1
$\begingroup$

When I tried to ask Mistral to give results back in JSON format, the results were very good on Bedrock .
When I used mistral on ubuntu but on CPU the results were really bad.
Also, on the gpu server stableLM was running, that also gave good results.

Does underlying hardware impacts results?

Improve this question
$\endgroup$

1 Answer 1

Reset to default
1
$\begingroup$

Does underlying hardware impacts results?

May slightly impacts results, but shouldn't be dramatic. I'd check if the models you ran are the same.

Improve this answer
$\endgroup$
1
  • $\begingroup$ even ollama on cpu vs gpu for same model... results are much different $\endgroup$ Commented Mar 28 at 12:55

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.