Ответы LLM недетерминированны – можно задать один и тот же вопрос несколько раз и каждый раз получать разные ответы.

Например, стандартный вопрос из тестов на IQ:

* Start with a full cup of black coffee (no milk) and drink
one-third of it.
* Now pour into the cup an amount of milk equal to the coffee
you have just drunk, and stir well.
* Now drink a further half of the resultant mixture.
* Now pour into the cup a further amount of milk equal to the
mixture you have just drunk and stir well again.
* Now drink one-sixth of the resultant mixture.
* Now pour into the cup a further amount of milk equal to the
mixture you have just drunk, stir well, and finally, drink the
whole cup of liquid.
Have you drunk more milk or more coffee in total?

Ответ:

 (далее…)