Repeatability
#25
by peterlian - opened
I noticed Orca2 often gives different answers if you ask the same question multiple times. For example, here is the multiple choice problem shown in the original paper. The correct answer is C. If I ask Orca2 (13B, Q4 Q8), it alternates between answer C and D. The temperature in the setting is zero. Any thoughts?
Scientists have studied the productivity of crops in mountain valleys. In some areas, the valleys are more productive than others. The increase in which factor most likely accounts for the high productivity of some areas in mountain valleys? Options:
(A)leaching of soils
(B)evaporation rates
(C)runoff from rains
(D)amounts of sunlight.