Jamba Evaluation Task on GSM8K
#39
by ssparks - opened
Hi, thanks for this wonderful work!
I have just tried Jamba evaluated on GSM8K using lm-evaluation-harness repo but got much lower result than the paper claimed. Could you please share how you do the evaluation task or do you have any plans to release the process of evaluation? Thanks a lot.