eval_math and eval_gsm8k #30
Description
Hi! I am wondering how do you control the LLM's output if you don't explicitly tell it to output the answer with the format "The answer is: "? (as written in the function process_results()) I didn't see such prompt in your provided code. I ran your code without any modifications, and the LLM does not output the answer with "The answer is", making the result unjudgable. Thank you !
BTW, could you please also provide few shot examples for eval_math and eval_gsm8k, if they exist? Thanks!