What is the meaning of total_episodes?

[weizier]

default total_episodes = 1 in the code

[umair-nasir14]

Hi,

Apologies for the delayed reply!~

total_episodes are the tries that an LLM gets to complete an objective. In Table 3 of the paper (https://arxiv.org/pdf/2410.07765) you see the results for 1-shot, which can be replicated by setting total_episode to 2.

I hope this clarifies your question!