Tasks for Dataset Generation

[thelechen]

Tasks:

• Refine the definition of Questioner and Solver: prompts and workflow.
• Replace GPT (current data generation model) with open-source models and run data generation.
• Data cleaning and analysis.
• Save all the conversations: failed experience.
• Refine the conversation parsing and splitting process. ref: https://docs.google.com/document/d/1ZTuASlzFn7f4FRVRqw7uCvgvOnB18NQ2bQwS9YK07pg/edit?usp=sharing
• [ ]