New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Synthetic Data #72

Open

manisnesan opened this issue Mar 19, 2024 · 2 comments

Owner

manisnesan commented Mar 19, 2024 •

edited

Loading

https://github.com/MoritzLaurer/synthetic-data-blog/tree/main

https://huggingface.co/blog/synthetic-data-save-costs#32-compare-the-open-source-model-to-proprietary-models

Related: #47 (comment)

Owner Author

manisnesan commented Mar 29, 2024

The problem: There is no data for your use-case
The solution: Synthetic data to teach efficient students

LLMs started reaching parity with human data annotators.
Implications: high-quality annotation labor is now available through APIs. | reproducible annotation instructions can be sent as prompts | synthetic data is returned almost instantaneously with compute as the only bottleneck.
How do you validate synthetic data is correct

Owner Author

manisnesan commented Apr 1, 2024

Related

How to Generate and Use Synthetic Data for Finetuning
https://eugeneyan.com/writing/synthetic/

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment