2: Models

[nirgranthi]

It is honestly unbelievable how much the models have progressed in just a year, I remember the small 0.5b and 3b models having only few thousands or hundred context length and now it is hundred thousands.

Once this project gets out of beta phase, I think the best option to get the best models for this would be just to ask the community on reddit.

[nirgranthi]

Dawg, you right as hell