This repo uses llama3 with simple yet meaningfull example of creating document bot.
Exploring ollama capabilities & POC.
we used langchain framework to connect to ollama server to do embeding of the pdf and creating vector from it later be used to fetch simillar phrases from pdf than all of that goes into prompt to be proccessed by ollama.
ollama3 is Meta LLM which is opensource!
in the code we use 2 models:
- 8b (for GenAI, simillar to gpt, claud, etc.. models)
- nomic-embed-text (for embedding, simillar to ada2)
we have a Dockerfile containing the ollama server and the 2 models you can play with it as you want.
you can access it via dockerhub