Steps to use with Ollama

[easis]

Hi! I recently discovered how easy it is to use TinyTroupe with Ollama and wanted to share it with you all:

import os
from tinytroupe.factory import TinyPersonFactory

os.environ["OPENAI_API_KEY"] = "ollama"
os.environ["OPENAI_BASE_URL"] = "http://localhost:11434/v1"

bank_spec = "A large brazillian bank. It has a lot of branches and a large number of employees. It is facing a lot of competition from fintechs."
banker_spec = "A vice-president of one of the largest brazillian banks. Has a degree in engineering and an MBA in finance."

banker_factory = TinyPersonFactory(bank_spec)
banker = banker_factory.generate_person(banker_spec, attepmpts=1)
print(banker)

bio = banker.minibio()
print(bio)

You might see an error like this:

TypeError: Cannot merge different types: <class 'list'> and <class 'dict'> for key 'relationships'

TypeError: 'NoneType' object is not subscriptable
^^^ Highlighting self._persona['occupation']['title']

And this message in your ollama serve console:

level=WARN source=runner.go:130 msg="truncating input prompt" limit=2048 prompt=4128 keep=4 new=2048

This means your context window size is 2048, and you need to increase it.

To do this, create a file named Modelfile (or any name you prefer) with the following content:

FROM llama3.2:3b # Your model here
PARAMETER num_ctx 32768 # Context size here

Then run the following command (adjust the last argument to match your model):

ollama create -f Modelfile llama3.2:3b

(Reference)