smallrye-llm

Experimentation around LLM and MicroProfile

How to run examples.

Install LM Sutdio

https://lmstudio.ai/

Download model

Mistral 7B Instruct v0.2

Run

On left goto "local server", select the model in dropdown combo on the top, then start server