basic-kserve-vllm

Create minio and your data connections using the setup/setup-s3.yaml.
```
kubectl apply -n my-namespace -f setup/setup-s3.yaml 
```
Start a workbench using with git-lfs installed. OpenShift AI PyTorch notebook will work well. Make sure to set the data connection to My Storage
Clone this repository and run the notebook 1_download_save.ipynb
Serve a model using the UI or apply the yaml from sample-deployments
Test out the new endpoint using 2_vllm_rest_requests.ipynb and 3_vllm_openai_requests.ipynb

Name		Name	Last commit message	Last commit date
Latest commit History 16 Commits
sample-deployments		sample-deployments
setup		setup
.gitignore		.gitignore
1_download_save.ipynb		1_download_save.ipynb
2_vllm_rest_requests.ipynb		2_vllm_rest_requests.ipynb
3_openai_requests.ipynb		3_openai_requests.ipynb
4_langchain_requests.ipynb		4_langchain_requests.ipynb
LICENSE		LICENSE
README.md		README.md
vllm-4gpu-runtime.yaml		vllm-4gpu-runtime.yaml
vllm-runtime.yaml		vllm-runtime.yaml

Provide feedback