Skip to content

Commit

Permalink
Update.
Browse files Browse the repository at this point in the history
  • Loading branch information
squidarth committed Oct 2, 2023
1 parent 36b7ac1 commit 4929713
Showing 1 changed file with 0 additions and 5 deletions.
5 changes: 0 additions & 5 deletions docs/examples/6_high_performance/vllm.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -68,10 +68,6 @@ You can then invoke the model with:
$ truss predict -d '{"prompt": "What is a large language model?", "model": "facebook/opt-125M"}' --published
```

```yaml config.yaml
```

<RequestExample>
```yaml config.yaml
build:
Expand All @@ -94,6 +90,5 @@ resources:
use_gpu: true
secrets: {}
system_packages: []
```
</RequestExample>

0 comments on commit 4929713

Please sign in to comment.