Skip to content

Commit

Permalink
small change
Browse files Browse the repository at this point in the history
  • Loading branch information
snova-rodrigom committed Sep 27, 2024
1 parent de56e6f commit ee5814b
Showing 1 changed file with 3 additions and 0 deletions.
3 changes: 3 additions & 0 deletions benchmarking/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -182,6 +182,7 @@ This option allows you to evaluate the performance of the selected LLM on synthe
- Timeout: 600

Results:

![dynamic_batching_speed-ttft](./imgs/dynamic_batching_speed-ttft.png)
![dynamic_batching_speed-latency](./imgs/dynamic_batching_speed-latency.png)
![dynamic_batching_speed-output_throughput](./imgs/dynamic_batching_speed-output_throughput.png)
Expand All @@ -200,6 +201,7 @@ This option allows you to evaluate the performance of the selected LLM on synthe
- Timeout: 600

Results:

![high_input_output_tokens-ttft](./imgs/high_input_output_tokens-ttft.png)
![high_input_output_tokens-latency](./imgs/high_input_output_tokens-latency.png)
![high_input_output_tokens-output_throughput](./imgs/high_input_output_tokens-output_throughput.png)
Expand All @@ -218,6 +220,7 @@ This option allows you to evaluate the performance of the selected LLM on synthe
- Timeout: 600

Results:

![running_multiple_concurrent_requests-ttft](./imgs/running_multiple_concurrent_requests-ttft.png)
![running_multiple_concurrent_requests-latency](./imgs/running_multiple_concurrent_requests-latency.png)
![running_multiple_concurrent_requests-output_throughput](./imgs/running_multiple_concurrent_requests-output_throughput.png)
Expand Down

0 comments on commit ee5814b

Please sign in to comment.