Skip to content

Corrected latency statistics when batchsize is greater than 1 #527

Corrected latency statistics when batchsize is greater than 1

Corrected latency statistics when batchsize is greater than 1 #527

Triggered via pull request April 10, 2024 08:19
Status Success
Total duration 12m 53s
Billable time 54m
Artifacts

causal_lm_cpp.yml

on: pull_request
cpp-beam_search_causal_lm-Mistral-7B
5m 50s
cpp-beam_search_causal_lm-Mistral-7B
cpp-greedy_causal_lm-ubuntu
4m 50s
cpp-greedy_causal_lm-ubuntu
cpp-beam_search_causal_lm-ubuntu
6m 25s
cpp-beam_search_causal_lm-ubuntu
cpp-beam_search_causal_lm-windows
11m 44s
cpp-beam_search_causal_lm-windows
cpp-beam_search_causal_lm-Qwen-7B-Chat
11m 52s
cpp-beam_search_causal_lm-Qwen-7B-Chat
cpp-beam_search_causal_lm-Qwen1_5-7B-Chat
5m 14s
cpp-beam_search_causal_lm-Qwen1_5-7B-Chat
cpp-beam_search_causal_lm-Phi-2
4m 12s
cpp-beam_search_causal_lm-Phi-2
cpp-beam_search_causal_lm-notus-7b-v1
4m 51s
cpp-beam_search_causal_lm-notus-7b-v1
cpp-speculative_decoding_lm-ubuntu
9m 49s
cpp-speculative_decoding_lm-ubuntu
cpp-Phi-1_5
4m 22s
cpp-Phi-1_5
Fit to window
Zoom out
Zoom in

Annotations

10 warnings
cpp-beam_search_causal_lm-Phi-2
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/setup-python@v4. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
cpp-Phi-1_5
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/setup-python@v4. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
cpp-greedy_causal_lm-ubuntu
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/setup-python@v4. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
cpp-beam_search_causal_lm-notus-7b-v1
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/setup-python@v4. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
cpp-beam_search_causal_lm-Qwen1_5-7B-Chat
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/setup-python@v4. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
cpp-beam_search_causal_lm-ubuntu
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/setup-python@v4. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
cpp-beam_search_causal_lm-Mistral-7B
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/setup-python@v4. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
cpp-speculative_decoding_lm-ubuntu
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/setup-python@v4. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
cpp-beam_search_causal_lm-windows
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/setup-python@v4. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
cpp-beam_search_causal_lm-Qwen-7B-Chat
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/setup-python@v4. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.