Skip to content

Issues: triton-inference-server/model_analyzer

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

23 Open 142 Closed
23 Open 142 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

model_analyzer profile with mig : DCGM initialization error
#954 opened Dec 25, 2024 by jason-i-vv
2
TritonModelAnalyzerException: [StatusCode.UNAVAILABLE] failed to connect to all addresses; Failed to connect to remote host: Timeout occurred: FD Shutdown
#950 opened Nov 26, 2024 by C-Dhayananthan
Latency report file from perf analyzer is not found
#937 opened Oct 8, 2024 by shreyassks
2
Invalid genai-perf command line for LLM model type
#935 opened Oct 2, 2024 by vlad-vinogradov-47
@nv-braf
1
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xf8 in position 0: invalid start byte
#931 opened Sep 12, 2024 by Anas0x45
model_analyzer.model_analyzer_exceptions.TritonModelAnalyzerException: The first 2 attempts to acquire measurements have failed.
#920 opened Jul 26, 2024 by gizarchik
1
DCGM initialization error
#910 opened Jul 9, 2024 by minhhoai1001
1
wrong with --triton-launch-mode=remote
#908 opened Jul 4, 2024 by RheaRia
2
How to analyze large models like llama 3 70B that requires model parallelism?
#907 opened Jun 28, 2024 by ccchow
3
How to sweep GPUs using Model Analyzer
#906 opened Jun 27, 2024 by lionsheep24
1
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xf8 in position 0: invalid start byte
#901 opened Jun 14, 2024 by kyosukegg
7
Time intervals in model analyzer
#880 opened May 21, 2024 by YaliEkstein
custom samples
#875 opened May 15, 2024 by riyajatar37003
1
--triton-launch-mode=remote
#874 opened May 15, 2024 by riyajatar37003
4
Understanding GPU utilization
#870 opened May 7, 2024 by siretru
5
Sending multiple shapes binary input data
#863 opened Apr 20, 2024 by eladamittai
5
Model Analyzer - NO Gpu Metrics collection
#862 opened Apr 18, 2024 by aptmess
Model Analyzer GPU Memory Usage Differences
#847 opened Mar 25, 2024 by KimiJL
5
Feature idea: perf analyzer behavior control enhancement New feature or request
#808 opened Jan 7, 2024 by Talavig
1
14
Questions regarding config search enhancement New feature or request
#805 opened Dec 29, 2023 by Talavig
11
Unexpected error: perf_analyzer did not produce any output. It was likely terminated with a SIGABRT bug Something isn't working
#750 opened Aug 23, 2023 by wxthu
12
How to load a pytorch model with model analyzer
#699 opened Jun 5, 2023 by benhgm
16
Dose model analyzer tool support Jetson nano? enhancement New feature or request
#123 opened Apr 25, 2021 by liwenhust8282
3
ProTip! Exclude everything labeled bug with -label:bug.