Modeling and simulating various queuing models for Large Language Model (LLM) inference systems such as-
M/M/1, M/M/k, G/G/1, G/M/1, and M/G/1:
-
Notifications
You must be signed in to change notification settings - Fork 0
Modeling and simulating various queuing models such as: M/M/1, M/M/k, G/G/1, G/M/1, and M/G/1 for Large Language Model (LLM) inference systems. These simlulations bridge the gap between theoretical frameworks and practical simulations, this provides valuable insights for developing scalable, energy-efficient AI infrastructures.
1lmao/Queuing-Theory
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
Modeling and simulating various queuing models such as: M/M/1, M/M/k, G/G/1, G/M/1, and M/G/1 for Large Language Model (LLM) inference systems. These simlulations bridge the gap between theoretical frameworks and practical simulations, this provides valuable insights for developing scalable, energy-efficient AI infrastructures.
Topics
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published