Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stack options.
benchmarking benchmark p5 bedrock evaluation-metrics sagemaker g6 p4d g5 foundation-models inferentia generative-ai llama2 deepseek trainium llama3 g6e deepseek-r1
-
Updated
Feb 26, 2025 - Jupyter Notebook