Deploy open-source LLMs on AWS in minutes — with OpenAI-compatible APIs and a powerful CLI/SDK toolkit.
ec2 ecs sagemaker huggingface qwq langchain large-language-model vllm ollama deepseek comfyui-workflow inferentia-2 internlm2 openai-compatible-api qwen2-5 deepseek-v3 deepseek-r1 qwq-32b gemma3 qwen3
-
Updated
Jul 25, 2025 - Python