Cloud LLM Dev Scripts

Instant setup for cloud-based LLM development.
Skip the environment configuration and start coding and testing in seconds.

Supported Systems: Debian/Ubuntu Linux (x86_64)

⚡ Quick Start

SGLang (with Mooncake & Router)

Sets up SGLang dev environment with P/D disaggregation dependencies.

cd sglang
source init_sglang_git.sh

See SGLang Cookbook for single-node and distributed launch instructions.

AWS S3

Stop paying rent for empty GPU instances.
Cloud providers charge for attached storage even when your instance is paused. Don't let your 500GB model checkpoints drain your wallet while you sleep. Offload everything to S3—it’s dirt cheap, infinite, and this script connects you in seconds.

export AWS_ACCESS_KEY=your_key
export AWS_SECRET_KEY=your_secret
export AWS_REGION=your_region
source init_s3.sh

Open WebUI

Give your LLM a beautiful face.
One command to launch the most popular chat interface on the planet, instantly connected to your API.

export OPENAI_API_BASE_URL=http://localhost:8000/v1
export OPENAI_API_KEY=sk-... 
source init_open-webui.sh

📜 Included Scripts

Script	Description
init_sglang_git.sh	Installs SGLang, Mooncake, and Router. Sets up pipx, uv, and virtual environment.
init_s3.sh	Installs AWS CLI and configures credentials securely in ~/.aws/.
init_open-webui.sh	Launches Open WebUI in Docker connected to your model API.

🔗 References

• SGLang Cookbook
• SGLang GitHub
• Open WebUI GitHub

✅ Tested Platforms

Platform	Status	System Spec
Local Devbox	✅ Verified	Ubuntu 24.04 (i7-12700K)
YottaLabs.ai	✅ Verified	Ubuntu 22.04 / 24.04
RunPod	🚧 Planned	-
Lambda Labs	🚧 Planned	-

---

Created by Fanyi Zhao (2026). MIT License.