Skip to content

Commit 326ed21

Browse files
committed
docs - have 1 section for routing +load balancing
1 parent 50314a6 commit 326ed21

File tree

3 files changed

+13
-8
lines changed

3 files changed

+13
-8
lines changed

docs/my-website/docs/proxy/load_balancing.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,4 @@
1-
# Multiple Instances
1+
# Proxy - Load Balancing
22
Load balance multiple instances of the same model
33

44
The proxy will handle routing requests (using LiteLLM's Router). **Set `rpm` in the config if you want maximize throughput**

docs/my-website/docs/proxy/reliability.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@ import Image from '@theme/IdealImage';
22
import Tabs from '@theme/Tabs';
33
import TabItem from '@theme/TabItem';
44

5-
# Fallbacks, Load Balancing, Retries
5+
# Proxy - Fallbacks, Retries
66

77
- Quick Start [load balancing](#test---load-balancing)
88
- Quick Start [client side fallbacks](#test---client-side-fallbacks)

docs/my-website/sidebars.js

Lines changed: 11 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -96,11 +96,10 @@ const sidebars = {
9696
label: "Spend Tracking + Budgets",
9797
items: ["proxy/cost_tracking", "proxy/users", "proxy/custom_pricing", "proxy/team_budgets", "proxy/billing", "proxy/customers"],
9898
},
99-
"proxy/reliability",
10099
{
101-
type: "category",
102-
label: "Routing",
103-
items: ["proxy/load_balancing", "proxy/tag_routing", "proxy/provider_budget_routing", "proxy/team_based_routing", "proxy/customer_routing",],
100+
type: "link",
101+
label: "Load Balancing, Routing, Fallbacks",
102+
href: "https://docs.litellm.ai/docs/routing-load-balancing",
104103
},
105104
{
106105
type: "category",
@@ -267,8 +266,14 @@ const sidebars = {
267266
},
268267
{
269268
type: "category",
270-
label: "Load Balancing",
271-
items: ["routing", "scheduler"],
269+
label: "Load Balancing & Routing",
270+
link: {
271+
type: "generated-index",
272+
title: "Load Balancing & Routing",
273+
description: "Learn how to load balance, route, and set fallbacks for your LLM requests",
274+
slug: "/routing-load-balancing",
275+
},
276+
items: ["routing", "scheduler", "proxy/load_balancing", "proxy/reliability", "proxy/tag_routing", "proxy/provider_budget_routing", "proxy/team_based_routing", "proxy/customer_routing"],
272277
},
273278
{
274279
type: "category",

0 commit comments

Comments
 (0)