Skip to content

Conversation

@btsheehy
Copy link

@btsheehy btsheehy commented Feb 3, 2026

The fastly service list --json command returns a massive amount of unnecessary data, especially when your account has nearly 100 services.

More specifically, every service includes an array with details on every version its ever had. We have nearly 100 services, some of which have 700+ versions. Our fastly service list --json currently returns over 1.15 MB of text, or roughly 448,310 tokens, and that number can only grow.

This immediately overloads the LLM context for most models and causes the call to fail.

I've found this fix to work well, as it allows the LLM to truly obtain a simple list of services, then query what's necessary after that.

Perhaps you could instead intercept the json to remove the excess data before passing it to the LLM, but this seemed like the most straightforward approach.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant