[mcp-analysis] GitHub MCP Structural Analysis - February 13, 2026 #15383
Closed
Replies: 1 comment
-
|
This discussion was automatically closed because it expired on 2026-02-20T11:20:24.372Z.
|
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Analyzed 19 GitHub MCP tools across 10 toolsets to evaluate response sizes and structural usefulness for agentic workflows. Average usefulness rating: 4.05/5 with 10 tools rated excellent (5/5). Total token usage today: 29,488 tokens. Key finding: Most efficient tools are
get_file_contents(25 tokens, 5/5),get_label(50 tokens, 5/5), andlist_branches(100 tokens, 5/5). Context-heavy tools includelist_releases(7,058 tokens),list_pull_requests(5,125 tokens), andlist_workflows(3,885 tokens) due to broken pagination or nested redundancy.View Full Structural Analysis Report
Executive Summary
get_file_contents: 5/5 ⭐⭐⭐⭐⭐ (25 tokens)get_me,list_notifications: 1/5 ⭐ (403 errors)get_file_contents(25 tokens),get_label(50 tokens),list_branches(100 tokens)list_releases(7,058 tokens),list_pull_requests(5,125 tokens),list_workflows(3,885 tokens)Usefulness Ratings for Agentic Work
Tools rated by their structural usefulness for autonomous agent workflows (1-5 scale).
⭐⭐⭐⭐⭐ Excellent (Rating 5/5) - 10 Tools
These tools provide complete, actionable data with clean structures. Immediately usable by agents.
get_file_contentsget_labellist_brancheslist_tagsget_commit(no diff)list_discussionslist_commitssearch_repositoriesissue_readlist_issues⭐⭐⭐⭐ Good (Rating 4/5) - 5 Tools
Good data with minor gaps or redundancy. Mostly actionable but room for improvement.
search_codesearch_issuesget_repository_treesearch_pull_requestsget_repository_tree⭐⭐⭐ Adequate (Rating 3/5) - 3 Tools
Usable but requires supplementary calls or has significant inefficiencies.
list_workflowsperPage=1. Context-heavy.list_pull_requestslist_releases⭐ Poor (Rating 1/5) - 2 Tools
Unavailable or broken in GitHub Actions context. Not usable for agents in CI.
get_melist_notificationsSchema Analysis
Response structures and organization patterns identified:
get_file_contentscontentget_labelid,name,color,descriptionlist_branchesname,sha,protectedlist_issuesissues[],pageInfo,totalCountlist_pull_requestsid,number,head.repo,base.repolist_workflowstotal_count,workflows[]search_repositoriestotal_count,items[].id,items[].nameget_repository_treesha,tree[].path,tree[].typeSchema Patterns Observed:
list_issues,list_discussions): Excellent structure with cursor pagination and clean response shapesperPageparameterResponse Size Analysis
Token usage by toolset (average per tool):
Tool-by-Tool Detailed Analysis
Complete reference table for all 19 tools analyzed today:
get_file_contentsget_labellist_brancheslist_tagsget_commitlist_discussionslist_commitssearch_repositoriessearch_codeissue_readlist_issuessearch_issuesget_repository_treesearch_pull_requestslist_workflowslist_pull_requestslist_releasesget_melist_notifications30-Day Trend Summary
Data collected from February 6 - February 13, 2026 (8 days, 66 data points):
get_file_contents(8 times)Trends Observed:
list_releases: 7,058-7,551 tokens) due to content changeslist_workflowsandlist_pull_requestsremain across all test daysget_me,list_notifications) consistently fail in Actions contextRecommendations
Based on structural analysis and usefulness ratings:
✅ High-Value Tools (Rating 4-5, Recommended for Agents)
Context-Efficient Champions (< 500 tokens, rating 5/5):
get_file_contents(25 tokens) - File readingget_label(50 tokens) - Label operationslist_branches(100 tokens) - Branch listinglist_tags(100 tokens) - Tag listingget_commitwithinclude_diff=false(200 tokens) - Commit metadatalist_discussions(275 tokens) - Discussion listinglist_commits(325 tokens) - Commit historysearch_repositories(350 tokens) - Repo discoveryFeature-Rich High-Value Tools (> 500 tokens, rating 5/5):
issue_read(950 tokens) - Single issue detailslist_issues(1,650 tokens) - Issue listing with GraphQLGood Tools Worth Using (rating 4/5):
search_code(950 tokens) - Code discoverysearch_issues(2,600 tokens) - Issue search across reposget_repository_tree(2,645 tokens) - Directory explorationsearch_pull_requests(3,200 tokens) - PR discoveryPagination Issues:
list_workflows- Action Required: Fix pagination. Currently returns all 193 workflows regardless ofperPageparameterlist_pull_requests- Action Required: Reduce nested repo duplication. Consider lightweight response optionlist_releases- Action Required: Add option to exclude full release body or assets for listing operationsRecommendations for Improvement:
minimal=trueparameter to return only essential fieldslist_workflows,list_workflow_runs)❌ Unavailable Tools (Rating 1/5)
Authentication-Restricted:
get_me- Not accessible by GitHub Actions integration tokenlist_notifications- Not accessible by GitHub Actions integration tokenprojects_list- 404 errors in many contextsRecommendations:
🎯 Context Optimization Strategy
For Context-Conscious Agents:
list_issues,list_discussions) for clean structures and good paginationinclude_diff=falsewhen callingget_committo save tokenslist_tags+get_release_by_taginsteadContext Budget Guidelines:
get_file_contents,get_label,list_branches,list_tags)get_commit,list_discussions,list_commits,search_repositories)issue_read,list_issues,search_issues)get_repository_tree,search_pull_requests,list_workflows,list_pull_requests)list_releases) - use cautiouslyVisualizations
Response Size by Toolset
Average token usage per toolset. Shows
releases,pull_requests, andactionsas the heaviest toolsets.Usefulness Ratings by Toolset
Average usefulness ratings (1-5 scale). Green bars (≥4) indicate good-to-excellent tools for agents. Orange/red bars indicate tools needing improvement.
Daily Token Usage Trend
Total token usage over the 8-day analysis period. Shows stable daily patterns around 28K-30K tokens per analysis run.
Token Size vs Usefulness Rating
Scatter plot showing the relationship between token size and usefulness. Ideal tools are in the lower-right (small size, high rating). Upper-left quadrant shows context-heavy, low-value tools to avoid.
Rating Distribution
Distribution of usefulness ratings. Shows most tools (10) are rated excellent (5 stars), with good balance across rating categories.
Analysis Methodology: Each tool tested with minimal parameters (perPage=1 where applicable) to measure baseline response size and structure. Token counts estimated at 1 token ≈ 4 characters. Usefulness ratings based on completeness, actionability, clarity, efficiency, and relationship inclusion. Data persisted in cache memory with 30-day rolling window.
References:
Beta Was this translation helpful? Give feedback.
All reactions