Adding copilot metrics #487

austenstone · 2025-07-04T22:02:51Z

Introduces functionality to query and process GitHub Copilot metrics for organizations and teams. It includes new API integrations, data models, query handlers, and tests to support this feature.

Fixes #425

CLAassistant · 2025-07-04T22:02:58Z

Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
_{You have signed the CLA already but the status is still pending? Let us recheck it.}

…ds list

itsmylife · 2025-07-10T12:15:33Z

Hey @austenstone 👋 Thanks for this PR. It's amazing work and I'm planning to review it throughly. But I noticed that you accidently pushed package-lock.json file. Could you please remove it?

austenstone · 2025-07-10T15:35:04Z

@itsmylife I honestly did all of this with Claude sonnet to get the ball rolling. I did review and test that it worked but I think the UI for data selection needs some TLC.

Glad to hear you're opening to accepting the PR. I'll keep working on it.

This functionality will help a lot of people!

itsmylife

I didn't finished my review yet but I just want to share these. After testing it with proper access token and check backend code throughly I'll share another feedback.
Thank you very much for sparing time for this feature!

itsmylife · 2025-07-25T13:51:31Z

src/views/QueryEditorCopilotMetrics.tsx

+      <Input
+        aria-label={components.QueryEditor.Owner.input}
+        width={RightColumnWidth}
+        value={owner}
+        onChange={(el) => setOwner(el.currentTarget.value)}
+        onBlur={(el) =>
+          props.onChange({
+            ...props,
+            owner: el.currentTarget.value,
+          })
+        }
+      />


No need to define this expilicitly. In QueryEditor QueryType.Copilot_Metrics must be removed from nonRepoTypes.

itsmylife · 2025-07-25T13:51:46Z

src/views/QueryEditor.tsx

 };

-const nonRepoTypes = [QueryType.Projects, QueryType.ProjectItems];
+const nonRepoTypes = [QueryType.Projects, QueryType.ProjectItems, QueryType.Copilot_Metrics];


Suggested change

const nonRepoTypes = [QueryType.Projects, QueryType.ProjectItems, QueryType.Copilot_Metrics];

const nonRepoTypes = [QueryType.Projects, QueryType.ProjectItems];

itsmylife · 2025-07-25T13:53:15Z

src/views/QueryEditorCopilotMetrics.tsx

+
+const QueryEditorCopilotMetrics = (props: Props) => {
+  const [team, setTeam] = useState(props.teamSlug || '');
+  const [owner, setOwner] = useState<string>(props.owner || '');


No need this one since we'll remove owner input component

itsmylife · 2025-07-25T13:54:05Z

src/types/query.ts

+  organization?: string;
+  teamSlug?: string;
+  since?: string;
+  until?: string;
+  page?: number;
+  perPage?: number;


I think we don't use this many fields. In the editor only teamSlug is being used. The rest is useless for now.

itsmylife · 2025-07-25T13:58:07Z

pkg/models/copilot_metrics.go

+		Since:        opt.Since,
+		Until:        opt.Until,
+		Page:         opt.Page,
+		PerPage:      opt.PerPage,


Those are not passed from frontend for now so we can remove them.

itsmylife

I couldn't test it because I don't have an organization which has copilot metrics and has permission to see them. But I left a bunch of comments.

itsmylife · 2025-07-25T20:35:44Z

pkg/github/copilot_metrics.go

+	frameName := "copilot_metrics"
+	if opts.TeamSlug != "" {
+		frameName = "copilot_metrics_team"
+	}
+
+	return copilotMetricsToDataFrame(CopilotMetricsResponse(metrics), frameName)


we don't need these I believe. Just returning metrics would be enough. Frames() method will handle this part. So we don't need copilotMetricsToDataFrame too

itsmylife · 2025-07-25T20:49:15Z

pkg/models/copilot_metrics.go

+// ListCopilotMetricsOptions defines the options for listing Copilot metrics for an organization or team
+type ListCopilotMetricsOptions struct {
+	Organization string     `json:"organization"`
+	TeamSlug     string     `json:"team_slug,omitempty"`
+	Since        *time.Time `json:"since,omitempty"`
+	Until        *time.Time `json:"until,omitempty"`
+	Page         int        `json:"page,omitempty"`
+	PerPage      int        `json:"per_page,omitempty"`
+}
+
+// CopilotMetrics represents a daily metrics record for Copilot usage
+type CopilotMetrics struct {
+	Date                      string                    `json:"date"`
+	TotalActiveUsers          int                       `json:"total_active_users"`
+	TotalEngagedUsers         int                       `json:"total_engaged_users"`
+	CopilotIDECodeCompletions CopilotIDECodeCompletions `json:"copilot_ide_code_completions"`
+	CopilotIDEChat            CopilotIDEChat            `json:"copilot_ide_chat"`
+	CopilotDotcomChat         CopilotDotcomChat         `json:"copilot_dotcom_chat"`
+	CopilotDotcomPullRequests CopilotDotcomPullRequests `json:"copilot_dotcom_pull_requests"`
+}
+
+// CopilotIDECodeCompletions represents code completion metrics in IDEs
+type CopilotIDECodeCompletions struct {
+	TotalEngagedUsers int                      `json:"total_engaged_users"`
+	Languages         []CopilotLanguageMetrics `json:"languages"`
+	Editors           []CopilotEditorMetrics   `json:"editors"`
+}
+
+// CopilotIDEChat represents chat metrics in IDEs
+type CopilotIDEChat struct {
+	TotalEngagedUsers int                        `json:"total_engaged_users"`
+	Editors           []CopilotEditorChatMetrics `json:"editors"`
+}
+
+// CopilotDotcomChat represents chat metrics on GitHub.com
+type CopilotDotcomChat struct {
+	TotalEngagedUsers int                `json:"total_engaged_users"`
+	Models            []CopilotChatModel `json:"models"`
+}
+
+// CopilotDotcomPullRequests represents pull request metrics on GitHub.com
+type CopilotDotcomPullRequests struct {
+	TotalEngagedUsers int                        `json:"total_engaged_users"`
+	Repositories      []CopilotRepositoryMetrics `json:"repositories"`
+}
+


you don't need all those to define. You can use restClient. Please check ListAlertsForRepo in client/client.go

i.e.

metrics, resp, err := client.restClient.Copilot.GetOrganizationMetrics(ctx, owner, &googlegithub.CopilotMetricsListOptions{ Since: nil, Until: nil, ListOptions: googlegithub.ListOptions{ Page: 0, PerPage: 0, }, })

ChrisSyme · 2025-09-11T03:54:23Z

@austenstone how are you going with this? Do you need any assistance? I'd love to see this functionality added

…to copilot

austenstone · 2025-09-16T13:39:33Z

@austenstone how are you going with this? Do you need any assistance? I'd love to see this functionality added

Hi! I've been slacking here.
I just pushed some changes (related to @itsmylife comments) that I worked on a few weeks ago.
I think this is very close. I just need to find time to clean up a few things. Feel free to fork and edit my work.

austenstone requested a review from a team as a code owner July 4, 2025 22:02

Adding copilot metrics

b5c7797

austenstone force-pushed the copilot branch from ce453d8 to b5c7797 Compare July 4, 2025 22:05

austenstone added 2 commits July 4, 2025 19:58

refactor: unify Copilot metrics handling for organizations and teams

a707c74

fix: correct spelling in cspell configuration and add "neovim" to wor…

f7f9378

…ds list

itsmylife self-assigned this Jul 10, 2025

austenstone added 4 commits July 10, 2025 11:39

lock files

d156b2a

cleanup

c73c084

fix ui

7519cfd

fix ui

b6f499d

itsmylife reviewed Jul 25, 2025

View reviewed changes

Merge branch 'copilot' of github.com:austenstone/github-datasource in…

9b99859

…to copilot

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Adding copilot metrics #487

Adding copilot metrics #487

Uh oh!

austenstone commented Jul 4, 2025 •

edited

Loading

Uh oh!

CLAassistant commented Jul 4, 2025 •

edited

Loading

Uh oh!

itsmylife commented Jul 10, 2025

Uh oh!

austenstone commented Jul 10, 2025

Uh oh!

itsmylife left a comment

Uh oh!

itsmylife Jul 25, 2025

Uh oh!

itsmylife Jul 25, 2025

Uh oh!

itsmylife Jul 25, 2025

Uh oh!

itsmylife Jul 25, 2025

Uh oh!

itsmylife Jul 25, 2025

Uh oh!

itsmylife left a comment

Uh oh!

itsmylife Jul 25, 2025

Uh oh!

itsmylife Jul 25, 2025

Uh oh!

ChrisSyme commented Sep 11, 2025

Uh oh!

austenstone commented Sep 16, 2025

Uh oh!

Uh oh!

	const nonRepoTypes = [QueryType.Projects, QueryType.ProjectItems, QueryType.Copilot_Metrics];
	const nonRepoTypes = [QueryType.Projects, QueryType.ProjectItems];

Adding copilot metrics #487

Are you sure you want to change the base?

Adding copilot metrics #487

Uh oh!

Conversation

austenstone commented Jul 4, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

CLAassistant commented Jul 4, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

itsmylife commented Jul 10, 2025

Uh oh!

austenstone commented Jul 10, 2025

Uh oh!

itsmylife left a comment

Choose a reason for hiding this comment

Uh oh!

itsmylife Jul 25, 2025

Choose a reason for hiding this comment

Uh oh!

itsmylife Jul 25, 2025

Choose a reason for hiding this comment

Uh oh!

itsmylife Jul 25, 2025

Choose a reason for hiding this comment

Uh oh!

itsmylife Jul 25, 2025

Choose a reason for hiding this comment

Uh oh!

itsmylife Jul 25, 2025

Choose a reason for hiding this comment

Uh oh!

itsmylife left a comment

Choose a reason for hiding this comment

Uh oh!

itsmylife Jul 25, 2025

Choose a reason for hiding this comment

Uh oh!

itsmylife Jul 25, 2025

Choose a reason for hiding this comment

Uh oh!

ChrisSyme commented Sep 11, 2025

Uh oh!

austenstone commented Sep 16, 2025

Uh oh!

Uh oh!

austenstone commented Jul 4, 2025 •

edited

Loading

CLAassistant commented Jul 4, 2025 •

edited

Loading