Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(seer grouping): Add metrics for feature flag and eligible content #76639

Merged

Conversation

lobsterkatie
Copy link
Member

This adds two new metrics, grouping.similarity.event_from_backfilled_project and grouping.similarity.event_content_seer_eligible, to the helpers called in should_call_seer_for_grouping. In order that they both always be recorded, the order of checks there has also been rearranged, so failing one of the relevant checks doesn't prevent checking the other.

@github-actions github-actions bot added the Scope: Backend Automatically applied to PRs that change backend components label Aug 27, 2024
@lobsterkatie lobsterkatie force-pushed the kmclb-add-content-and-flag-metrics-to-seer-gouping branch from 083fa84 to 9a7de8d Compare August 27, 2024 22:15
@lobsterkatie lobsterkatie marked this pull request as ready for review August 28, 2024 16:16
@lobsterkatie lobsterkatie requested a review from a team as a code owner August 28, 2024 16:16
@lobsterkatie lobsterkatie merged commit f115699 into master Aug 28, 2024
50 checks passed
@lobsterkatie lobsterkatie deleted the kmclb-add-content-and-flag-metrics-to-seer-gouping branch August 28, 2024 17:19
ArthurKnaus pushed a commit that referenced this pull request Aug 29, 2024
#76639)

This adds two new metrics, `grouping.similarity.event_from_backfilled_project` and `grouping.similarity.event_content_seer_eligible`, to the helpers called in `should_call_seer_for_grouping`. In order that they both always be recorded, the order of checks there has also been rearranged, so failing one of the relevant checks doesn't prevent checking the other.
lobsterkatie added a commit that referenced this pull request Sep 4, 2024
…76895)

In #76639, I added a `grouping.similarity.event_from_backfilled_project` metric, to track what percentage of events without a hash come from projects with Seer grouping turned on. Unfortunately, I forgot that the `sentry:similarity_backfill_completed` project option contains a timestamp rather than a boolean, and as a result, we've been sending a super-high-cardinality tag to DataDog. Whoops.

To fix this, I obviously changed the tag value to be a boolean, but I also renamed the metric, from `event_from_backfilled_project` to `event_project_backfill_status`. This will let us just allow the problematic metric to age out, rather than worrying about selectively enabling tags for it (though I have, in fact, turned off indexing for that tag). As a bonus, it's a clearer name. (I discovered my mistake when adding a graph for the metric to our dashboard, but in that process, I had already confused myself by thinking that `event_from_backfilled_project` was only going to fire when the answer was yes.)
@github-actions github-actions bot locked and limited conversation to collaborators Sep 13, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
Scope: Backend Automatically applied to PRs that change backend components
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants