Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(cdp): Mini purge of old ingesters #29341

Open
wants to merge 21 commits into
base: master
Choose a base branch
from

Conversation

benjackwhite
Copy link
Contributor

Problem

We're no longer using the old ingesters. Time to remove them and make sure all tests are pointing at new stuff

Changes

👉 Stay up-to-date with PostHog coding conventions for a smoother review.

Does this work well for both Cloud and self-hosted?

How did you test this code?

Copy link
Contributor

@greptile-apps greptile-apps bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

PR Summary

Mini purge of old ingesters

This PR removes deprecated ingestion systems from the plugin server, focusing on cleaning up old ingestion modes and their corresponding files that are no longer in use.

  • Removed several PluginServerMode entries including ingestion, ingestion_overflow, ingestion_historical, events_ingestion, and analytics_ingestion
  • Deleted four ingestion consumer files: analytics-events-ingestion-consumer.ts, analytics-events-ingestion-overflow-consumer.ts, analytics-events-ingestion-historical-consumer.ts, and events-ingestion-consumer.ts
  • Updated PROCESS_EVENT_CAPABILITIES in worker/vm/capabilities.ts to only include ingestionV2 and ingestionV2Combined
  • Modified all tests to use ingestionV2 instead of the deprecated ingestion capabilities
  • Removed corresponding test files for the deleted ingestion consumers

16 file(s) reviewed, 1 comment(s)
Edit PR Review Bot Settings | Greptile

Comment on lines 12 to +13
test('gives the right value for ingestion -> PluginServerMode.plugins_ingestion', () => {
expect(stringToPluginServerMode['ingestion']).toEqual(PluginServerMode.ingestion)
expect(stringToPluginServerMode['ingestion-v2']).toEqual(PluginServerMode.ingestion_v2)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

style: The test description still mentions 'ingestion -> PluginServerMode.plugins_ingestion' but is actually testing 'ingestion-v2 -> PluginServerMode.ingestion_v2'

Suggested change
test('gives the right value for ingestion -> PluginServerMode.plugins_ingestion', () => {
expect(stringToPluginServerMode['ingestion']).toEqual(PluginServerMode.ingestion)
expect(stringToPluginServerMode['ingestion-v2']).toEqual(PluginServerMode.ingestion_v2)
test('gives the right value for ingestion-v2 -> PluginServerMode.ingestion_v2', () => {
expect(stringToPluginServerMode['ingestion-v2']).toEqual(PluginServerMode.ingestion_v2)

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These tests have all been replaced by the ingestion consumer tests with snapshots confirming things working as expected

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant