chore: replace kafka with redpanda for e2e testing

[whynowy]

What this PR does / why we need it

Briefly describe the problem and the solution.

Related issues

Fixes #

Testing

How was this tested (unit/integration/manual)? Include commands, links, or screenshots if applicable.

Special notes for reviewers

Anything notable for review (risk, rollout, follow-ups).

[codecov]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 79.83%. Comparing base (75c6158) to head (44edda5).

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #3077      +/-   ##
==========================================
+ Coverage   79.72%   79.83%   +0.10%     
==========================================
  Files         291      291              
  Lines       65063    65063              
==========================================
+ Hits        51873    51942      +69     
+ Misses      12638    12569      -69     
  Partials      552      552              

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.