Support "MemoryDB(AWS)" or "ElasticCache for Redis(ClusterMode)" for message broker

[kgwangehee]

Hello,

I'm looking to set up AWS's MemoryDB or ElasticCache for Redis as a cluster for celery's message broker.

When configuring this with celery, I encounter errors like "Failed to capture events: 'CROSSSLOT Keys in request don't hash to the same slot'."

From what I found on Stack Overflow(https://stackoverflow.com/questions/76006734/a-proper-way-to-use-aws-redis-cluster-with-celery), it seems Celery doesn't yet support Redis cluster mode. Does that mean I can't use cluster mode Redis like MemoryDB and ElasticCache from AWS as brokers for Celery?

[alexander-schmidt-mf]

Hello,

I wanted to use the ElatiCache Serverless which only runs in a cluster. Now I get the same error: "CROSSSLOT Keys in request don't hash to the same slot".

So I am looking forward for this feature too.

Thanks
Alex

[auvipy]

we got an open pr for redis cluster support celery/kombu#2204