0

I found that Redis Queue is a good broker to start the a new task for processing. However, I don't know whether Redis Queue is using Multithreading or Multiprocessing in Python?.

The original repo is here: https://github.com/rq/rq

"RQ (Redis Queue) is a simple Python library for queueing jobs and processing them in the background with workers"

Furthermore, what is the meaning of workers here? Is it processors (CPU cores) in the computer?

Thank you guys

1 Answer 1

2

Redis Queue is indeed a distributed task queue, which similar to Celery. The task/job is typically distributed across machines (on which deploy worker). It differs from the regular multi-process or thread which using multiprocessing standard library.

The worker is a process which consume the task/job from Redis (which acting as a message queue here, like RabbitMQ, Kafka), and then process the task, and send back the result.

Sign up to request clarification or add additional context in comments.

1 Comment

Thank you so much for your explanation. I can fully understand what you say.

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.