Skip to main content
Updated description
Source Link
Ahmed Al Hafoudh
  • 8.5k
  • 1
  • 21
  • 35

Let's say we have some web crawling system which needs to scale to many workers. Each worker has a limit for example max. 5 HTTP requests per minute per web host that could be crawled.

"per web host" can be in message header and which will be populated by producer.

Can I teach ActiveMQ to dispatch messages to nodes in this fasion?

Let's say we have some web crawling system which needs to scale to many workers. Each worker has a limit for example max. 5 HTTP requests per minute per web host that could be crawled.

Can I teach ActiveMQ to dispatch messages to nodes in this fasion?

Let's say we have some web crawling system which needs to scale to many workers. Each worker has a limit for example max. 5 HTTP requests per minute per web host that could be crawled.

"per web host" can be in message header and which will be populated by producer.

Can I teach ActiveMQ to dispatch messages to nodes in this fasion?

Source Link
Ahmed Al Hafoudh
  • 8.5k
  • 1
  • 21
  • 35

ActiveMQ rate limit external service

Let's say we have some web crawling system which needs to scale to many workers. Each worker has a limit for example max. 5 HTTP requests per minute per web host that could be crawled.

Can I teach ActiveMQ to dispatch messages to nodes in this fasion?