Skip to main content
Software Engineering

You are not logged in. Your edit will be placed in a queue until it is peer reviewed.

We welcome edits that make the post easier to understand and more valuable for readers. Because community members review edits, please try to make the post substantially better than how you found it, for example, by fixing grammar or adding additional resources and hyperlinks.

Required fields*

7
  • You might long-poll from the client to a process of your own, and have that process be the only one monitoring the queue for finished jobs. Then you wouldn't have the thousands of clients doing their own polling to SQS. Commented Jan 3, 2014 at 18:08
  • But wouldn't that mean thousands of clients long polling to to the process? Seems there is still a bottleneck. no? Commented Jan 3, 2014 at 18:13
  • Its no different than what a chat server or game server would do. Its an area where something like Node.js might be appropriate, rather than loading x-thousand instances of a server side app. Commented Jan 3, 2014 at 18:32
  • You could possibly do some predictive work on how long the polling interval should be based on the files being zipped. Commented Jan 3, 2014 at 20:50
  • @Slickrick12 mind sharing what solution you ended up with? Commented Sep 22, 2018 at 18:23