Increase default number of concurrent workers from 5 to 20 

Support deny list of domains 

Re-org peer set file names and locations 

Timeout the body download as well as a response 

Track nick usage frequency per URL 

Organize User-Agent setting - type the components - handle missing peers in me file - handle multiple peers in me file

Define custom peers-union and simplify crawling 

Fix upload hook location 

Validate crawled peers if at least one message could be parsed from downloaded timeline.

Implement timeouts for downloads