Slowly losing my sanity part 1: Removed scrapy dependency and moved to custom solution. Added multi-threaded ftp crawler

Browse Source

...

This commit is contained in:

Simon

2018-06-11 15:46:55 -04:00

parent b649b82854

commit 7f496ce7a8

10 changed files with 338 additions and 284 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

0

crawler/__init__.py Normal file