10 Commits

Author	SHA1	Message	Date
simon987	b9f25630b4	Switch to postgresql, finish minimum viable task_tracker/ws_bucket integration	2019-03-27 19:34:05 -04:00
simon987	4ffe805b8d	Use task_tracker for task tracking	2019-03-24 20:23:05 -04:00
simon987	00e3fd7340	Remove task tracking	2019-03-09 13:26:05 -05:00
Simon	254d6ea44e	More debug logging	2018-11-18 11:15:23 -05:00
Simon	98f43f817a	revert task queuing pt. 3 ._.	2018-11-18 11:13:51 -05:00
Simon	801d056da8	revert task queuing pt. 2	2018-11-18 11:11:38 -05:00
Simon	4ce807c8a0	revert task queuing	2018-11-18 11:10:44 -05:00
Simon	1812ec932d	Completed tasks queue	2018-11-17 21:36:29 -05:00
Simon	112400886e	Crawler no longer crashes when website has no files	2018-07-15 10:46:48 -04:00
Simon	fe1d29aaea	Crawl tasks are now fetched by the crawlers instead of pushed by the server	2018-07-14 17:31:18 -04:00