19 Commits

Author SHA1 Message Date
simon987
4ffe805b8d Use task_tracker for task tracking 2019-03-24 20:23:05 -04:00
Simon
5c386707ed Should fix import error 2018-08-13 14:03:22 -04:00
Simon
f729b462f0 od_util can be used when od-database is a submodule part 2 2018-08-08 23:31:50 -04:00
Simon
88166054ad od_util can be used when od-database is a submodule 2018-08-08 23:07:09 -04:00
Simon
d138db8f06 Added filter to check if a website can be scanned from its parent directory 2018-07-10 10:14:23 -04:00
Simon
14037c5f21 Added more extension types and adjusted global stats histograms 2018-06-27 11:53:32 -04:00
Simon
059d9fd366 Added button to queue empty websites 2018-06-24 19:33:15 -04:00
Simon
e11343de23 More FTP crawler bug fixes 2018-06-24 18:05:30 -04:00
Simon
8e937e69c0 Should fix some FTP errors 2018-06-24 13:50:55 -04:00
Simon
4ca56d2317 Fixes #2 2018-06-20 21:52:45 -04:00
Simon
7400bdc2a9 Added admin blacklist control in dashboard 2018-06-20 11:28:06 -04:00
Simon
35837463cd Added admin clear & delete buttons for websites 2018-06-20 10:48:51 -04:00
Simon
cef9e2c8a1 Added some file types association 2018-06-19 22:41:43 -04:00
Simon
5f07e7d340 File types color based on type 2018-06-19 22:34:44 -04:00
Simon
83f4b8def9 Enhanced search results page 2018-06-18 15:01:49 -04:00
Simon
7f496ce7a8 Slowly losing my sanity part 1: Removed scrapy dependency and moved to custom solution. Added multi-threaded ftp crawler 2018-06-11 15:46:55 -04:00
Simon
d8c16d53e6 FTP url validation 2018-06-10 14:32:19 -04:00
Simon
0b1d76f478 Added blacklist feature (untested) 2018-06-06 10:17:30 -04:00
Simon
ad645490f6 Initial commit 2018-05-28 20:35:04 -04:00