15 Commits

Author	SHA1	Message	Date
Simon	d138db8f06	Added filter to check if a website can be scanned from its parent directory	2018-07-10 10:14:23 -04:00
Simon	14037c5f21	Added more extension types and adjusted global stats histograms	2018-06-27 11:53:32 -04:00
Simon	059d9fd366	Added button to queue empty websites	2018-06-24 19:33:15 -04:00
Simon	e11343de23	More FTP crawler bug fixes	2018-06-24 18:05:30 -04:00
Simon	8e937e69c0	Should fix some FTP errors	2018-06-24 13:50:55 -04:00
Simon	4ca56d2317	Fixes #2	2018-06-20 21:52:45 -04:00
Simon	7400bdc2a9	Added admin blacklist control in dashboard	2018-06-20 11:28:06 -04:00
Simon	35837463cd	Added admin clear & delete buttons for websites	2018-06-20 10:48:51 -04:00
Simon	cef9e2c8a1	Added some file types association	2018-06-19 22:41:43 -04:00
Simon	5f07e7d340	File types color based on type	2018-06-19 22:34:44 -04:00
Simon	83f4b8def9	Enhanced search results page	2018-06-18 15:01:49 -04:00
Simon	7f496ce7a8	Slowly losing my sanity part 1: Removed scrapy dependency and moved to custom solution. Added multi-threaded ftp crawler	2018-06-11 15:46:55 -04:00
Simon	d8c16d53e6	FTP url validation	2018-06-10 14:32:19 -04:00
Simon	0b1d76f478	Added blacklist feature (untested)	2018-06-06 10:17:30 -04:00
Simon	ad645490f6	Initial commit	2018-05-28 20:35:04 -04:00