9 Commits

Author	SHA1	Message	Date
Simon	011b8455a7	Elasticsearch search engine (search & scroll)	2018-06-11 23:06:41 -04:00
Simon	72495275b0	Elasticsearch search engine (import from json)	2018-06-11 22:35:49 -04:00
Simon	d849227798	barebones crawl_server microservice	2018-06-11 19:00:43 -04:00
Simon	7f496ce7a8	Slowly losing my sanity part 1: Removed scrapy dependency and moved to custom solution. Added multi-threaded ftp crawler	2018-06-11 15:46:55 -04:00
Simon	f2d914060b	Removed unsuitable scrapy spider and implemented custom crawler	2018-06-10 20:08:59 -04:00
Simon	0304c98a31	Added basic ftp spider for scrapy	2018-06-10 14:12:55 -04:00
Simon	dc0cde61a0	Basic admin page	2018-06-08 11:40:54 -04:00
Simon	cfa6a9f02f	Added requirement	2018-06-03 10:49:11 -04:00
Simon	ad645490f6	Initial commit	2018-05-28 20:35:04 -04:00