9 Commits

Author	SHA1	Message	Date
Simon	24ef493245	Websites being indexed now show up on the homepage	2018-06-12 21:51:02 -04:00
Simon	e266a50197	Website stats now works with elasticsearch	2018-06-12 20:17:30 -04:00
Simon	4b60ac62fc	Added website url & date in search results & fixed threading problem	2018-06-12 17:48:15 -04:00
Simon	1718bb91ca	Files are indexed into ES when task is complete	2018-06-12 15:45:00 -04:00
Simon	d61fd75890	Tasks can now be queued from the web interface. Tasks are dispatched to the crawl server(s)	2018-06-12 13:44:03 -04:00
Simon	6d48f1f780	Task crawl result now logged in a database	2018-06-12 11:03:45 -04:00
Simon	72495275b0	Elasticsearch search engine (import from json)	2018-06-11 22:35:49 -04:00
Simon	fcfd7d4acc	Bug fixes + export to json	2018-06-11 20:02:30 -04:00
Simon	d849227798	barebones crawl_server microservice	2018-06-11 19:00:43 -04:00