305 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
terorie	1ac3b97d7e	Crawl stats: time format + sorting (#10) ... * Nicer stats * Fix right align * No leading day zeros * Fix right-align padding	2018-12-14 09:30:06 -05:00
Simon	e89eb6e3e0	Fixes #9	2018-12-06 10:05:35 -05:00
Simon	d4fd764536	import problem temp fix	2018-12-02 12:42:57 -05:00
Simon	a33d4f2dca	retry on index fail/timeout	2018-11-22 10:52:42 -05:00
Simon	5782a45524	Maybe fix last PR	2018-11-18 12:27:20 -05:00
Simon Fortier	fb6a1821ae	Merge pull request #7 from terorie/master ... Exclusive /api/task/upload operation	2018-11-18 12:23:14 -05:00
terorie	812a9c4113	Exclusive /api/task/upload operation	2018-11-18 18:21:21 +01:00
Simon	750940d148	error handling for delete	2018-11-18 11:19:34 -05:00
Simon	254d6ea44e	More debug logging	2018-11-18 11:15:23 -05:00
Simon	98f43f817a	revert task queuing pt. 3 ._.	2018-11-18 11:13:51 -05:00
Simon	801d056da8	revert task queuing pt. 2	2018-11-18 11:11:38 -05:00
Simon	4ce807c8a0	revert task queuing	2018-11-18 11:10:44 -05:00
Simon	6e491513bf	Merge remote-tracking branch 'origin/master'	2018-11-18 11:07:45 -05:00
Simon	64ce9379c3	Replace delete_by_query with bulk delete (cleanup)	2018-11-18 11:07:34 -05:00
Simon	2f6ae3cb35	Replace delete_by_query with bulk delete	2018-11-18 11:07:18 -05:00
Simon	1812ec932d	Completed tasks queue	2018-11-17 21:36:29 -05:00
Simon	876a511b54	Lowered search timeout	2018-11-17 12:08:04 -05:00
Simon	372c10b5ab	Nicer search logging	2018-11-17 12:04:59 -05:00
Simon	d8df91a0d6	app.py small cleanup + some logging	2018-11-17 11:53:41 -05:00
Simon	a6c421c4a6	Flask logging disabled	2018-11-17 11:20:46 -05:00
Simon	4996de6aa9	Logging for search and better error handling	2018-11-17 11:19:09 -05:00
Simon	edf1849bac	Create new rescan task when no queued tasks pt2	2018-11-16 23:01:28 -05:00
Simon	4c51598441	Get queued tasks temporarily returns only non-ftp websites	2018-11-16 22:59:26 -05:00
Simon	e3f3a9cf7f	Minified css & js, added about section in homepage	2018-11-16 20:19:03 -05:00
Simon	53317ab606	forgot submodule	2018-11-16 16:53:25 -05:00
Simon	6e80791264	Search filter	2018-11-16 16:49:23 -05:00
Simon	a461b22ffc	Stats page crawl server table improvement	2018-11-15 13:46:21 -05:00
Simon	fc3de06c35	Next/Prev button works without captcha	2018-11-15 12:54:31 -05:00
Simon	db26e851a4	API endpoint to cancel task	2018-10-26 18:13:47 -04:00
Simon	1d3318f6e2	Create new rescan task when no queued tasks	2018-09-29 12:01:02 -04:00
Simon	2ef60a05a5	proper user agent for pycurl	2018-09-29 11:38:52 -04:00
Simon Fortier	0c423ee9a9	Update README.md	2018-09-20 19:41:55 -04:00
Simon Fortier	fff013f253	Update README.md	2018-09-20 19:31:26 -04:00
Simon	bbd5c7694c	Fixed typo in title	2018-09-13 17:17:55 -04:00
Simon	85437b1ef9	Merge remote-tracking branch 'origin/master'	2018-09-06 19:46:56 -04:00
Simon	53db765856	Static export file now managed by nginx	2018-09-06 19:38:07 -04:00
Simon	8b13de4a6b	Re-init curl handle on error	2018-08-25 16:46:53 -04:00
Simon	faa9ac3ccb	Closing curl handle manually just to make sure	2018-08-23 12:48:15 -04:00
Simon	dff4125c9f	Bugfix post-pycurl update pt. 3 (Sorry!)	2018-08-23 12:47:17 -04:00
Simon	25e1e58828	Bugfix post-pycurl update pt. 3 (Sorry!)	2018-08-23 12:46:00 -04:00
Simon	6ffc43601b	Bugfix post-pycurl update pt. 2	2018-08-23 12:40:13 -04:00
Simon	484a0baf9d	Bugfix post-pycurl update	2018-08-23 12:37:27 -04:00
Simon	cadaf14c1b	Small bugfix	2018-08-23 12:12:23 -04:00
Simon	54b4d2d5b4	removed debug lines	2018-08-23 12:02:07 -04:00
Simon	d42be56dee	More debug info	2018-08-23 11:59:23 -04:00
Simon Fortier	8dc8627f78	Update README.md	2018-08-23 11:51:48 -04:00
Simon	85c3aa918d	replaced requests by pycurl	2018-08-23 11:47:09 -04:00
Simon	8f218f3c9d	Bug fix for pages buttons pt.2	2018-08-16 13:24:00 -04:00
Simon	a2327bac7c	Bug fix for pages buttons	2018-08-16 13:13:34 -04:00
Simon	6d27cbca02	xz -> lzma for export	2018-08-15 11:32:36 -04:00