simon987/od-database
1
0
Fork 0
mirror of https://github.com/simon987/od-database.git synced 2025-11-04 06:56:52 +00:00
Code Issues Projects Releases Wiki Activity
287 Commits 2 Branches 0 Tags
Commit Graph

69 Commits

Author SHA1 Message Date
simon987
b9f25630b4 Switch to postgresql, finish minimum viable task_tracker/ws_bucket integration 2019-03-27 19:34:05 -04:00
simon987
00e3fd7340 Remove task tracking 2019-03-09 13:26:05 -05:00
simon987
7f857d641f Change ES settings, big refactor, removed recaptcha 2019-01-13 12:48:39 -05:00
terorie
0519d1fbea
Proper downloads page 2018-12-14 20:15:37 +01:00
terorie
1ac3b97d7e Crawl stats: time format + sorting (#10) 
* Nicer stats
* Fix right align
* No leading day zeros
* Fix right-align padding
 2018-12-14 09:30:06 -05:00
Simon
d8df91a0d6 app.py small cleanup + some logging 2018-11-17 11:53:41 -05:00
Simon
e3f3a9cf7f Minified css & js, added about section in homepage 2018-11-16 20:19:03 -05:00
Simon
a461b22ffc Stats page crawl server table improvement 2018-11-15 13:46:21 -05:00
Simon
fc3de06c35 Next/Prev button works without captcha 2018-11-15 12:54:31 -05:00
Simon
bbd5c7694c Fixed typo in title 2018-09-13 17:17:55 -04:00
Simon
85437b1ef9 Merge remote-tracking branch 'origin/master' 2018-09-06 19:46:56 -04:00
Simon
53db765856 Static export file now managed by nginx 2018-09-06 19:38:07 -04:00
Simon
8f218f3c9d Bug fix for pages buttons pt.2 2018-08-16 13:24:00 -04:00
Simon
a2327bac7c Bug fix for pages buttons 2018-08-16 13:13:34 -04:00
Simon
bbe8ed07a8 Reset page number on search 2018-08-14 16:20:00 -04:00
Simon
78d1b7a5bd Next and previous buttons now works with captcha 2018-08-10 16:30:40 -04:00
Simon
aab1abba54 Fixed websites link 2018-08-10 15:24:43 -04:00
Simon
c29af180c5 Captcha for searches 2018-08-10 12:46:40 -04:00
Simon
a6b1d9cba3 More help when no search results 2018-08-09 21:43:07 -04:00
Simon
0227684a53 Added API commands 2018-07-15 21:21:57 -04:00
Simon
fe1d29aaea Crawl tasks are now fetched by the crawlers instead of pushed by the server 2018-07-14 17:31:18 -04:00
Simon
d9e9f53f92 Website should stay online even if elasticsearch is down / timing out 2018-07-12 12:06:45 -04:00
Simon
1b743e7aba Updated README and catpchas are now toggled from the config 2018-07-10 22:57:52 -04:00
Simon
2b83698292 Changed 'no results' text in search page 2018-07-10 21:09:21 -04:00
Simon
711e8282ef 'Go to random website' button, and navigation in the website list 2018-07-08 10:42:14 -04:00
Simon
4c9d79fdbf Added filter for large files in stats 2018-06-28 10:40:54 -04:00
Simon
6a3d540de2 Added date filter in search options and github banner on homepage 2018-06-27 10:05:33 -04:00
Simon
b570e81bec More search options 2018-06-26 21:38:26 -04:00
Simon
4abd8d12e2 Added size filter 2018-06-26 20:21:24 -04:00
Simon
8ea57967e6 Filter by extension type 2018-06-26 19:02:46 -04:00
Simon
5fd00f22af Task logs now stored on main server 2018-06-24 20:32:02 -04:00
Simon
059d9fd366 Added button to queue empty websites 2018-06-24 19:33:15 -04:00
Simon
a6d753c6ee Added redispatch button and fixed typo in load balancing code 2018-06-24 10:07:46 -04:00
Simon
1ac510ff53 Slots can be updated without removing & adding 2018-06-24 09:39:44 -04:00
Simon
e824b2bf3c Updated readme and UI fixes 2018-06-22 13:22:58 -04:00
Simon
14d384e366 Decentralised crawling should work in theory + temporary fix for going further than the maximum 10k results elasticsearch allows by default 2018-06-21 19:44:27 -04:00
Simon
80aa8933e6 Added rescan button 2018-06-21 13:02:16 -04:00
Simon
a7e4e3ae1f Fixed stats bug 2018-06-20 18:07:55 -04:00
Simon
cf51bb381c Added top websites scatter graph 2018-06-20 12:21:34 -04:00
Simon
7400bdc2a9 Added admin blacklist control in dashboard 2018-06-20 11:28:06 -04:00
Simon
35837463cd Added admin clear & delete buttons for websites 2018-06-20 10:48:51 -04:00
Simon
8236b04c2e Dates and sizes graphs 2018-06-19 19:04:12 -04:00
Simon
e0b5aad654 Preview icon for images 2018-06-19 13:56:00 -04:00
Simon
4f5f0f76be Small adjustments for csv export 2018-06-19 10:01:15 -04:00
Simon
81d52a4551 Changed UI to fit the-eye.eu 2018-06-18 22:37:05 -04:00
Simon
788d3749d4 Homepage now compatible with new stats 2018-06-18 20:04:49 -04:00
Simon
8768e39f08 Added stats page 2018-06-18 19:56:25 -04:00
Simon
83f4b8def9 Enhanced search results page 2018-06-18 15:01:49 -04:00
Simon
7c47b0f00c Added delta column in crawl logs 2018-06-18 12:21:00 -04:00
Simon
400abc9a3c Added crawl logs page 2018-06-18 11:41:26 -04:00