simon987/od-database
1
0
Fork 0
mirror of https://github.com/simon987/od-database.git synced 2025-04-20 10:56:47 +00:00
Code Issues Projects Releases Wiki Activity
190 Commits 2 Branches 0 Tags
Commit Graph

190 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Simon
711e8282ef 'Go to random website' button, and navigation in the website list 2018-07-08 10:42:14 -04:00
Simon
9ff21e7943 Fixed indentation error 2018-06-28 22:47:14 -04:00
Simon
4c9d79fdbf Added filter for large files in stats 2018-06-28 10:40:54 -04:00
Simon
2638e47360 Only log searches in es 2018-06-27 15:39:48 -04:00
Simon
5383ad6aea Searches are not saved to database 2018-06-27 15:29:50 -04:00
Simon
14037c5f21 Added more extension types and adjusted global stats histograms 2018-06-27 11:53:32 -04:00
Simon
10e1afb2e4 Small fix to allow uppercase in extension names 2018-06-27 10:12:59 -04:00
Simon
6a3d540de2 Added date filter in search options and github banner on homepage 2018-06-27 10:05:33 -04:00
Simon
b570e81bec More search options 2018-06-26 21:38:26 -04:00
Simon
b1ad39c204 bugfix when crawl server is timing out 2018-06-26 20:25:28 -04:00
Simon
4abd8d12e2 Added size filter 2018-06-26 20:21:24 -04:00
Simon
f859bd3f8d Removed unmaintained tests 2018-06-26 19:07:14 -04:00
Simon
8ea57967e6 Filter by extension type 2018-06-26 19:02:46 -04:00
Simon
a0bd45c829 Increased ES timeouts 2018-06-26 17:01:17 -04:00
Simon
e384efd403 Bugfix for http crawler 2018-06-25 20:36:31 -04:00
Simon
d7ce1670a8 Logging and bugfix for http crawler 2018-06-25 14:36:16 -04:00
Simon
5fd00f22af Task logs now stored on main server 2018-06-24 20:32:02 -04:00
Simon
059d9fd366 Added button to queue empty websites 2018-06-24 19:33:15 -04:00
Simon
f6ee338c0f Removed unused statement 2018-06-24 18:24:41 -04:00
Simon
e11343de23 More FTP crawler bug fixes 2018-06-24 18:05:30 -04:00
Simon
ab35ce96cc FTP crawler bug fixes 2018-06-24 16:44:21 -04:00
Simon
f603f41754 Updated readme 2018-06-24 14:27:44 -04:00
Simon
8e937e69c0 Should fix some FTP errors 2018-06-24 13:50:55 -04:00
Simon
a6d753c6ee Added redispatch button and fixed typo in load balancing code 2018-06-24 10:07:46 -04:00
Simon
1ac510ff53 Slots can be updated without removing & adding 2018-06-24 09:39:44 -04:00
Simon
348914aba9 Removing unused module 2018-06-22 17:34:10 -04:00
Simon
e824b2bf3c Updated readme and UI fixes 2018-06-22 13:22:58 -04:00
Simon
9d3fc2d71b typo (again) 2018-06-21 21:26:44 -04:00
Simon
efd1981e6f typo 2018-06-21 21:00:50 -04:00
Simon
7a4432e4d0 More bugfixes for looping directories, some work on task dispatching 2018-06-21 20:50:26 -04:00
Simon
14d384e366 Decentralised crawling should work in theory + temporary fix for going further than the maximum 10k results elasticsearch allows by default 2018-06-21 19:44:27 -04:00
Simon
098ad2be72 Should fix unknown encoding errors + removed https warnings 2018-06-21 19:23:01 -04:00
Simon
80aa8933e6 Added rescan button 2018-06-21 13:02:16 -04:00
Simon
073551df3c Attempt to handle looping directories 2018-06-21 11:54:40 -04:00
Simon
dd93d40a55 Small bugfix for ftp crawler 2018-06-20 21:56:38 -04:00
Simon
4ca56d2317 Fixes #2 2018-06-20 21:52:45 -04:00
Simon
a7e4e3ae1f Fixed stats bug 2018-06-20 18:07:55 -04:00
Simon
c5deafbea5 Should fix some odd http listings 2018-06-20 13:34:41 -04:00
Simon
cf51bb381c Added top websites scatter graph 2018-06-20 12:21:34 -04:00
Simon
7400bdc2a9 Added admin blacklist control in dashboard 2018-06-20 11:28:06 -04:00
Simon
35837463cd Added admin clear & delete buttons for websites 2018-06-20 10:48:51 -04:00
Simon
cef9e2c8a1 Added some file types association 2018-06-19 22:41:43 -04:00
Simon
5f07e7d340 File types color based on type 2018-06-19 22:34:44 -04:00
Simon
5afdfb2b3c fixed navbar icon for mobile 2018-06-19 21:13:36 -04:00
Simon
c99400994b Modified graph of file types 2018-06-19 20:17:20 -04:00
Simon
76ed03a82e Dates and sizes graphs styling 2018-06-19 19:44:04 -04:00
Simon
8236b04c2e Dates and sizes graphs 2018-06-19 19:04:12 -04:00
Simon
e0b5aad654 Preview icon for images 2018-06-19 13:56:00 -04:00
Simon
d8486104b4 Fix for odd html listings 2018-06-19 12:14:50 -04:00
Simon
e54609972c Overwrite document on re-index, update website last_modified on task complete, delete website files on index complete 2018-06-19 11:24:28 -04:00