20 Commits

Author SHA1 Message Date
Yatao Li
6075c21a3a do not throttle writer/index thread pools 2022-02-13 18:43:23 +08:00
Yatao Li
f3674ffa02 stop threadpool when the memory limit is too low for any worker thread to proceed 2022-02-13 18:42:54 +08:00
Yatao Li
de187eff1c minor fix 2022-02-13 18:42:54 +08:00
Yatao Li
8e96174e1f scan memory threshold 2022-02-13 18:42:54 +08:00
bb91139ffb console log fixes, version bump 2021-11-15 20:52:24 -05:00
b17b9439df Print progress bar in index module 2021-11-07 13:20:05 -05:00
f4e1d90a6b web UI rewrite, switch to ndjson.zst index format 2021-09-05 09:49:25 -04:00
a2209e91ca add fast-epub arg, tweak thread pool, error handling for nftw 2021-07-10 12:52:04 -04:00
22dd58e140 add signal handler w/ debug info 2021-05-08 16:23:24 -04:00
33f97f6bfb Increase scan queue size 2021-05-05 14:25:35 -04:00
13f4dbed2d Handle 429, multi-threaded index module 2020-07-11 17:42:46 -04:00
e436af7b2a
2.0 (#46)
* extract scan code to libscan, (wip)

* submodules

* replace curl with mongoose (wip)

* replace onion with mongoose (wip)

* replace onion with mongoose (wip)

* It compiles! (I think)

* Update readme

* Entirely remove libonion (WIP)

* unscramble submodules

* recover screenshot

* Update mappings

* Bug fixes

* update

* media meta fix

* memory fixes

* More bug fixes...

* Bug fix w/ libmagic & vfile

* libmagic fix (again)

* Better lightbox, better video handler, random reloads fix

* Use svg for info icon

* re-enable http auth

* mobi support #41, fix logs

* Update README & cleanup
2020-04-21 14:42:20 -04:00
663f8e21c1 Better logging, fixes #15 2019-12-21 12:32:08 -05:00
be23201210 Archive file support 2019-12-13 10:53:51 -05:00
1a1032a8a7 Cleaner shutdown 2019-11-30 19:59:11 -05:00
373ac01e4e Fix for #3 and maximum scan depth 2019-11-19 11:23:30 -05:00
7962a994e2 utf8 update + bug fixes 2019-11-03 07:50:31 -05:00
0d4deb3eb3 Update readme 2019-10-26 17:40:06 -04:00
c3b7a05dde bugfixes & refactoring 2019-10-26 12:42:25 -04:00
564a17a8fa Initial commit (squashed) 2019-10-25 20:25:01 -04:00