Commit Graph

25 Commits

Author SHA1 Message Date
c18557e360 Fix thumbnail copying for incremental index, fix incremental index when there are no new updates, add option for JSON logs output 2022-11-23 20:45:47 -05:00
f075b542fe Tweak mem-throttle option 2022-02-19 14:05:50 -05:00
Yatao Li
9a6e7c7c47 reset throttle timer for each work item 2022-02-13 18:43:25 +08:00
Yatao Li
68252b4e80 query page size on tpool creation 2022-02-13 18:43:25 +08:00
Yatao Li
d1f13f2c84 stop scanning gracefully if memory limit target cannot be met 2022-02-13 18:43:25 +08:00
Yatao Li
6075c21a3a do not throttle writer/index thread pools 2022-02-13 18:43:23 +08:00
Yatao Li
f3674ffa02 stop threadpool when the memory limit is too low for any worker thread to proceed 2022-02-13 18:42:54 +08:00
Yatao Li
de187eff1c minor fix 2022-02-13 18:42:54 +08:00
Yatao Li
8e96174e1f scan memory threshold 2022-02-13 18:42:54 +08:00
bb91139ffb console log fixes, version bump 2021-11-15 20:52:24 -05:00
b17b9439df Print progress bar in index module 2021-11-07 13:20:05 -05:00
f4e1d90a6b web UI rewrite, switch to ndjson.zst index format 2021-09-05 09:49:25 -04:00
a2209e91ca add fast-epub arg, tweak thread pool, error handling for nftw 2021-07-10 12:52:04 -04:00
22dd58e140 add signal handler w/ debug info 2021-05-08 16:23:24 -04:00
33f97f6bfb Increase scan queue size 2021-05-05 14:25:35 -04:00
13f4dbed2d Handle 429, multi-threaded index module 2020-07-11 17:42:46 -04:00
e436af7b2a 2.0 (#46)
* extract scan code to libscan, (wip)

* submodules

* replace curl with mongoose (wip)

* replace onion with mongoose (wip)

* replace onion with mongoose (wip)

* It compiles! (I think)

* Update readme

* Entirely remove libonion (WIP)

* unscramble submodules

* recover screenshot

* Update mappings

* Bug fixes

* update

* media meta fix

* memory fixes

* More bug fixes...

* Bug fix w/ libmagic & vfile

* libmagic fix (again)

* Better lightbox, better video handler, random reloads fix

* Use svg for info icon

* re-enable http auth

* mobi support #41, fix logs

* Update README & cleanup
2020-04-21 14:42:20 -04:00
663f8e21c1 Better logging, fixes #15 2019-12-21 12:32:08 -05:00
be23201210 Archive file support 2019-12-13 10:53:51 -05:00
1a1032a8a7 Cleaner shutdown 2019-11-30 19:59:11 -05:00
373ac01e4e Fix for #3 and maximum scan depth 2019-11-19 11:23:30 -05:00
7962a994e2 utf8 update + bug fixes 2019-11-03 07:50:31 -05:00
0d4deb3eb3 Update readme 2019-10-26 17:40:06 -04:00
c3b7a05dde bugfixes & refactoring 2019-10-26 12:42:25 -04:00
564a17a8fa Initial commit (squashed) 2019-10-25 20:25:01 -04:00