58 Commits

Author SHA1 Message Date
6d505f912c Rework document IDs 2022-03-03 17:44:59 -05:00
3d4331b27d Add thumbnail-count option 2022-02-19 13:45:31 -05:00
Yatao Li
8f7edf3190 incremental_delete: read from index file so that we have parent info 2022-01-25 19:03:25 +08:00
Yatao Li
e65905a165 only add new entries into new_table to save memory 2022-01-25 19:03:25 +08:00
Yatao Li
679e12f786 unify READ_INDICES to reduce clutter 2022-01-25 19:03:25 +08:00
Yatao Li
291d307689 index: incremental indexing, add stub for index entries removal 2022-01-25 19:03:25 +08:00
Yatao Li
7d40b9e959 incremental scan: build delete index. only load from main & original. 2022-01-25 19:03:25 +08:00
ad95684771 Update --ocr-* args, enable OCR'ing images 2022-01-08 14:24:50 -05:00
81008d8936 Add --list-file argument 2021-12-29 18:54:13 -05:00
27e32db1ed Fix attempt for excludes 2021-11-17 20:18:48 -05:00
b17b9439df Print progress bar in index module 2021-11-07 13:20:05 -05:00
be8eedc9c7 Skip subtree of excluded directories 2021-11-07 11:56:09 -05:00
0887046b41 Fix sidecar files, better error handling in store_write 2021-09-20 20:34:05 -04:00
17fda1e540 Support for rewind buffer 2021-09-11 20:46:40 -04:00
c9aa4bed72 Add argument to calculate checksums 2021-09-11 14:31:31 -04:00
f4e1d90a6b web UI rewrite, switch to ndjson.zst index format 2021-09-05 09:49:25 -04:00
a2209e91ca add fast-epub arg, tweak thread pool, error handling for nftw 2021-07-10 12:52:04 -04:00
efa4a06e56 Fix meta_key UB problem 2021-06-11 20:19:36 -04:00
a01f6dff1f Use 16-bit ints for meta keys (wip) 2021-06-07 08:40:12 -04:00
22dd58e140 add signal handler w/ debug info 2021-05-08 16:23:24 -04:00
050c1283a3 Remove UUID dep, fix incremental scan, use MD5(path) as unique id, version bump 2020-12-31 10:26:05 -05:00
641a8ec90c sidecar files #114, version bump 2020-10-25 09:44:30 -04:00
a0739d5177 Fix #92 2020-08-25 10:38:38 -04:00
c061613302 Fix #76 2020-07-18 19:23:43 -04:00
7b9fa4cc0a Fix bad merge... 2020-07-15 21:00:51 -04:00
649689ce30 Remove warning when generating stats 2020-07-15 20:41:38 -04:00
1d9fcf7105 Manual tagging 2020-07-13 19:18:07 -04:00
8127745f2b wip 2020-07-13 19:16:51 -04:00
cf513b4ad8 Escape invalid UTF8 characters simon987/sist2#44, increase magic buffer size 2020-05-12 19:28:02 -04:00
e436af7b2a
2.0 (#46)
* extract scan code to libscan, (wip)

* submodules

* replace curl with mongoose (wip)

* replace onion with mongoose (wip)

* replace onion with mongoose (wip)

* It compiles! (I think)

* Update readme

* Entirely remove libonion (WIP)

* unscramble submodules

* recover screenshot

* Update mappings

* Bug fixes

* update

* media meta fix

* memory fixes

* More bug fixes...

* Bug fix w/ libmagic & vfile

* libmagic fix (again)

* Better lightbox, better video handler, random reloads fix

* Use svg for info icon

* re-enable http auth

* mobi support #41, fix logs

* Update README & cleanup
2020-04-21 14:42:20 -04:00
a2be9b955c Fix build errors 2020-03-24 11:49:13 -04:00
02fa3f02f5 Fix memory leak with virtual files in parse.c 2020-03-06 09:36:07 -05:00
513a21cca2 Undo debug stuff 2020-03-05 18:42:51 -05:00
9ace5774af Update dependencies 2020-03-05 16:10:45 -05:00
d7cbd5d2b6 wip doc rewrite 2020-03-05 09:13:37 -05:00
98c40901ed Disallow incremental scan when version does not match (#33) 2020-03-03 16:36:07 -05:00
483a454c8d --exclude argument #26 2020-02-22 16:55:35 -05:00
7eb9c5d7d5 Fix web/index issue with NULL mime types 2020-02-09 17:23:49 -05:00
75f99025d9 add exif dateTime, allow some special characters in text meta 2020-02-09 08:47:13 -05:00
df41c251e4 (Breaking!) Add some exif tags 2020-02-06 19:21:50 -05:00
7c8a3e2f9d Support for external json indices 2020-01-14 15:44:31 -05:00
663f8e21c1 Better logging, fixes #15 2019-12-21 12:32:08 -05:00
be23201210 Archive file support 2019-12-13 10:53:51 -05:00
1a1032a8a7 Cleaner shutdown 2019-11-30 19:59:11 -05:00
373ac01e4e Fix for #3 and maximum scan depth 2019-11-19 11:23:30 -05:00
ebfd7e03ce User scripts, bug fixes, docker image 2019-11-12 20:58:43 -05:00
6931d320a2 bugfix with invalid/corrupted index path 2019-11-11 20:49:38 -05:00
fc22e52eae Image placeholder 2019-11-09 23:26:49 -05:00
152d2ddf8a bug fix in deserialize 2019-11-08 09:03:44 -05:00
7962a994e2 utf8 update + bug fixes 2019-11-03 07:50:31 -05:00