48 Commits

Author SHA1 Message Date
8fdb832c85 refactor index schema, remove sidecar parsing, remove TS 2023-09-05 18:59:18 -04:00
b5cdd9a5df Work on README, optimize database storage 2023-04-22 16:02:19 -04:00
fc36f33d52 use sqlite to save index, major thread pool refactor 2023-04-03 21:39:50 -04:00
f8abffba81 process pool mostly works, still WIP 2023-03-09 22:11:21 -05:00
8c662bb8f8 Adjust some structs 2023-02-27 20:44:25 -05:00
c18557e360 Fix thumbnail copying for incremental index, fix incremental index when there are no new updates, add option for JSON logs output 2022-11-23 20:45:47 -05:00
a75675ecea Fix thumbnail copy bug, update tests 2022-04-16 11:48:43 -04:00
16a4fb4874 Rework document IDs 2022-03-05 11:18:06 -05:00
3d4331b27d Add thumbnail-count option 2022-02-19 13:45:31 -05:00
Yatao Li
8f7edf3190 incremental_delete: read from index file so that we have parent info 2022-01-25 19:03:25 +08:00
Yatao Li
e65905a165 only add new entries into new_table to save memory 2022-01-25 19:03:25 +08:00
Yatao Li
291d307689 index: incremental indexing, add stub for index entries removal 2022-01-25 19:03:25 +08:00
Yatao Li
7d40b9e959 incremental scan: build delete index. only load from main & original. 2022-01-25 19:03:25 +08:00
ad95684771 Update --ocr-* args, enable OCR'ing images 2022-01-08 14:24:50 -05:00
c9aa4bed72 Add argument to calculate checksums 2021-09-11 14:31:31 -04:00
f4e1d90a6b web UI rewrite, switch to ndjson.zst index format 2021-09-05 09:49:25 -04:00
efa4a06e56 Fix meta_key UB problem 2021-06-11 20:19:36 -04:00
a01f6dff1f Use 16-bit ints for meta keys (wip) 2021-06-07 08:40:12 -04:00
050c1283a3 Remove UUID dep, fix incremental scan, use MD5(path) as unique id, version bump 2020-12-31 10:26:05 -05:00
641a8ec90c sidecar files #114, version bump 2020-10-25 09:44:30 -04:00
a0739d5177 Fix #92 2020-08-25 10:38:38 -04:00
7b9fa4cc0a Fix bad merge... 2020-07-15 21:00:51 -04:00
649689ce30 Remove warning when generating stats 2020-07-15 20:41:38 -04:00
1d9fcf7105 Manual tagging 2020-07-13 19:18:07 -04:00
cf513b4ad8 Escape invalid UTF8 characters simon987/sist2#44, increase magic buffer size 2020-05-12 19:28:02 -04:00
e436af7b2a
2.0 (#46)
* extract scan code to libscan, (wip)

* submodules

* replace curl with mongoose (wip)

* replace onion with mongoose (wip)

* replace onion with mongoose (wip)

* It compiles! (I think)

* Update readme

* Entirely remove libonion (WIP)

* unscramble submodules

* recover screenshot

* Update mappings

* Bug fixes

* update

* media meta fix

* memory fixes

* More bug fixes...

* Bug fix w/ libmagic & vfile

* libmagic fix (again)

* Better lightbox, better video handler, random reloads fix

* Use svg for info icon

* re-enable http auth

* mobi support #41, fix logs

* Update README & cleanup
2020-04-21 14:42:20 -04:00
a2be9b955c Fix build errors 2020-03-24 11:49:13 -04:00
02fa3f02f5 Fix memory leak with virtual files in parse.c 2020-03-06 09:36:07 -05:00
9ace5774af Update dependencies 2020-03-05 16:10:45 -05:00
98c40901ed Disallow incremental scan when version does not match (#33) 2020-03-03 16:36:07 -05:00
7eb9c5d7d5 Fix web/index issue with NULL mime types 2020-02-09 17:23:49 -05:00
75f99025d9 add exif dateTime, allow some special characters in text meta 2020-02-09 08:47:13 -05:00
df41c251e4 (Breaking!) Add some exif tags 2020-02-06 19:21:50 -05:00
7c8a3e2f9d Support for external json indices 2020-01-14 15:44:31 -05:00
663f8e21c1 Better logging, fixes #15 2019-12-21 12:32:08 -05:00
be23201210 Archive file support 2019-12-13 10:53:51 -05:00
1a1032a8a7 Cleaner shutdown 2019-11-30 19:59:11 -05:00
ebfd7e03ce User scripts, bug fixes, docker image 2019-11-12 20:58:43 -05:00
6931d320a2 bugfix with invalid/corrupted index path 2019-11-11 20:49:38 -05:00
152d2ddf8a bug fix in deserialize 2019-11-08 09:03:44 -05:00
7962a994e2 utf8 update + bug fixes 2019-11-03 07:50:31 -05:00
5661573b06 Dark theme, pdf meta, de-serialize bugfix 2019-10-30 22:20:22 -04:00
130fb78787 Fix some memory leaks 2019-10-27 15:40:48 -04:00
9b7c56a608 Static build (scan only) 2019-10-27 12:25:34 -04:00
f44e6336dc Deserialize typo 2019-10-26 20:54:46 -04:00
b4199a1fd8 fix for elasticsearch 2019-10-26 19:09:26 -04:00
bfc7f4ddb6 progress bar fix 2019-10-26 14:39:28 -04:00
564a17a8fa Initial commit (squashed) 2019-10-25 20:25:01 -04:00