24 Commits

Author SHA1 Message Date
31b35e3a32 Fix clean html (again) 2021-08-28 19:44:10 -04:00
4d6c8018df Fix clean_html 2021-08-28 19:33:11 -04:00
75bf2c2d85 Rename test.clean to text.preprocess, add QS util func, more debug logging 2021-04-25 12:10:03 -04:00
88f3124f85 add bigram option for clean function 2021-04-21 21:34:49 -04:00
32119535ae improve text cleaning 2021-04-18 21:27:12 -04:00
2ffaa4a5b3 improve text cleaning 2021-04-18 21:10:07 -04:00
45b5803c40 improve text cleaning 2021-04-18 15:40:30 -04:00
765f6f59b7 Add text cleaning function 2021-04-18 12:12:31 -04:00
30902c8235 Add sep option in volatile state 2021-04-16 19:10:45 -04:00
66d37e0be2 Add way to manually flush @buffered 2021-02-28 12:15:44 -05:00
9cadce62ac add Web helper & logger 2021-02-25 21:26:27 -05:00
7d330a0f9f Add pgsql wrapper & delitem for persistent state 2021-02-06 15:41:18 -05:00
a2cfab55bc msgpack for queue 2021-01-20 20:30:57 -05:00
c4fca1b754 Add volatile queue 2021-01-20 20:08:35 -05:00
d615ebdbd9 add custum SQL in persistant state 2021-01-17 10:05:39 -05:00
f914759b71 Fix @retry 2021-01-10 22:46:20 -05:00
58d150279f Handle bool values in state 2021-01-10 21:26:34 -05:00
b2efaa99a4 Handle null values in state 2021-01-10 20:56:46 -05:00
b845d96295 Fix update in persistentstate 2021-01-09 19:57:31 -05:00
a1156599ce Fix tests 2021-01-09 19:31:55 -05:00
e3f3ea87eb Enable int IDs in PersistentState 2021-01-09 19:30:43 -05:00
89b21884b7 Use hash in volatile state 2020-12-20 20:15:17 -05:00
30c9494daa add download_file, bool volatile state 2020-12-20 19:53:38 -05:00
f92776e646 add volatile state 2020-05-22 18:56:35 -04:00