63 Commits

Author SHA1 Message Date
067a20f7a8 improve text cleaning 2021-04-18 20:32:34 -04:00
00323ea576 improve text cleaning 2021-04-18 18:50:39 -04:00
45b5803c40 improve text cleaning 2021-04-18 15:40:30 -04:00
18cd59fc4a ignore log in text 2021-04-18 12:20:22 -04:00
d895ac837e ignore log in text 2021-04-18 12:18:27 -04:00
ae59522b27 Add customstderr 2021-04-18 12:17:00 -04:00
765f6f59b7 Add text cleaning function 2021-04-18 12:12:31 -04:00
30902c8235 Add sep option in volatile state 2021-04-16 19:10:45 -04:00
53a262a138 Add retry_sleep to retry 2021-04-06 21:24:23 -04:00
6e1aa53455 Add retry_sleep to retry 2021-04-06 21:23:28 -04:00
53ac0c37e8 Fix redis_publish 2021-04-06 21:08:43 -04:00
8378ed6526 Add session arg to get_web 2021-04-06 20:32:34 -04:00
c79b3bfafd Add get_soup() 2021-04-05 19:17:27 -04:00
5ee1629c79 oops 2021-03-28 09:53:16 -04:00
00f5aef721 Update redis_publish to add subproject 2021-03-28 09:42:52 -04:00
021da84433 add redis_publish 2021-03-25 18:25:46 -04:00
53a03baaa4 Add useragent option in Web 2021-03-07 11:02:26 -05:00
66d37e0be2 Add way to manually flush @buffered 2021-02-28 12:15:44 -05:00
43cb6c4a7b web retry_codes fix 2021-02-27 12:07:48 -05:00
4278b0f89e web retry_codes fix 2021-02-27 08:58:21 -05:00
9738819428 web logging fix 2021-02-25 22:00:44 -05:00
ce2e5b2af6 load redis from env if not specified 2021-02-25 21:35:18 -05:00
9cadce62ac add Web helper & logger 2021-02-25 21:26:27 -05:00
7d330a0f9f Add pgsql wrapper & delitem for persistent state 2021-02-06 15:41:18 -05:00
a2cfab55bc msgpack for queue 2021-01-20 20:30:57 -05:00
c4fca1b754 Add volatile queue 2021-01-20 20:08:35 -05:00
d615ebdbd9 add custum SQL in persistant state 2021-01-17 10:05:39 -05:00
f914759b71 Fix @retry 2021-01-10 22:46:20 -05:00
58d150279f Handle bool values in state 2021-01-10 21:26:34 -05:00
b2efaa99a4 Handle null values in state 2021-01-10 20:56:46 -05:00
b845d96295 Fix update in persistentstate 2021-01-09 19:57:31 -05:00
a1156599ce Fix tests 2021-01-09 19:31:55 -05:00
e3f3ea87eb Enable int IDs in PersistentState 2021-01-09 19:30:43 -05:00
89b21884b7 Use hash in volatile state 2020-12-20 20:15:17 -05:00
6832b9edd6 remove extraneous ttl arg 2020-12-20 19:55:52 -05:00
30c9494daa add download_file, bool volatile state 2020-12-20 19:53:38 -05:00
2d74f61553 fix fuzz bug 2020-11-25 15:33:01 -05:00
b0de37d4f9 Fix pg cursor 2020-08-20 21:10:31 -04:00
266f8642fb Fix VolatileState 2020-08-12 18:11:46 -04:00
fe955668eb Add chunks() 2020-08-04 21:52:14 -04:00
52ad2d22b9 Switch to orjson, add ndjson_iter 2020-08-04 21:40:56 -04:00
30854c7f8b Add random_word & random_phrase 2020-08-04 18:45:00 -04:00
595fbc71be Add encode/decode cj 2020-07-05 16:14:05 -04:00
51a4c7854d Change silent_stdout 2020-06-14 14:05:06 -04:00
3db293c867 concurrency 2020-06-14 10:29:12 -04:00
7633c64057 add pgsql cursor util & silent stdout 2020-06-06 14:08:22 -04:00
f92776e646 add volatile state 2020-05-22 18:56:35 -04:00
c0472efacc Add random file fuzzing functions 2020-03-04 13:16:12 -05:00
86e07900ea Handle raw bytes 2019-12-29 17:13:35 -05:00
37257f11eb save and load cookie 2019-12-29 13:25:43 -05:00