5 Commits

Author	SHA1	Message	Date
aldacron	f27cf17478	added timeout to import and sync es	2017-05-16 23:15:48 -07:00
queue	e38fe2575a	sync_es.py: bulk actions per binlog event ... mainly helps with the stat updates, that come in a single INSERT VALUES (...) ON CONFLICT UPDATE event, which helpfully translates to a bulk index event. It seems like elasticsearch should still be buffering that up internally, so maybe the refresh_interval: 30s change will help more than this.	2017-05-16 22:47:34 -06:00
aldacron	40c34e7df0	add stats as upsert in case of binlog not being sequential	2017-05-16 03:20:38 -07:00
aldacron	899aa01473	hooked up ES... 90% done, need to figure out how to generate magnet URIs	2017-05-15 23:51:58 -07:00
queue	32b9170a81	es: add sync_es script for binlog maintenance ... lightly documented.	2017-05-15 01:32:56 -06:00