simon987/od-database
1
0
Fork 0
mirror of https://github.com/simon987/od-database.git synced 2025-04-19 18:36:44 +00:00
Code Issues Projects Releases Wiki Activity

Empty queue timeout increased to avoid that all workers die before the website is dropped

Browse Source
This commit is contained in:
Simon 2018-07-20 14:11:17 -04:00
parent d3801adf74
commit d43cf3b0ce
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
crawl_server/crawler.py
View File

@ -140,7 +140,7 @@ class RemoteDirectoryCrawler:
while directory: while directory:
try: try:
path = in_q.get(timeout=150) path = in_q.get(timeout=2000)
except Empty: except Empty:
logger.debug("in_q is Empty") logger.debug("in_q is Empty")
directory.close() directory.close()