simon987/od-database
1
0
Fork 0
mirror of https://github.com/simon987/od-database.git synced 2025-12-13 23:09:01 +00:00
Code Issues Projects Releases Wiki Activity

Bug fixes for FTP crawler

Browse Source
This commit is contained in:
Simon
2018-06-13 15:54:45 -04:00
parent 9bde8cb629
commit 1bd58468eb
5 changed files with 45 additions and 12 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
stress_test.py
View File

@@ -52,5 +52,5 @@ def random_searches(count=10000000, max_workers=1000):
# dump_local_filesystem("/mnt/")
# index_file_list("local_filesystem.json", 10)
index_file_list("crawl_server/crawled/123.json", 10)
# random_searches(100000)