simon987/od-database
1
0
Fork 0
mirror of https://github.com/simon987/od-database.git synced 2025-04-19 02:16:47 +00:00
Code Issues Projects Releases Wiki Activity

Bugfix for http crawler

Browse Source
This commit is contained in:
Simon 2018-06-25 20:36:31 -04:00
parent d7ce1670a8
commit e384efd403
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
crawl_server/remote_http.py
View File

@ -85,6 +85,7 @@ class HttpDirectory(RemoteDirectory):
)
FILE_NAME_BLACKLIST = (
"Parent Directory",
" Parent Directory"
"../"
)