mirror of
https://github.com/terorie/od-database-crawler.git
synced 2025-04-18 18:06:45 +00:00
11 lines
494 B
Markdown
11 lines
494 B
Markdown
# od-database Go crawler 🚀
|
|
[](https://travis-ci.org/terorie/od-database-crawler)
|
|
> by terorie 2018 :P
|
|
|
|
* Crawler for [__OD-Database__](https://github.com/simon987/od-database)
|
|
* Crawls HTTP open directories (standard Web Server Listings)
|
|
* Gets name, path, size and modification time of all files
|
|
* Lightweight and fast: __over 9000 requests per second__ on a standard laptop
|
|
|
|
https://od-db.the-eye.eu/
|