mirror of
https://github.com/terorie/od-database-crawler.git
synced 2025-04-16 17:06:46 +00:00
10 lines
356 B
Markdown
10 lines
356 B
Markdown
# od-database Go crawler 🚀
|
|
> by terorie 2018 :P
|
|
|
|
* Crawler for [__OD-Database__](https://github.com/simon987/od-database)
|
|
* Crawls HTTP open directories (standard Web Server Listings)
|
|
* Gets name, path, size and modification time of all files
|
|
* Lightweight and fast: __over 9000 requests per second__ on a standard laptop
|
|
|
|
https://od-db.the-eye.eu/
|