mirror of
https://github.com/terorie/od-database-crawler.git
synced 2025-04-21 03:16:46 +00:00
8 lines
329 B
Markdown
8 lines
329 B
Markdown
# od-database Go crawler 🚀
|
|
> by terorie 2018 :P
|
|
|
|
* Crawler for [__OD-Database__](https://github.com/simon987/od-database)
|
|
* Crawls HTTP open directories (standard Web Server Listings)
|
|
* Gets name, path, size and modification time of all files
|
|
* Lightweight and fast: __over 9000 requests per second__ on a standard laptop
|