simon987/od-database-crawler
1
0
Fork 0
mirror of https://github.com/terorie/od-database-crawler.git synced 2025-04-16 08:56:44 +00:00
Code Issues Projects Releases Wiki Activity
od-database-crawler/README.md
Richard Patel 108fff0503
Add Travis CI badge
2019-02-03 02:09:06 +01:00

494 B
Raw Blame History

od-database Go crawler 🚀

Build Status

by terorie 2018 :P

  • Crawler for OD-Database
  • Crawls HTTP open directories (standard Web Server Listings)
  • Gets name, path, size and modification time of all files
  • Lightweight and fast: over 9000 requests per second on a standard laptop

https://od-db.the-eye.eu/