simon987/od-database-crawler
1
0
Fork 0
mirror of https://github.com/terorie/od-database-crawler.git synced 2025-04-16 00:46:43 +00:00
Code Issues Projects Releases Wiki Activity
od-database-crawler/README.md
Richard Patel 0fe97a8058
Update README.md
2018-11-17 01:36:07 +01:00

329 B
Raw Blame History

od-database Go crawler 🚀

by terorie 2018 :P

  • Crawler for OD-Database
  • Crawls HTTP open directories (standard Web Server Listings)
  • Gets name, path, size and modification time of all files
  • Lightweight and fast: over 9000 requests per second on a standard laptop