simon987/od-database-crawler
1
0
Fork 0
mirror of https://github.com/terorie/od-database-crawler.git synced 2025-12-10 22:18:55 +00:00
Code Issues Projects Releases Wiki Activity
28 Commits 12 Branches 8 Tags
a4e53053b9ea62f02b156ec56dc5c1f0d31c2022
Go to file
Clone
Open with VS Code Open with VSCodium Open with Intellij IDEA
Download ZIP Download TAR.GZ Download BUNDLE
Richard Patel a4e53053b9 Add LICENSE 
oi m8 got a loicense for that
2018-11-05 21:42:59 +01:00
.gitignore
Refactor a bit
2018-10-28 13:43:45 +01:00
config.go
Add urfave/cli app
2018-10-28 17:59:46 +01:00
config.yml
Better config
2018-10-28 14:19:09 +01:00
crawl.go
Detect directory symlinks
2018-10-28 18:37:18 +01:00
errors.go
Detect directory symlinks
2018-10-28 18:37:18 +01:00
LICENSE
Add LICENSE
2018-11-05 21:42:59 +01:00
main.go
Add pprof debug server
2018-11-05 21:39:15 +01:00
model.go
Remember scanned URLs
2018-10-28 17:07:30 +01:00
README.md
Remove WIP disclaimer
2018-10-28 03:48:33 +01:00
scheduler.go
Remove too many crawler block
2018-10-28 18:17:04 +01:00
server.go
Refactor a bit
2018-10-28 13:43:45 +01:00
stats.go
Remember scanned URLs
2018-10-28 17:07:30 +01:00
tasks.go
Bits of ODDB API
2018-10-27 04:10:08 +02:00
worker.go
Detect directory symlinks
2018-10-28 18:37:18 +01:00

README.md

oddb Go crawler

by terorie 2018 :P

Reference in New Issue View Git Blame Copy Permalink
Description
No description provided
crawlerfasthttpgogolangod-database
Readme 858 KiB
Languages
Go 99.9%