simon987/od-database-crawler
1
0
Fork 0
mirror of https://github.com/terorie/od-database-crawler.git synced 2025-12-12 14:58:51 +00:00
Code Issues Projects Releases Wiki Activity
19 Commits 12 Branches 8 Tags
ab5874129f7d7b76f924c426dbdef60d943dd7c7
Go to file
Clone
Open with VS Code Open with VSCodium Open with Intellij IDEA
Download ZIP Download TAR.GZ Download BUNDLE
Richard Patel ab5874129f Don't retry on 401/403
2018-10-28 03:47:29 +01:00
.gitignore
Add .gitignore
2018-10-27 04:13:05 +02:00
config.go
Fix crawl descent
2018-10-28 03:06:18 +01:00
config.yml
more stuff
2018-10-28 03:41:16 +01:00
crawl_http.go
Don't retry on 401/403
2018-10-28 03:47:29 +01:00
crawl.go
Scheduler
2018-10-28 02:40:12 +02:00
main.go
more stuff
2018-10-28 03:41:16 +01:00
manager.go
Scheduler
2018-10-28 02:40:12 +02:00
README.md
WIP disclaimer
2018-10-27 04:12:33 +02:00
scheduler.go
more stuff
2018-10-28 03:41:16 +01:00
stats.go
Add stats interval parameter
2018-10-28 02:47:20 +02:00
tasks.go
Bits of ODDB API
2018-10-27 04:10:08 +02:00
worker.go
Don't retry on 401/403
2018-10-28 03:47:29 +01:00

README.md

oddb Go crawler

by terorie 2018 :P

WIP, code is in branches

Reference in New Issue View Git Blame Copy Permalink
Description
No description provided
crawlerfasthttpgogolangod-database
Readme 858 KiB
Languages
Go 99.9%