simon987/od-database-crawler
1
0
Fork 0
mirror of https://github.com/terorie/od-database-crawler.git synced 2025-04-10 05:56:42 +00:00
Code Issues Projects Releases Wiki Activity
28 Commits 12 Branches 8 Tags
Go to file
Clone
Open with VS Code Open with VSCodium Open with Intellij IDEA
Download ZIP Download TAR.GZ Download BUNDLE
Richard Patel a4e53053b9
Add LICENSE 
oi m8 got a loicense for that
2018-11-05 21:42:59 +01:00
.gitignore
Refactor a bit
2018-10-28 13:43:45 +01:00
config.go
Add urfave/cli app
2018-10-28 17:59:46 +01:00
config.yml
Better config
2018-10-28 14:19:09 +01:00
crawl.go
Detect directory symlinks
2018-10-28 18:37:18 +01:00
errors.go
Detect directory symlinks
2018-10-28 18:37:18 +01:00
LICENSE
Add LICENSE
2018-11-05 21:42:59 +01:00
main.go
Add pprof debug server
2018-11-05 21:39:15 +01:00
model.go
Remember scanned URLs
2018-10-28 17:07:30 +01:00
README.md
Remove WIP disclaimer
2018-10-28 03:48:33 +01:00
scheduler.go
Remove too many crawler block
2018-10-28 18:17:04 +01:00
server.go
Refactor a bit
2018-10-28 13:43:45 +01:00
stats.go
Remember scanned URLs
2018-10-28 17:07:30 +01:00
tasks.go
Bits of ODDB API
2018-10-27 04:10:08 +02:00
worker.go
Detect directory symlinks
2018-10-28 18:37:18 +01:00

README.md

oddb Go crawler

by terorie 2018 :P

Description
No description provided
crawlerfasthttpgogolangod-database
Readme 858 KiB
Languages
Go 99.9%