Commit Graph

4 Commits

Author SHA1 Message Date
Richard Patel
ab5874129f Don't retry on 401/403 2018-10-28 03:47:29 +01:00
Richard Patel
4ea5f8a410 Handle HTTP statuses 2018-10-28 03:22:25 +01:00
Richard Patel
1c33346f45 Fix crawl descent 2018-10-28 03:06:18 +01:00
Richard Patel
79f540bf29 Scheduler 2018-10-28 02:40:12 +02:00