simon987/Architeuthis
1
0
Fork 0
mirror of https://github.com/simon987/Architeuthis.git synced 2025-12-19 11:19:01 +00:00
Code Issues Projects Releases Wiki Activity

More config options, bug fixes

Browse Source
This commit is contained in:
simon
2019-05-29 22:49:51 -04:00
parent f6ac796dfd
commit 69f28f1ff7
7 changed files with 127 additions and 53 deletions
Download Patch File Download Diff File Expand all files Collapse all files

8
README.md
View File

@@ -20,10 +20,14 @@ and error handling. Built for automated web scraping.
```json
{
"addr": "localhost:5050",
"timeout": "15s",
"wait": "4s",
"multiplier": 2.5,
"retries": 3,
"proxies": [
{
"name": "squid_P0",
"url": "http://p0.exemple.com:8080"
"url": "http://user:pass@p0.exemple.com:8080"
},
{
"name": "privoxy_P1",
@@ -38,7 +42,7 @@ and error handling. Built for automated web scraping.
},
"reddit.com": {
"every": "2s",
"burst": 1,
"burst": 2,
"headers": {"User-Agent": "mybot_v0.1"}
}
}