Chrome extension for sitemap-based scraping with cloud execution support. Use KnoxProxy via SwitchyOmega for local scraping or configure it as a custom proxy in WebScraper.io Cloud for server-side runs.
For local browser scraping, install SwitchyOmega from the Chrome Web Store to manage proxy routing.
Create a new proxy profile with KnoxProxy settings.
Protocol: HTTP
Server: gw.knoxproxy.com
Port: 7000
Username: your_username-country-us
Password: your_passwordClick SwitchyOmega in the Chrome toolbar and select the KnoxProxy profile before starting your scrape.
In WebScraper.io Cloud dashboard, go to Settings > Proxy and add KnoxProxy as a custom proxy.
Proxy: http://your_username-country-us:your_password@gw.knoxproxy.com:7000Build your sitemap in the WebScraper.io panel using DevTools (F12). Start the scrape with the proxy active.
Check extracted data for completeness and correct geo-targeting. Export as CSV or push to cloud storage.
{
"sitemap": {
"startUrl": ["https://example.com/products"],
"selectors": [
{
"id": "product",
"type": "SelectorElement",
"parentSelectors": ["_root"],
"selector": ".product-card",
"multiple": true
}
]
},
"proxy": {
"url": "http://gw.knoxproxy.com:7000",
"username": "your_username-country-us",
"password": "your_password"
}
}KnoxProxy rotates IPs automatically per connection. For sitemaps with pagination, use sticky sessions (your_username-session-{id}) to maintain IP consistency across paginated requests.
| Problem | Fix |
|---|---|
| Scrape returns 403 errors | Use -country-{cc} to switch to residential IPs in the target region. Add delays between requests in sitemap settings. |
| Cloud run ignores proxy | Add the proxy URL in WebScraper.io Cloud dashboard under Settings > Proxy. SwitchyOmega only affects local runs. |
USER-country-de-city-berlin-session-profile07Order matters -- geo flags before the session flag. The session name is free text; use the profile ID so the mapping is self-documenting. Password stays as issued; no flags belong there. HTTP on :7000, SOCKS5 on :7001, same credentials.
Yes. Use SwitchyOmega for local browser scraping and configure KnoxProxy directly in the WebScraper.io Cloud proxy settings for cloud runs.
Use sticky sessions by setting username to your_username-session-{id}. This keeps the same IP across paginated requests, avoiding session-based blocks.
Yes. Set different -country-{cc} suffixes in the proxy configuration for each sitemap or cloud job.
KnoxProxy has no connection limit. WebScraper.io may have its own rate limits depending on your subscription tier.
Free trial on rotating residential -- 2 minutes setup, no credit card.