Puppeteer allows you to automate everything you can do in the browser manually and even more. There are cases when you need to use a proxy. It is easy to use proxy globally for the puppeteer instance, but there is a trick to use proxy on a per-page basis.
Puppeteer plugin for proxying requests per page
Installation and usage
Make sure you installed the puppeteer library first:
npm i puppeteerWe are going to use an excellent plugin puppeteer-page-proxy to solve the problem with proxy per page.
The plugin supports:
- proxy per page and proxy per request;
http,https,socks4andsocks5proxies;- authentication;
- and cookies.
Install:
npm i puppeteer-page-proxyThen you can import the library and use proxy on per-page basis:
const puppeteer = require("puppeteer");const useProxy = require("puppeteer-page-proxy");
(async () => { const browser = await puppeteer.launch({});
try { const page = await browser.newPage();
useProxy(page, "socks5://127.0.0.1:9876");
await page.goto("https://example.com/", { waitUntil: "networkidle0", });
await page.screenshot({ path: "example.com.png" }); } catch (e) { console.log(e); } finally { await browser.close(); }})();In this example I take a screenshot through proxy.
Authentication
To use authentication with proxying, you need to specify user and password in your proxy connection URL:
const puppeteer = require("puppeteer");const useProxy = require("puppeteer-page-proxy");
(async () => { const browser = await puppeteer.launch({});
try { const page = await browser.newPage();
useProxy(page, "https://user:password@host:port");
await page.goto("https://example.com/", { waitUntil: "networkidle0", });
await page.screenshot({ path: "example.com.png" }); } catch (e) { console.log(e); } finally { await browser.close(); }})();Proxy per request
You can go further and proxy on per request basis:
const puppeteer = require("puppeteer");const useProxy = require("puppeteer-page-proxy");
(async () => { const browser = await puppeteer.launch({});
try { const page = await browser.newPage();
await page.setRequestInterception(true); page.on("request", async (request) => { await useProxy(request, "https://127.0.0.1:443"); });
await page.goto("https://example.com/", { waitUntil: "networkidle0", });
await page.screenshot({ path: "example.com.png" }); } catch (e) { console.log(e); } finally { await browser.close(); }})();This example is not different from the regular usage because we proxy every page request. But! Imagine you don’t want to load your proxy bandwidth and skip proxying images. This way, it becomes more valuable:
const puppeteer = require("puppeteer");const useProxy = require("puppeteer-page-proxy");
(async () => { const browser = await puppeteer.launch({});
try { const page = await browser.newPage();
await page.setRequestInterception(true); page.on("request", async (request) => { if (request.resourceType() === "image") { request.abort(); } else { await useProxy(request, "socks4://127.0.0.1:1080"); } });
await page.goto("https://example.com/", { waitUntil: "networkidle0", });
await page.screenshot({ path: "example.com.png" }); } catch (e) { console.log(e); } finally { await browser.close(); }})();The plugin covers as many cases as you can image.
Proxy taking screenshots with API
If, in your case, you want to take screenshots or render HTML and you are OK with saving time and money, you can use our screenshot API with proxy to take screenshots.
That’s it. If you want to check out the complete guide on how to take screenshots with Puppeteer, you are welcome, and have a nice day!
