Nodriver proxy with authentication

[strukiii]

Hi all, I'm putting this here since there is no nodriver discussions section. I'm trying to get the browser setup with an authenticated proxy but chrome does not support credentials via browser args. I found this, where the answer from Arkadiy Bolotov is interesting. There are the same cdp methods as in his post available in Network though they are deprecated for those in Fetch. Here is my current attempt I put together this afternoon, which does intercept the requests however no authRequired events are fired as the documentation suggests.

class Scraper:
    main_tab: tab

    def __init__(self):
        loop().run_until_complete(self.run())

    async def run(self):
        browser = await start(
            browser_args=[f"--proxy-server={PROXY}"],
        )
        self.main_tab = browser.main_tab
        await self.main_tab.send(cdp.fetch.enable(handle_auth_requests=True))
        self.main_tab.add_handler(cdp.fetch.RequestPaused, self.req_paused)
        self.main_tab.add_handler(cdp.fetch.AuthRequired, self.auth_challenge_handler)
        page = await browser.get('https://www.whatismyip.com/')
        await asyncio.sleep(6000)


    async def auth_challenge_handler(self, event: cdp.fetch.AuthRequired):
        # Split the credentials
        # Respond to the authentication challenge
        await self.main_tab.send(cdp.fetch.continue_with_auth(
            request_id=event.request_id,
            auth_challenge_response=cdp.fetch.AuthChallengeResponse(
                response="ProvideCredentials",
                username=USERNAME,
                password=PASSWORD
            )
        ))


    async def req_paused(self, event: cdp.fetch.RequestPaused):
        await self.main_tab.send(cdp.fetch.continue_request(request_id=event.request_id))


if __name__ == '__main__':
    Scraper()

[WindBora]

Hi

Here 2 problems arises:

1. You add handlers after enabling domain (internal implementation overrides enabling domain) - that's the reason why handlers do not receive an event
2. When you will finally receive an event, your response will block all processes

Solutions:

1. Add handlers before enabling domain. Only after adding them do enable domain
2. For such blocking requests there is a must to just use fire-and-forget method e.g. do not await for sending response on req_paused or auth_required. Just wrap the call into asyncio.create_task

Example of working code based of of yours:

class Scraper:
    main_tab: uc.Tab

    def __init__(self):
        uc.loop().run_until_complete(self.run())

    async def run(self):
        browser = await uc.start(
            browser_args=[f"--proxy-server={PROXY}"],
        )
        self.main_tab = await browser.get("draft:,")
        self.main_tab.add_handler(uc.cdp.fetch.RequestPaused, self.req_paused)
        self.main_tab.add_handler(
            uc.cdp.fetch.AuthRequired, self.auth_challenge_handler
        )
        await self.main_tab.send(uc.cdp.fetch.enable(handle_auth_requests=True))
        page = await browser.get("https://www.whatismyip.com/")
        await asyncio.sleep(6000)

    async def auth_challenge_handler(self, event: uc.cdp.fetch.AuthRequired):
        # Split the credentials
        # Respond to the authentication challenge
        asyncio.create_task(
            self.main_tab.send(
                uc.cdp.fetch.continue_with_auth(
                    request_id=event.request_id,
                    auth_challenge_response=uc.cdp.fetch.AuthChallengeResponse(
                        response="ProvideCredentials",
                        username=USERNAME,
                        password=PASSWORD,
                    ),
                )
            )
        )

    async def req_paused(self, event: uc.cdp.fetch.RequestPaused):
        asyncio.create_task(
            self.main_tab.send(
                uc.cdp.fetch.continue_request(request_id=event.request_id)
            )
        )


if __name__ == "__main__":
    Scraper()

[tidal10]

Do you have a way to run multiple proxy sessions on a threaded environment with different proxies?

[epicwhale]

This works for me with non-ssl domains/pages, but fails when it's an https:// url I am trying to access. I get the following (screenshot below)...

Wondering is there some flag or extra args you needed to set somewhere to workaround this by any chance? @mushifali @strukiii @WindBora

[mushifali]

@epicwhale It is also working for https:// domains for me. Can you please share your code?

[epicwhale]

@mushifali looks like it was an issue with the proxy I was using, thanks for confirming! A better proxy seemed to do it for me too.

[nathanfallet]

I cannot get this example working. Actually this line made the first page loading but any subsequent calls paused:

await self.main_tab.send(uc.cdp.fetch.enable(handle_auth_requests=True))

For example, if you go to a website with html/css/js, the main html will load, but all css/js assets will be marked as pending and never continues. This is due to req_paused being called for the html page but never called again for all those assets (so we cannot continue the request)
Do you have any way to solve this? Maybe someone else already encountered this issue.

[SSujitX]

import nodriver as uc
from nodriver.cdp import fetch

PROXYHOST = "aaaaaaaaaaaaaa.ika.na.pyproxy.io"
PROXYPORT = "2000"
PROXYUSERNAME = "aaa"
PROXYPASSWORD = "bbbb"
PROXY = f"http://{PROXYHOST}:{PROXYPORT}"

async def setup_proxy(username, password, tab):
    async def auth_challenge_handler(event: fetch.AuthRequired):
        # Respond to the authentication challenge
        await tab.send(
            fetch.continue_with_auth(
                request_id=event.request_id,
                auth_challenge_response=fetch.AuthChallengeResponse(
                    response="ProvideCredentials",
                    username=username,
                    password=password,
                ),
            )
        )

    async def req_paused(event: fetch.RequestPaused):
        # Continue with the request
        await tab.send(fetch.continue_request(request_id=event.request_id))

    # Add handlers for fetch events
    tab.add_handler(
        fetch.RequestPaused, lambda event: asyncio.create_task(req_paused(event))
    )
    tab.add_handler(
        fetch.AuthRequired,
        lambda event: asyncio.create_task(auth_challenge_handler(event)),
    )

    # Enable fetch domain with auth requests handling
    await tab.send(fetch.enable(handle_auth_requests=True))


    # -------- PROXY -------- #
    browser = await uc.start(browser_args=[f"--proxy-server={PROXY}"])
    main_tab = await browser.get("draft:,")
    await setup_proxy(PROXYUSERNAME, PROXYPASSWORD, main_tab)
    ipPage = await browser.get("https://www.myexternalip.com/raw")
    await asyncio.sleep(2)
    ip = await ipPage.evaluate("document.body.textContent.trim()")
    print(f">= IP Address: {ip}")
    # -------- PROXY -------- #

[aoddspotato]

This is awesome

[kashif-ghafoor]

Thanks Brother. Saved a lot of my time.

[C0uchP0tat0]

Thanks, bro! This is exactly what I needed. This solution works for Zendriver too.

[LuisGMM]

Hi all, I have been trying to use a proxy with nodriver for a couple of days now, without success. I tried the suggested solutions but I keep getting this error in the chrome tab: ERR_NO_SUPPORTED_PROXIES

Image:

In my case, in am trying to use smartproxy residential proxies. A snippet of working code with requests would be this:

import requests
url = 'https://ip.smartproxy.com/json'
username = 'some_user'
password = 'some_password'
proxy = f"http://{username}:{password}@es.smartproxy.com:10000"
result = requests.get(url, proxies = {
    'http': proxy,
    'https': proxy
})
print(result.text)

A working example with undetected_chromedriver & selenium_wire would be this:

import seleniumwire.undetected_chromedriver as uc

# Proxy server details
PROXYUSERNAME = 'some_user'
PROXYPASSWORD = 'some_password'
PROXYPORT = '10000'

# define your proxy credentials
proxy_username = PROXYUSERNAME
proxy_password = PROXYPASSWORD
proxy_host = 'es.smartproxy.com'
proxy_port = PROXYPORT

# form the proxy address
proxy_address = f'http://{proxy_username}:{proxy_password}@{proxy_host}:{proxy_port}'

# add the proxy address to proxy options
proxy_options = {
    'proxy': {
        'http': proxy_address,
        'https': proxy_address,
    }
}

if __name__ == '__main__':
    # set Chrome options
    options = uc.ChromeOptions()

    # run Chrome in headless mode
    options.headless = True
    options.add_argument('--ignore-certificate-errors')

    # create a Chrome instance with the proxy options
    driver = uc.Chrome(
        seleniumwire_options=proxy_options,
        options=options,
        use_subprocess=False,
    )

    # visit the test URL to check your proxy IP
    driver.get('https://httpbin.io/ip')
    ip_address = driver.find_element(By.TAG_NAME, 'body').text
    print(ip_address)

    # close the browser
    driver.quit()

However, when using these credentials with nodriver I get the previous error. Any ideas anyone?

Ps: @strukiii @WindBora @epicwhale @SSujitX

[LuisGMM]

Sure, maybe I explained myself wrong, sorry about that :)
I would love to use nodriver with a proxy, as described above by other colleagues, however I cannot manage to make it work as I could using requests or undetected_chromedriver with seleniumwire

[ultrafunkamsterdam]

await start(browser_args=["--proxy-server=socks5://127.0.0.1:9150"])

[LuisGMM]

What does that mean @ultrafunkamsterdam ?

[felipemedlev]

Any luck?

[ultrafunkamsterdam]

What does that mean @ultrafunkamsterdam ?

I would love to use nodriver with a proxy,

[BarisSenel]

Hi, here's what I usually do for authentication-required SOCKS5 proxies with Chromium. I use GOST
It can be used on linux/windows

import subprocess

def start_gost_proxy(proxy, rport):
    ip, port, user, password = proxy.split(":")
    gost_proxy = f"socks5://{user}:{password}@{ip}:{port}"
    gost_command = ["gost", "-L", f":{rport}", "-F", gost_proxy]
    subprocess.Popen(gost_command, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL)
    print(f"Started GOST proxy with {gost_proxy} on port {rport}")

async def login(email, password):
    start_gost_proxy("YourProxyIP:YourProxyPort:Username:Password", 2000)
    browser = await start(headless=False, lang="en-US", browser_args=["--proxy-server=socks5://localhost:2000"])

[sufyanhamid]

@BarisSenel will it work with the http datacenter proxies?

[BarisSenel]

Yes it would you can look up to GOST documents it supports both socks5 / http https://gost.run/

[diyorjon-olimjonov]

it worked, thanks

[ultrafunkamsterdam]

Proxy with auth solved in latest version, you can also use per window/tab another proxy

see here

[danofun]

Thank you for implementing this feature! Unfortunately, I'm receiving an error.

import nodriver
import time

async def main():

    browser = await nodriver.start(
        headless=False,
    )
    page = await browser.create_context('https://www.ipchicken.com', proxy_server='http://user:pass@ip:port')
    time.sleep(15)
    

if __name__ == '__main__':
    # since asyncio.run never worked (for me)
    nodriver.loop().run_until_complete(main())

is producing the following error on both Debian 12 and macOS 15.3.2 using either python 3.11 or 3.13.

Traceback (most recent call last):
  File "proxy_test.py", line 16, in <module>
    nodriver.loop().run_until_complete(main())
  File "/usr/lib/python3.11/asyncio/base_events.py", line 653, in run_until_complete
    return future.result()
           ^^^^^^^^^^^^^^^
  File "proxy_test.py", line 10, in main
    page = await browser.create_context('https://www.ipchicken.com', proxy_server='http://user:pass@ip:port')
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/nodriver/core/browser.py", line 307, in create_context
    fw = util.ProxyForwarder(proxy_server=proxy_server)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/nodriver/core/util.py", line 4589, in __init__
    self.port = util.free_port()
                ^^^^
NameError: name 'util' is not defined. Did you mean: 'shutil'?
successfully removed temp profile /tmp/uc_ail1vv85

Is this implementation for socks5 authenticated proxies only?

[BarisSenel]

@ultrafunkamsterdam @danofun
Enter the util.py from "C:\Users{Username}\AppData\Local\Programs\Python\Python313\Lib\site-packages\nodriver\core"
inside util.py there will be this line
self.port = util.free_port()
change it to
self.port = free_port()
fixed for me

[ultrafunkamsterdam]

Damn. Yes I moved the custom proxy to util file laat minute . Thanks will fix in repo in 60 minutes

[ultrafunkamsterdam]

Thank you for implementing this feature! Unfortunately, I'm receiving an error.

import nodriver
import time

async def main():

    browser = await nodriver.start(
        headless=False,
    )
    page = await browser.create_context('https://www.ipchicken.com', proxy_server='http://user:pass@ip:port')
    time.sleep(15)
    

if __name__ == '__main__':
    # since asyncio.run never worked (for me)
    nodriver.loop().run_until_complete(main())

is producing the following error on both Debian 12 and macOS 15.3.2 using either python 3.11 or 3.13.

Traceback (most recent call last):
  File "proxy_test.py", line 16, in <module>
    nodriver.loop().run_until_complete(main())
  File "/usr/lib/python3.11/asyncio/base_events.py", line 653, in run_until_complete
    return future.result()
           ^^^^^^^^^^^^^^^
  File "proxy_test.py", line 10, in main
    page = await browser.create_context('https://www.ipchicken.com', proxy_server='http://user:pass@ip:port')
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/nodriver/core/browser.py", line 307, in create_context
    fw = util.ProxyForwarder(proxy_server=proxy_server)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/nodriver/core/util.py", line 4589, in __init__
    self.port = util.free_port()
                ^^^^
NameError: name 'util' is not defined. Did you mean: 'shutil'?
successfully removed temp profile /tmp/uc_ail1vv85

Is this implementation for socks5 authenticated proxies only?

Yes socks5 only atm

[zerxdapro]

Proxy with auth solved in latest version, you can also use per window/tab another proxy

see here

'Browser' object has no attribute 'create_context'

[Pavlo165]

I'm trying to use a SOCKS5 proxy with authentication in nodriver. However, when I set the proxy in create_context, I get an error and the browser fails to start the context.

Code

async def init_browser():
    browser = await uc.start(
        headless=False,
        browser_args=[
            "--start-maximized"
        ]
    )
    proxied_tab = await browser.create_context(
        proxy_server = "socks5://user:[email protected]:8005",
        proxy_bypass_list = ["localhost"]
    )
    await proxied_tab.get('https://whatismyip.com')
    return browser, proxied_tab

async def main():
    browser, main_tab = await init_browser()
    await browser.wait(3600)

if __name__ == "__main__":
    uc.loop().run_until_complete(main())
    

Error

2025-06-21 23:47:18,903 INFO [2848] nodriver.core.browser [browser.py:440] - enabling autodiscover targets
2025-06-21 23:47:18,917 INFO [2848] nodriver.core.util [util.py:4599] - socks proxy with authentication is requested : socks5://user:[email protected]:8005
2025-06-21 23:47:18,921 INFO [2848] nodriver.core.util [util.py:4602] - starting forward proxy on 127.0.0.1:64927
2025-06-21 23:47:18,934 INFO [2848] nodriver.core.util [util.py:4603] - which forwards to socks5://user:[email protected]:8005
Traceback (most recent call last):
  File "C:\Users\mothu\OneDrive\Рабочий стол\nodriver\parser\parser.py", line 45, in <module>
    uc.loop().run_until_complete(main())
  File "C:\Users\mothu\AppData\Local\Programs\Python\Python311\Lib\asyncio\base_events.py", line 653, in run_until_complete
    return future.result()
           ^^^^^^^^^^^^^^^
  File "C:\Users\mothu\OneDrive\Рабочий стол\nodriver\parser\parser.py", line 38, in main
    browser, main_tab = await init_browser()
                        ^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\mothu\OneDrive\Рабочий стол\nodriver\parser\parser.py", line 19, in init_browser
    proxied_tab = await browser.create_context(
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\mothu\AppData\Local\Programs\Python\Python311\Lib\site-packages\nodriver\core\browser.py", line 321, in create_context
    ctx: cdp.browser.BrowserContextID = await self.connection.send(
                                        ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\mothu\AppData\Local\Programs\Python\Python311\Lib\site-packages\nodriver\core\connection.py", line 518, in send
    return await tx
           ^^^^^^^^
nodriver.core.connection.ProtocolException: Invalid parameters [code: -32602]
2025-06-21 23:47:18,989 INFO [2848] nodriver.core.browser [browser.py:683] - terminated browser with pid 12416 successfully
successfully removed temp profile C:\Users\mothu\AppData\Local\Temp\uc_y477s70t

Does anyone know how to properly set a SOCKS5 proxy with authentication in nodriver? Any help or advice is appreciated.

[nathanfallet]

We cannot get a proxy with auth working directly in the browser, because auth is not supported in the URL and you need to pause a request to handle it. The issue we got was that every other requests were paused when we didn't want them paused, so we could not do anything.

The way we made it work was by using gost to start a local proxy that handles auth for us, and then connecting the browser to the local proxy without auth:

# Somewhere before starting the browser
# In your case, url = "socks5://user:[email protected]:8005"
gost_command = ["gost", "-L", f":{port}", "-F", url]
subprocess.Popen(gost_command, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL)

# When starting the browser
browser_args = [
    f"--proxy-server=socks5://localhost:{port}",
    # ...
]