OpenAI browser tools

Use Browser Use Cloud as the remote browser for OpenAI models. Start with the library driver and a remote Cloud browser. The separate Playwright example provides another connection:

Connection	Browser actions	Dependencies
Library driver	Browser Use Actor	Browser Use with the `openai-tools` extra
Remote browser example	Playwright	OpenAI SDK, Browser Use Cloud SDK, Playwright

The OpenAI SDK defines the tools and runs the model loop. Browser Use supplies the remote browser. The library driver also supplies browser actions.

Browser Use library driver

Install the tested Browser Use release with the OpenAI tools extra:

uv venv --python 3.12
uv pip install --python .venv/bin/python "browser-use[openai-tools] @ git+https://github.com/browser-use/browser-use.git@0.13.13"

Set your keys and model:

export BROWSER_USE_API_KEY=your-browser-use-key
export OPENAI_API_KEY=your-openai-key
export OPENAI_MODEL=your-model

Get your Browser Use API key. Choose an OpenAI model that supports Responses function tools. OpenAI 3.x uses httpx2 for custom HTTP clients. Use OpenAI’s DefaultAsyncHttpxClient when configuring a custom client. The following example uses a remote browser:

import asyncio
import os

from openai import AsyncOpenAI
from openai.lib.browser import AsyncBrowserToolset
from openai.lib.responses_tool_runner import AsyncResponsesToolRunner

from browser_use.integrations.openai import BrowserUse


async def confirm(context):
    return context["member"] in {"new_tab", "navigate"}


async def allow_url(context, url):
    return url in {"https://example.com", "https://example.com/"}


async def main():
    model = os.environ["OPENAI_MODEL"]
    async with AsyncOpenAI() as client, BrowserUse(use_cloud=True) as driver:
        tools = AsyncBrowserToolset(
            driver,
            members=["new_tab", "navigate", "get_page_text"],
            confirm=confirm,
            url_policy=allow_url,
        )
        runner = AsyncResponsesToolRunner(browser=tools)
        try:
            response = await runner.run(
                client,
                {
                    "model": model,
                    "store": False,
                    "input": "Open https://example.com and read its heading and explanation.",
                },
                max_steps=6,
            )
            text = await driver.get_page_text({"tab_id": None})
            if "documentation examples" not in text:
                raise RuntimeError("The browser did not show the expected page.")
            print(response.output_text)
        finally:
            runner.close()
            tools.close()


asyncio.run(main())

The driver creates and closes its own browser. You can also pass an already connected BrowserSession. The caller keeps responsibility for that borrowed session. Use BrowserUse() for a local browser after installing Chromium with uvx browser-use install.

Remote browsers with Playwright

This path uses the Cloud SDK without the open-source Browser Use agent. You do not need local Chromium. Create a separate environment:

uv venv --python 3.12
uv pip install --python .venv/bin/python openai==3.31.0 browser-use-sdk==3.11.3 playwright==1.63.0

Set your keys and model:

export BROWSER_USE_API_KEY=your-browser-use-key
export OPENAI_API_KEY=your-openai-key
export OPENAI_MODEL=your-model

Get your Browser Use API key. Choose an OpenAI model that supports Responses function tools. Download both files from the remote browser example:

browser_use_driver.py
browser_use_responses.py

Keep the files together and run:

.venv/bin/python browser_use_responses.py

The example creates a dedicated Cloud browser and connects through Chrome DevTools Protocol (CDP). It gives the model two tools: navigation and page-text reading. It permits navigation only within example.com. It closes the connection and stops its browser after the run. Both providers charge for their respective services. The example prints the model answer after the driver reads the page. Check the page result and browser cleanup separately.

Library driver actions

The default tools cover navigation, tabs, page reads, element search, screenshots, zoom, clicks, typing, keys, scrolling, selection, and waits. The SDK exposes list_tabs from the driver’s state method. Enable additional methods with additional_members:

tools = AsyncBrowserToolset(
    driver,
    additional_members=["click_at", "hover_at", "drag_path", "hold_keys", "set_checked"],
    confirm=confirm,
    url_policy=allow_url,
)

The example confirmation callback only permits navigation. Change that callback to approve the actions your task needs. The driver also implements run_script for explicitly approved page JavaScript. A script timeout stops waiting; it does not guarantee that page execution stops. This version does not implement scoped reads, console/network diagnostics, uploads, or downloads. It does not include Bash. The remote browser filesystem differs from the application filesystem.

References and approvals

Read the page before using an element reference. A new page read replaces that tab’s references. Navigation, detached elements, and tab changes can invalidate references. Page reads use the main document’s accessibility tree. They do not guarantee complete iframe or shadow-root coverage. Screenshots and coordinate actions provide another way to inspect and operate the page. OpenAI’s toolset validates inputs and invokes your confirmation callback before actions. The URL callback checks requested navigation; it does not replace network controls. Keep task permissions and provider settings in application code. See the OpenAI browser helper reference.

Get Started

Customize

Examples

Development

Browser Use library driver

Remote browsers with Playwright

Library driver actions

References and approvals

​Browser Use library driver

​Remote browsers with Playwright

​Library driver actions

​References and approvals

Browser Use library driver

Remote browsers with Playwright

Library driver actions

References and approvals