Skip to content

browser-use fails to identify/click icon-only "Create Test" button when tooltip is present but accessible label is missing #4801

@BBiswa123

Description

@BBiswa123

Browser Use Version

0.12.5

LLM Model

azure/gpt-4.1-mini

Screenshots, Description, and task prompt given to Agent

Image

Description

While running browser-use automation on the Cavisson UI, the agent successfully logs in and navigates to the Functional tab, but it is unable to reliably identify and click the Create Test button.

The Create Test control is an icon-only plus (+) button in the Functional page toolbar. When hovering over the icon, the UI shows a tooltip with text:

Create Test

However, the button itself does not appear to expose a stable accessible name such as:

aria-label="Add"

or

aria-label="Create Test"

Because the button is icon-only and the visible text exists only as a tooltip, browser-use struggles to locate it by text. In previous runs, the agent searched for Create Test, found no direct text match, and clicked an incorrect generic toolbar button instead.

Task prompt given to agent
Step 1: Navigate to https://10.10.10.115:4444/UnifiedDashboard/#/login
Step 2: Enter valid username-cavisson and password-@dmin and submit the login form
Step 3: Click on the 'Functional' button/tab in the dashboard
Step 4: Click on the 'Create Test' button
Step 5: Select the protocol option 'API Test'
Step 6: Verify the request URL field
Expected behavior

After navigating to the Functional page, browser-use should identify and click the Create Test plus icon button.

The target button is visible in the toolbar near the search field. On hover, the tooltip displays:

Create Test
Actual behavior

browser-use does not reliably identify the Create Test button by the tooltip text. It may fail to find Create Test in the page text or may click another nearby generic icon/button.

Screenshot reference

The screenshot shows the Functional page toolbar. The Create Test button is the plus (+) icon next to the search box, and the tooltip text Create Test appears on hover.

Suspected cause

The Create Test button is an icon-only control. The tooltip text is visible only on hover and may not be available in the accessibility tree or DOM text when browser-use scans the page.

Because the button lacks a stable accessible label, browser-use cannot confidently map the instruction:

Click on the 'Create Test' button

to the correct UI element.

HTML around where it's failing

Suggested fix / recommendation

Add an accessible label to the icon button, for example:

<button aria-label="Create Test" title="Create Test">
  +
</button>

or:

<button aria-label="Add" title="Create Test">
  +
</button>

Preferred:

<button aria-label="Create Test" title="Create Test">

Operating System & Browser Versions

linux

Python Code Sample

Full DEBUG Log Output

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions