Add MouseDown/MouseUp methods to InteractiveBrowser interface #79

New Issue

Claude · 2026-02-28T15:24:27Z

Claude commented

2026-02-28 15:24:27 +00:00

Problem

The InteractiveBrowser interface currently has MouseClick (which does mousedown+mouseup at the same position), MouseMove, and MouseWheel. However, there's no way to perform a drag operation, which requires:

MouseDown at position A
MouseMove to position B
MouseUp at position B

This is needed for slider captchas (e.g., DataDome's GeeTest slider used by NYT) where the user must drag a slider handle from left to right.

Proposed Change

Add two new methods to InteractiveBrowser:

// MouseDown presses the mouse button at the given coordinates without releasing.
MouseDown(x, y float64, button string) error
// MouseUp releases the mouse button at the given coordinates.
MouseUp(x, y float64, button string) error

Implementation would use Playwright's existing page.Mouse().Down() and page.Mouse().Up():

func (ib *interactiveBrowser) MouseDown(x, y float64, button string) error {
    if err := ib.page.Mouse().Move(x, y); err != nil {
        return err
    }
    var btn *playwright.MouseButton
    switch button {
    case "right":
        btn = playwright.MouseButtonRight
    case "middle":
        btn = playwright.MouseButtonMiddle
    default:
        btn = playwright.MouseButtonLeft
    }
    return ib.page.Mouse().Down(playwright.MouseDownOptions{Button: btn})
}

func (ib *interactiveBrowser) MouseUp(x, y float64, button string) error {
    if err := ib.page.Mouse().Move(x, y); err != nil {
        return err
    }
    var btn *playwright.MouseButton
    switch button {
    case "right":
        btn = playwright.MouseButtonRight
    case "middle":
        btn = playwright.MouseButtonMiddle
    default:
        btn = playwright.MouseButtonLeft
    }
    return ib.page.Mouse().Up(playwright.MouseUpOptions{Button: btn})
}

Context

Mort's captcha proxy and browser proxy use InteractiveBrowser for remote browser control. Without drag support, users cannot solve slider captchas through the proxy. The mort-side changes (JS client + Go handler) are ready and will use an optional interface check so they work automatically once this is implemented.

## Problem The `InteractiveBrowser` interface currently has `MouseClick` (which does mousedown+mouseup at the same position), `MouseMove`, and `MouseWheel`. However, there's no way to perform a **drag** operation, which requires: 1. `MouseDown` at position A 2. `MouseMove` to position B 3. `MouseUp` at position B This is needed for slider captchas (e.g., DataDome's GeeTest slider used by NYT) where the user must drag a slider handle from left to right. ## Proposed Change Add two new methods to `InteractiveBrowser`: ```go // MouseDown presses the mouse button at the given coordinates without releasing. MouseDown(x, y float64, button string) error // MouseUp releases the mouse button at the given coordinates. MouseUp(x, y float64, button string) error ``` Implementation would use Playwright's existing `page.Mouse().Down()` and `page.Mouse().Up()`: ```go func (ib *interactiveBrowser) MouseDown(x, y float64, button string) error { if err := ib.page.Mouse().Move(x, y); err != nil { return err } var btn *playwright.MouseButton switch button { case "right": btn = playwright.MouseButtonRight case "middle": btn = playwright.MouseButtonMiddle default: btn = playwright.MouseButtonLeft } return ib.page.Mouse().Down(playwright.MouseDownOptions{Button: btn}) } func (ib *interactiveBrowser) MouseUp(x, y float64, button string) error { if err := ib.page.Mouse().Move(x, y); err != nil { return err } var btn *playwright.MouseButton switch button { case "right": btn = playwright.MouseButtonRight case "middle": btn = playwright.MouseButtonMiddle default: btn = playwright.MouseButtonLeft } return ib.page.Mouse().Up(playwright.MouseUpOptions{Button: btn}) } ``` ## Context Mort's captcha proxy and browser proxy use `InteractiveBrowser` for remote browser control. Without drag support, users cannot solve slider captchas through the proxy. The mort-side changes (JS client + Go handler) are ready and will use an optional interface check so they work automatically once this is implemented.

Claude commented

2026-02-28 15:34:35 +00:00

Starting work on this. Plan: add MouseDown and MouseUp to the InteractiveBrowser interface and implement them on interactiveBrowser, following the pattern from the issue description. Will also update the mock in promote_test.go.

Starting work on this. Plan: add `MouseDown` and `MouseUp` to the `InteractiveBrowser` interface and implement them on `interactiveBrowser`, following the pattern from the issue description. Will also update the mock in `promote_test.go`.

Claude referenced this issue from a commit

2026-02-28 15:35:41 +00:00

feat: add MouseDown/MouseUp methods to InteractiveBrowser

Claude referenced a pull request that will close this issue

2026-02-28 15:35:50 +00:00

feat: add MouseDown/MouseUp to InteractiveBrowser #80

Claude closed this issue

2026-02-28 15:35:56 +00:00

Claude commented

2026-02-28 15:36:01 +00:00

Done. PR #80 has been merged. Added MouseDown and MouseUp to the InteractiveBrowser interface and implementation.

Done. PR #80 has been merged. Added `MouseDown` and `MouseUp` to the `InteractiveBrowser` interface and implementation.

Claude commented

2026-02-28 15:39:05 +00:00

Resolved — MouseDown and MouseUp are now part of InteractiveBrowser. Updated mort in PR steve/mort#862 to use them directly for drag gesture support (slider captchas).

Resolved — `MouseDown` and `MouseUp` are now part of `InteractiveBrowser`. Updated mort in PR steve/mort#862 to use them directly for drag gesture support (slider captchas).

Sign in to join this conversation.

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: steve/go-extractor#79