Skip to content

Computer Use action cursor still freezes after drawing and is not cleared #359

Description

@Tryanks

Current bug, reconfirmed by the reporter

The reporter explicitly reconfirmed on 2026-09-08 that this behavior still occurs despite the existing overlay changes. This issue remains actionable; the presence of animation and visibility code does not establish a fix.

The Computer Use cursor is drawn once, appears to stop reflecting later actions, and remains on screen without being cleared. The indicator therefore cannot be trusted as feedback about what the agent is currently doing.

Existing implementation

The macOS backend already publishes click, move, scroll, keyboard and drag overlay actions. CursorUi animates between points and distinguishes action kinds. #319 also gates visibility on the target app being frontmost; disabling the overlay or losing the target process has cleanup paths. This is a lifecycle/action-delivery investigation, not a missing-overlay feature.

The inspected state retains its target and polls foreground visibility, but has no inactivity expiry in that lifecycle. Determine separately why subsequent actions reportedly fail to update and when a completed action/run should cease to leave a visible marker.

Acceptance criteria

  • A recorded sequence of click, move, scroll, keyboard and drag actions produces feedback associated with the current target and latest action; delayed callbacks cannot restore an obsolete marker.
  • Define and implement the visible lifetime after the last action. Completion, cancellation, backend shutdown, disabling the feature and target closure leave no stale cursor.
  • Switching away from and back to the target cannot resurrect an expired action.
  • Preserve foreground gating and pointer/event passthrough; the visual overlay must not intercept input or activate the target.
  • Verify sequential actions and cleanup in a real GUI, including display-coordinate changes where available. Record the platform, revision and action trace.

The original report did not specify a platform or trace. The macOS implementation is the concrete starting point; do not infer that every platform has the same overlay backend or failure.

Code context

Reviewed against main at b4c549787da6 (2026-09-08).

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions