Skip to content

[Feature]: Place automatic zooms on recorded clicks, not only on cursor dwells #699

Description

@EtienneLescot

Search existing issues

  • I have searched the existing issues

Is your feature request related to a problem?

Auto-enhance → Automatic zooms only looks at where the pointer rests. detectZoomDwellCandidates (src/lib/ai-edition/timeline/zoom-suggestions.ts) turns stretches where the cursor stays still for 450–2600 ms into zoom candidates, and ignores clicks entirely.

So a click made while the pointer is still moving never gets a zoom, and a quick click-driven demo (click, move on, click) gets few or none. Screen Studio and Cap build their automatic zooms from recorded clicks, which is what most people expect from this feature.

Describe the solution you'd like

Use the clicks we already record. CursorTelemetryPoint.interactionType carries click, double-click, right-click and friends on every platform that records clicks (Windows; macOS with Accessibility; Linux with the input group).

  • Treat a click as a zoom candidate, focused on the click position, even when the pointer does not dwell.
  • Merge it with a nearby dwell candidate instead of producing two zooms, and keep SUGGESTION_SPACING_MS between suggestions.
  • Takes without click data (browser fallback, Linux without the input group, imported videos) keep today's dwell-only behaviour.

Describe alternatives you've considered

  • Dwell-only, as today: works without click data, but misses the moments users care about most.
  • Clicks only: breaks on takes that have no click data.

Additional context

Raised while writing the website's /features/auto-zoom/ page, which currently has to say that the detector ignores clicks.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions