​

What Muse adds

Logitech Muse is a spatial digital pencil for Apple Vision Pro. In NavigatorIM it gives a tangible way to indicate a physical teaching point and trigger a selected action with a button. It can reduce the need to move a hand from the point being discussed to a floating button. This is a proposed usability advantage, not a measured accuracy improvement or a promise of touch-free operation.

This source release connects Muse poses and button events on native Vision Pro. It does not provide native Muse 3D tracking on iPhone/iPad. It is not the Muse EEG headband and is not a Meta-only stylus. A Bluetooth connection is not the same as a live valid spatial pose.

Hardware can offer features that an application does not use. NavigatorIM does not thereby provide pressure-sensitive freehand painting, every manufacturer gesture or an app-specific haptic warning. Its optional tip-pressure input is a capture trigger, not a drawing brush. Muse is optional, sold separately and not a calibrated metrology instrument by virtue of pairing.

 Pair, enter the app, then confirm tracking

Follow Logitech's instructions for your device/firmware. Its getting-started guide specifies holding the top and primary buttons together for about three seconds to enter Bluetooth pairing, then selecting Muse in Vision Pro Bluetooth settings. Charge it through USB-C and follow the manufacturer's power instructions. Pairing is a system/hardware action, not NavigatorIM calibration.

Open the native NavigatorIMVision application, accept the launch acknowledgement, enter immersive space and permit the requested supported tracking features. Open Settings → Registration. Use Rescan Muse when needed. Confirm the accessory's live tracking state, not only a connected message. Keep the reference and stylus observable in a clear, stable, well-lit bench setup. If no live pose appears, stop capture and check the pairing/provider/permission and immersive status before changing calibration.

The current implementation uses one active spatial stylus. It does not provide a user-selectable two-Muse measurement pair. Connecting a second pen does not guarantee selection of the intended unit; keep one active during the demonstration. Do not present it as simultaneous two-stylus triangulation.

 Calibrate before interpreting physical contacts

Use the optical CYAN selector as an independently calibrated contact reference. The inherited CYAN default X 0, Y −160, Z 0 mm is a starting setting, not proof of its physical tip location. Check its actual hardware and calibrate it first.

For the simple Muse point-selector workflow, keep Reference body set to RED Object 26 with the matching real reference fixed to the teaching workpiece. Select Registration source → Muse AIM. Set Muse distal action → Navigate only and turn Muse tip pressure triggers selected action OFF while calibrating.

Gently hold the physical Muse tip at the calibrated CYAN tip, with both live and stable. Select Calibrate Muse from stable CYAN contact. Wait for the app's accepted/rejected message; do not force an unstable sample to pass. The controller checks a recent contact sample set for stability. Those internal thresholds are admission checks, not a guaranteed physical accuracy specification.

After acceptance, check the displayed tip against several other known physical contacts and orientations. Recalibrate after changing the tip geometry, mounting, offset or optical selector setup. Export important workflow data before changes that invalidate registration. Do not assume a numeric saved offset proves a successful calibration of this setup.

 Choose the action before pressing the primary button

The on-screen picker is Muse distal action. Primary/distal performs the selected action when the existing tracking and workflow guards allow it. Secondary/proximal is mode-specific undo, not general model undo.

Navigate only: primary does not add a point; secondary does not undo model editing. Use it while demonstrating pose movement or preparing calibration.

Register point: primary records the next required P1/P2/D3/D4 sample; secondary undoes the last registration sample. Follow the next-point instruction and its three-samples-per-landmark sequence.

Add point of interest: primary adds a POI using the configured point workflow; secondary undoes the last POI edit snapshot. That undo is not necessarily equivalent to deleting only the last point, because the last edit might be another POI change.

Mark danger: primary records a keep-out/danger point; secondary removes the last danger point. This annotates supplied geometry; it does not detect hazards or provide protection.

Free point: primary adds a free Navigator sample; secondary removes the most recent free sample.

IN cloud sample: primary adds an IN sample; secondary removes the most recent IN sample. OUT cloud sample behaves correspondingly for OUT. These samples support the retained geometric fitting workflow; they are not an automatic scan of the whole object.

Muse primary capture commits through the existing guarded capture path; it does not open the separate hand-tip review dialog. Do not instruct users to expect that dialog after each Muse click. Check the resulting point or sample count and undo the mode's last edit when appropriate.

The optional tip-pressure toggle is OFF until deliberately enabled. When ON, a qualifying tip press can invoke the selected capture action; keep it off while resting, handling or repositioning the pen. Release between intentional captures. Do not press secondary as if it were a universal Cancel or model undo control.

 Point selector versus reference body

As a point selector, Muse moves while a separate reference defines the workpiece frame. This is the easiest way to film point identification on a stationary phantom or fixture. The pen's button records the contact being explained.

As a reference body, the active Muse AIM pose defines a frame to which content can be related. Secure it to an inert demonstration fixture with a suitable non-damaging attachment, keep it visible and verify its relationship to the model. Use an independent CYAN selector or the supported hand source for capture. The same active Muse cannot be its own reference and capture pointer: that would be a self-referential measurement rather than a meaningful point on the workpiece.

Changing reference body can invalidate reference-local registration, danger and sample data. This is not a shortcut to preserve old points in a different coordinate frame. Check the displayed source and keep necessary exports. The current one-active-stylus pipeline is not a way to use one Muse as reference and a second Muse as pointer simultaneously.

 A clear twenty-second Muse demonstration

Before filming, pair and calibrate, prepare the independent physical reference, name the intended POI and select Add point of interest. Record the actual Settings action selection, show the live tip, touch a visible sticker on an inert phantom and press primary once. Show the resulting labelled POI. Move the pen away: the recorded point is not supposed to follow the moving pointer. Show a second deliberate capture, then demonstrate the mode-specific secondary undo and the changed point list.

Keep the camera/reference views unobstructed. If a tracking gap occurs, show it honestly, stop capture and recover. The objective is tangible point selection and understandable interaction, not proving submillimetre accuracy. Do not show a live powered tool, contact with a person or a patient-care procedure.

 Troubleshooting

Connected but no point: check immersive state, live AIM pose, permissions, action, reference and freshness. Navigate only intentionally adds no points. A loading reference is not live recognition.

Unexpected point: disable pressure capture, verify the active mode, check the result and use only the relevant undo. Model-manipulation undo is elsewhere.

Offset tip: verify CYAN calibration, repeat stable contact and independently check the result. Do not compensate a wrongly sized visual CAD model by calibrating the physical tip to its apparent screen position.

Hand pinch versus Muse: system spatial gestures manipulate models; optional hand-joint capture uses a separate candidate/review workflow. Disarm hand point capture when demonstrating Muse unless a deliberate separate task requires it.

Tracking unavailable: do not capture against a held display. Re-establish a valid reference and pose. Higher resource settings cannot guarantee optical visibility or repair incorrect physical calibration.

Manufacturer instructions: https://support.logi.com/hc/en-us/articles/32732081105431-Getting-Started-Logitech-Muse

Source basis: Build 14 IMNailMuseController.swift, AppModel.processMuseEvents(), SettingsView.swift and the shared point/registration implementations, retained in Build 15 except for a descriptive button-status label.

easy.