Connect Screen connect-screen

AR glasses · BiggerDroid

AR glasses on,
phone hard to see and tap:
how do you search and control?

BiggerDroid turns your phone into a remote. With Cast single app, Cast sandbox app or Desktop mirror, set Controls to Laser pointer or Touchpad: keep your eyes on the pointer in the glasses while your hand taps, scrolls and goes back on the phone without looking. To search, hold the large button and say the title; the text goes straight into the search box.

Android phone · Android 8.0 or later · 64-bit (arm64)

What this solves

Three steps to control everything with the glasses on

  1. Connect the glasses, pick a control mode

    Connect the AR glasses to your phone, open BiggerDroid and select them in the screen list. Set Controls to Laser pointer or Touchpad. The illustrations below show the difference; if your phone has no gyroscope, choose Touchpad.

    AR glasses1920×1080 · 60Hz ScreenrotationNo rotation ▾ ControlsTouchpad ▾ Phone appsUse your installed apps, sign-ins and data Cast single appDesktop mirror Sandbox appsSeparate app copies, sign-ins and data Cast sandbox app Pick Laser pointer or Touchpad
    Illustration; the app’s actual screens may differ.
  2. Pick a casting option: all three work with the remote

    To keep using the apps you’re signed in to on your phone, tap Cast single app and pick a video app; it is laid out for the glasses’ screen and fills it best. Or tap Desktop mirror to show the same picture on the glasses and the phone and switch apps freely. Both need Shizuku or the BiggerDroid accessibility service first. If you’d rather not grant those, tap Cast sandbox app, install the video app in the sandbox and sign in once more there.

    AR glasses1920×1080 · 60Hz ScreenrotationNo rotation ▾ ControlsTouchpad ▾ Phone appsUse your installed apps, sign-ins and data Cast single appDesktop mirror Sandbox appsSeparate app copies, sign-ins and data Cast sandbox app Cast single app or Desktop mirror
    Illustration; the app’s actual screens may differ.
  3. Control it while watching the glasses

    Once casting starts, the phone becomes a remote. Keep your eyes on the pointer in the glasses and use the spots shown below without looking; to search, just say the title.

Laser pointer or Touchpad: how does the pointer move?

In the glasses
Laser pointer: turn the phone like a flashlight and the pointer in the glasses follows. Handy lying down or leaning back; needs a phone with a gyroscope.
In the glasses
Touchpad: drag a finger on the touch area and the pointer follows, like a laptop touchpad. Works with the phone lying flat.

What does each spot on the remote do?

Illustration; the app’s actual screens may differ.
On the phoneIn the glasses
Turn the phone (Laser pointer)
Drag on the touch area (Touchpad)
The pointer moves
Tap / double-tap the touch areaClick / double-click at the pointer
Hold still on the touch areaReset the pointer
Swipe the large button in a direction
(with Laser pointer, the touch area works too)
Scroll lists and pages
Swipe right from the left edgeGo back
Tap the large buttonOpen the menu
Double-tap the large buttonPhone screen goes black so it won’t glare; double-tap again to restore
Hold the large buttonVoice input; release to finish

All three casting options use these controls. With Desktop mirror, the remote is a floating panel and things sit slightly differently; pull its top bar down to hide it for a while.

Search without typing: say the title

In the glasses
① Click the search box in the glasses with the pointer.
Interstellar
② Hold the large button on the phone and say the title.
In the glasses Interstellar
③ Release it: the text goes into the search box.

Voice input uses Gboard. Before the first use, install and set it up once in BiggerDroid’s settings. With Cast sandbox app, the keyboard also appears in the glasses, so you can type while reading the suggestions there.

Keep the glasses on. Say the title to search.