Create an account


Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
AppleInsider - Apple researching trackpad & gesture combo for controlling AR

#1
Apple researching trackpad & gesture combo for controlling AR

Rather than attempting to manipulate AR objects through gloves or a game controller, a peripheral like a trackpad could allow users to select and manipulate what they see in front of them.

The four images at the top are meant to be being displayed in AR, while the trackpad-style device at the bottom is a physical one that the user can control

The four images at the top are meant to be being displayed in AR, while the trackpad-style device at the bottom is a physical one that the user can control

Alongside headsets like Apple Glasses which lets users see augmented reality, there’s a need to interact and manipulate virtual objects. This is often done by the user having to also wear a type of glove, but Apple is looking at creating a physical surface that can detect touch. It’s considering a large trackpad for controlling computer-generated environments (CGR) through ARKit.

“CGR environments are environments where some objects displayed for a user’s viewing are generated by a computer,” says Apple in US Patent No. <a href="http://appft.uspto.gov/netacgi/nph-Parser?Sect1=PTO2&Sect2=HITOFF&u=%2Fnetahtml%2FPTO%2Fsearch-adv.html&r=114&p=3&f=G&l=50&d=PG01&S1=(apple.AANM.+AND+20200402.PD.)&OS=aanm/apple+and+pd/4/2/2020&RS=(AANM/apple+AND+PD/20200402)
%0D%0A”>20200104025, called “Remote Touch Detection Enabled by Peripheral Device.”

“A user can interact with these virtual objects by activating hardware buttons or touching touch-enabled hardware,” it continues. “However, such techniques for interacting with virtual objects can be cumbersome and non-intuitive for a user.”

Apple’s proposed solutions include a variety of “techniques for remote touch detection using a system of multiple devices,” but the principle one is a “peripheral device that is placed on a physical surface such as the top of a table.”

While a headset is showing a user a composite image of the real world around him or her, including this trackpad-style device, it can also be displaying virtual objects. Just as with a trackpad and screen on a MacBook Pro, the user can be looking at the virtual object while their fingers perform touch gestures on the trackpad.

A camera in the headset can locate the trackpad, and combined with that device’s touch sensitive surface, calculate what virtual objects the user is attempting to manipulate.

Drawings in the patent show a user selecting from a choice of images by tapping at a corresponding part of the pad. They show the user rotating objects, or resizing them, using familiar touch gestures and movements.

Most of the patent describes methods of registering touches, and of displaying the composite AR and real image. Part of the latter suggests using holograms projected onto surfaces.

Key to the patent application, though, is how the use of the trackpad-like device can change depending on the AR images being presented, and where the device is in relation to the user. The combination of the trackpad and the headset working together mean that the user can be told to reposition the peripheral touch device.

“For optimal operation, peripheral device can request additional space near or around itself such that camera sensor(s) are free from occlusions (e.g., obstructions),” it says. An error message can be displayed in the headset and cleared by the user moving the trackpad into a better position.

The top message is an error displayed on the user's AR headset, and is cleared by the user moving the trackpad-like device to a better position

The top message is an error displayed on the user’s AR headset, and is cleared by the user moving the trackpad-like device to a better position

That chiefly means being in view of the headset camera and not obscured by other items, but can also be as specific as requiring the device be turned a certain way.

“In some embodiments, the set of operating conditions includes a requirement that peripheral device is in a suitable orientation (e.g., a surface of the peripheral device is approximately parallel with respect to the ground, is horizontal, is vertical, so forth),” it concludes.

The patent is credited to four inventors, Samuel L. Iglesias, Devin W. Chalmers, Rhit Sethi, and Lejing Wang. The latter has recently been credited on a similar patent regarding accurate handling of real and virtual objects, while Chalmers is listed on one about having digital assistants guiding users through AR and VR.



https://www.sickgaming.net/blog/2020/04/...olling-ar/
Reply



Possibly Related Threads…
Thread Author Replies Views Last Post
  AppleInsider - Apple may offer iPad Air shipment date during ‘Hi, Speed’ event xSicKxBot 0 12 10-10-2020, 05:19 PM
Last Post: xSicKxBot
  AppleInsider - Apple working on how to securely present electronic ID wirelessly xSicKxBot 0 21 10-08-2020, 06:07 PM
Last Post: xSicKxBot
  AppleInsider - Breaking down the Coalition for App Fairness’ issues with Apple xSicKxBot 0 29 10-05-2020, 07:17 PM
Last Post: xSicKxBot
  AppleInsider - Google Project Zero security researcher moves to Apple xSicKxBot 0 27 10-04-2020, 08:25 PM
Last Post: xSicKxBot
  AppleInsider - EU could force Apple to share user data with competitors xSicKxBot 0 33 10-01-2020, 03:55 PM
Last Post: xSicKxBot
  AppleInsider - How to buy Apple Watch faces in watchOS 7 xSicKxBot 0 40 09-25-2020, 07:51 PM
Last Post: xSicKxBot
  AppleInsider - Duelling mini LED suppliers could cut cost on display tech for Apple xSicKxBot 0 50 09-21-2020, 12:09 PM
Last Post: xSicKxBot
  AppleInsider - Apple AR research encompasses so much more than entertainment xSicKxBot 0 41 09-17-2020, 02:32 PM
Last Post: xSicKxBot
  AppleInsider - Apple steps up promotion ahead of ‘Time Flies’ event xSicKxBot 0 51 09-14-2020, 06:26 PM
Last Post: xSicKxBot
  AppleInsider - Flash deal: Apple AirPods Pro return to record low $199 price xSicKxBot 0 45 09-13-2020, 01:33 PM
Last Post: xSicKxBot

Forum Jump:

Become a Patron!
[-]
Upcoming Events

[-]
Latest Threads
[Tut] How To Kill A Thread In Python?
Last Post: xSicKxBot
Today 05:40 AM
» Replies: 0
» Views: 3
(Indie Deal) FREE Ghost Sweeper, ? NBA 2...
Last Post: xSicKxBot
Today 05:40 AM
» Replies: 0
» Views: 3
News - Nintendo Is Permanently Reducing ...
Last Post: xSicKxBot
Today 04:13 AM
» Replies: 0
» Views: 2
News - Blade Runner: Enhanced Edition De...
Last Post: xSicKxBot
Today 04:13 AM
» Replies: 0
» Views: 4
Humble Ultimate Fantasy Game Development...
Last Post: xSicKxBot
Yesterday 10:00 PM
» Replies: 0
» Views: 7
Microsoft - Honeywell teams up with Micr...
Last Post: xSicKxBot
Yesterday 09:59 PM
» Replies: 0
» Views: 6
Fedora - Secure NTP with NTS
Last Post: xSicKxBot
Yesterday 09:59 PM
» Replies: 0
» Views: 6
News - Video: First 4 Figures Unboxes It...
Last Post: xSicKxBot
Yesterday 09:59 PM
» Replies: 0
» Views: 6
News - Battlefield 5 Definitive Edition ...
Last Post: xSicKxBot
Yesterday 09:59 PM
» Replies: 0
» Views: 7
(Indie Deal) Alien Cat Bundle, RIDE 4 re...
Last Post: xSicKxBot
Yesterday 05:21 PM
» Replies: 0
» Views: 6

[-]
Twitter

[-]
Sponsored
Get the Deal of the Week at RefurBees.com

Copyright © SickGaming.net 2012-2020