Desktop Augmented Reality app with voice commands and the Importance of User Experience

Ago 11, 2023 | News on Augmented, Mixed and Virtual Reality

With technology constantly pushing boundaries and redefining our digital experiences, one area gaining significant momentum is augmented reality (AR). AR has the ability to revolutionize how we interact with digital content by seamlessly integrating virtual elements with the real world. Although AR applications for mobile devices have gained popularity, we want to emphasize the significance of user experience when dealing with desktop augmented reality applications. A desktop AR app with voice commands can considerably enhance the user experience. The user experience (UX) is critical to the success of any digital application, including desktop AR. Desktop AR must provide intuitive, engaging, and seamless interactions to meet user expectations. The user experience should feel effortless, with natural navigation and meaningful interactions with virtual elements.

Advantages of AR Applications for Desktops with Voice Commands

1. Improved Interaction Users can seamlessly interact with digital content using natural language commands with a desktop AR application featuring voice commands. Complex gestures and keyboard input become unnecessary as the experience becomes more intuitive and accessible to a wider audience.
2. Improved Efficiency: Voice commands in desktop AR applications simplify users’ interactions, allowing them to perform tasks more efficiently. Users can create, manipulate, and navigate virtual objects with a simple voice command, reducing the time and effort required for complex tasks.
3. Engaging User Experiences: Through the combination of desktop AR and voice commands, users can fully engage themselves in immersive and interactive experiences. With intuitive voice interactions, users can explore virtual environments, interact with realistic 3D models, and even participate in real-time collaboration with others.
4. Equal accessibility for all: AR applications for desktop, featuring voice commands, have the potential to remove obstacles for users with limited mobility or visual impairments. By offering alternative input methods, such as voice commands, these applications make sure that all users can enjoy the magic of AR.

As the demand for desktop AR applications grows, organizations must prioritize user experience in order to deliver exceptional interactions. We can create intuitive, efficient, and engaging desktop AR experiences by harnessing the power of voice commands. A focus on user experience will be key to unlocking the full potential of desktop AR applications, whether it involves designing user-friendly interfaces, integrating advanced speech recognition technologies, or optimizing interactions for different use cases. By doing so, it enables transformative augmented reality experiences that redefine the way we interact with digital content in the desktop environment.

M. Compagno

Quest’opera è distribuita con Licenza Creative Commons Attribuzione – Non commerciale – Condividi allo stesso modo 4.0 Internazionale.

Riparare i PC con la realtà aumentata

Giu 12, 2022 | News on Augmented, Mixed and Virtual Reality

Dell Technologies ha presentato una nuova applicazione di realtà aumentata (Dell AR Assistant) che guida gli utenti attraverso le procedure di manutenzione e riparazione di oltre 100 PC e server Dell in sette lingue diverse e con istruzioni passo-passo. Tutto ciò che serve è uno smartphone Android o iOS. L’app non richiede un login e non archivia o trasmette informazioni sul cliente. Lo sviluppo dell’applicazione è avvenuto durante i primi mesi della pandemia, quando i tecnici non potevano recarsi a casa delle persone.

Dell mette a disposizione online i manuali dei prodotti e le relative risorse, e lo fa da oltre un decennio. Sono inclusi i download di software, driver, BIOS, firmware, patch del sistema operativo e di sicurezza. Il Dell AR Assistant è un’estensione naturale dei manuali, in un formato facile da seguire e accessibile al cliente da qualsiasi luogo. Gli utenti dell’AR Assistant possono vedere i loro dispositivi e le modalità di riparazione grazie alla realtà aumentata e alle sovrapposizioni informative sulla macchina da riparare, sfruttando la fotocamera dello smartphone.

Tara Gale, Client Solutions Country Lead, Dell Technologies Ireland, ha dichiarato: “La riparabilità continua a essere una priorità per noi di Dell Technologies. Sappiamo che gli utenti vogliono avere un maggiore controllo sui loro dispositivi, anche per quanto riguarda le riparazioni. Da sempre sostenitrice della riparabilità, Dell ha cambiato le carte in tavola con un’applicazione di realtà aumentata per le riparazioni IT, il Dell AR Assistant, unica nel suo genere. Il nostro obiettivo è quello di consentire ai consumatori di riparare facilmente i dispositivi da soli, laddove ne siano in grado. In definitiva stiamo cercando di ridurre i tempi di riparazione per i problemi che possono essere risolti dagli stessi utenti, con un piccolo aiuto da parte di Dell“.

Apple inventa un sistema per evitare il “burn-in” negli AR glasses ed “Headset”

Gen 19, 2020 | News on Augmented, Mixed and Virtual Reality

Qualche giorno fa l’ufficio brevetti e marchi degli Stati Uniti ha pubblicato una domanda di brevetto di Apple che si riferisce a una funzionalità progettata principalmente per “AR glasses” ed “Headset” che eviterà il cosidetto “burn-in” del display.

(Image credit: Martin Hajek/iDropNews)

Il burn-in è quell’effetto che, a seguito della visualizzazione prolungata nella stessa posizione nello schermo di un’immagine, comporta un deterioramento del fosforo dello schermo ( Il display è perfettamente funzionante al verificarsi di questo problema) con formazione di una cosiddetta “immagine fantasma“, un’immagine sbiadita che, indipendentemente da ciò che si visualizza sul display, rimane in sovrimpressione.

Operazione di visualizzazione basata sull’attività oculare

La domanda di brevetto di Apple riguarda un sistema di monitoraggio oculare progettato per rilevare “saccadi oculari” e battiti di ciglia e quindi apportare le modifiche necessarie alle visualizzazioni degli occhi in tempo reale senza che l’utente sappia che ciò sta accadendo in background.

Le saccadi oculari sono un rapido movimento oculare che porta una regione inizialmente periferica al centro del campo visivo (nella fovea). Gli esseri umani eseguono diversi movimenti oculari saccadici al secondo per utilizzare questa parte della retina ad alta risoluzione per guardare l’oggetto di interesse.

Durante saccadi e battiti di ciglia, la sensibilità visiva dell’utente viene temporaneamente soppressa. I circuiti di controllo dell’headset possono sfruttare la soppressione momentanea della sensibilità visiva dell’utente per apportare modifiche al funzionamento del display come ridurre il consumo di energia, apportare modifiche dell’immagine potenzialmente invadenti, evitare o ridurre gli effetti di burn-in, riducendo così il consumo di energia e migliorare le prestazioni del dispositivo.

Sopra l’immagine mostra un diagramma con un sistema di monitoraggio oculare può raccogliere informazioni sull’occhio di un utente. Il sistema può includere componenti riguardanti il tracciamento dello sguardo, sensori di immagine, fotorilevatori e dispositivi di rilevamento della luce, altre componenti per il monitoraggio dei movimenti oculari.

Come con la maggior parte dei brevetti, osserva che l’invenzione non è limitata ai soli occhiali ma potrebbe anche essere utilizzata in sistemi futuri come display heads-up Mac, tv e altro ancora.

Mirko Compagno
AR/VR/MR Architect & UX/UI Designer
Innovation Manager MISE: Sistemi di visualizzazione AR/VR

This work is licensed under a Creative Commons Attribution 4.0 International License.

Augmented Reality Solution Supports Surgical Trauma Care

Gen 14, 2020 | News on Augmented, Mixed and Virtual Reality

A set of smart surgical glasses with functionality based on augmented reality (AR) and mixed reality (MR) technologies brings a higher level of support to surgical trauma cases.

The Taiwan Main Orthopaedics Biotechnology Co. (Surglasses; Taichung, Taiwan) Foresee-X is a set of smart AR surgical glasses is designed to enhance intra-operative fluoroscopy image synchronization, primarily during orthopedic trauma procedures. Features include image enhancement functions, such as the ability to zoom in and out, allowing surgeons to concentrate on the operational field instead of monitors; reduced radiation exposure for the staff and patient; and improved accuracy by tracking the movements of surgical tools such as puncture needles, trocars, etc.

Image: The Foresee-X augment reality glasses (Photo courtesy of Surglasses)

The virtual and actual images are superimposed, and patient bone structure and tissues are fully visible through the smart glasses. In addition to improving overall surgical efficiency, the Foresee-X glasses can reduce OR staff radiation exposure by more than 60% compared to a mobile C-arm used for fluoroscopy. Foresee-X also allows outside observers to view procedures up close through tablet computers, as the device is equipped with an integrated camera with an 80 degree field of view that records video at 30 fps. The device can also collect data for academic purposes.

“The key to smart glasses is the algorithm. Since each person’s eyes have a different focal length, and with the addition of camera lens focus, synchronization would require the aid of high-performance computing,” said Min-Liang Wang, PhD, founder of Surglasses. “Furthermore, if the surgeon changes position during surgery, the image must be adjusted immediately for the new position. All of this can only be achieved by the development of cutting-edge technologies such as 5G and AR/MR.”

“Surglasses has been collaborating with hospitals in Taiwan and Malaysia to set up a specialized trauma center that includes Foresee-X as part of the equipment lineup. The smart surgical glasses are used for numerous kinds of orthopedic procedures including interlocking of nails, pelvic cases, wrists, shoulders, tibia, and many more,” said the company in a press statement. “With accuracy and efficiency as its main advantages, Foresee-X is the first of its kind on the market to provide cutting-edge assistance to surgeons and doctors dealing with trauma cases.”

AR is a term for a live direct or indirect view of a physical, real-world environment whose elements are augmented by computer-generated sensory input. It is related to a general concept called mediated reality, in which a view of reality is modified–possibly even diminished rather than augmented–by a computer. As a result, the technology can enhance the perception of reality.

source: https://www.hospimedica.com/surgical-techniques/articles/294780520/augmented-reality-solution-supports-surgical-trauma-care.html

CES 2020: Samsung Teases Prototype AR Glasses

Gen 8, 2020 | News on Augmented, Mixed and Virtual Reality

Are augmented reality personal trainers the future of at-home exercise?

Samsung is kicked-off the first day of CES 2020 with a bang this morning, offering attendees an in-depth look at a variety of cutting-edge products straight out of a science fiction novel, including a BB8-style robot assistant, as well as new improvements to their proprietary voice assistant, Bixby.

Among the many products developed as part of its “Age of Experience” product strategy, Samsung also used its time on stage to tease its own dedicated AR headset. The company demonstrated its AR technology on stage in front of a live audience using the companies GEMS (Gait Enhancing & Motivating System) technology, which uses an exoskeleton device to correct a user’s posture and track certain body metrics.

The demonstration involved an AR training session involving a digital personal trainer. According to Samsung, these AR glasses can be used to simulate personal gym sessions, mountain climbing, walking underwater, and a variety of other physically intensive activities from the comfort of home.

Of course, it goes without saying that the products shown are still very much in their developmental stage.

“Samsung will remain a hardware company, forever,” said Hyunsuk Kim, CEO of Samsung’s consumer electronics division. “It’s not about when we release the product, but it’s more crucial how much further we can evolve the technology. No other speaker in the world can control gadgets as much as Samsung can.”

*Samsung’s Ballie / Image Credit: Samsung*

In addition to new AR technology, the company also took the time to shine a light on the long-running Samsung Gear VR with an emotional video showing how the mobile headset is being used to help visually-impaired individuals connect with their families, friends, and loved ones.

With both Apple and Facebook currently in development of their own dedicated AR devices, it’s clear that companies are beginning to see the value in augmented reality headsets as a potential replacement for conventional smartphone technology.

With CES only just getting started, no doubt we’ll be seeing a lot more AR technology over the next couple of days.

Feature Image Credit: Samsung

Sources: https://vrscout.com/news/ces-2020-samsung-prototype-ar-glasses/

« Post precedenti