Understanding Augmented Reality and How to
Build AR Experience Using AR Core
Lately, I have been curious about Augmented reality. AR technology definability is one of the most powerful tools that can solve complex problems or create an enjoyable, immersive experience with the potential to make a significant impact on education, health care, industrial design, e-commerce etc.
Being user experience and interaction designers, it is important to consider the human factors while designing products. AR is a relatively new subject and there is little to no content available online for the same. So, I decided to take up some courses online, to learn the fundamentals of augmented reality and to learn to build an AR experience using ARCore. I just finished an introduction course to Augmented reality and ARcore on coursera , which I have summed up in this blog.
AR is basically the simulation of real world objects or information by computer generated inputs, thus changing the perception of reality .
Our mobile phones are one the most compatible hardware for AR as it already has a gyroscope, GPS, accelerometer and camera. Also, in this technology-driven world, everyone has access to smartphones making it easier for people to start using AR quickly and easily. However, AR needs a phone with decent processors and some phones may not be compatible with the AR apps.
As designers, our focus is usually on finding the users needs, product application, the context and defining the use cases. AR could be widely used in e-commerce, advertising, architecture and industrial design for product visualization, social media, gaming, and education, in non-profit organisations, health care and the list goes on. With regards to AR, the sky’s the limit.
Furthermore, recent research indicates that the Augmented Reality Market is set to exceed USD 50 billion by 2024.
Not all mobile devices support AR. Some popular devices that can handle AR apps are, Google Pixel and the Iphone X series. However, most of the recently released mobile phones tend to support AR apps.
As UX designers, it very important to be thoughtful and create meaningful experience and solve problems or just create enriching and entertaining experience using immersive technology.
This could be achieved by making the app realistic and ensuring uninterrupted AR experience throughout, while at the same time being aware of the technical limitations of AR technology.
Google has provided a UX consideration guide for designing AR apps, which can be found here. For starters, designers should ensure the screen is not cluttered to allow for easy user interface and eliminate unnecessary buttons.
These might sound obvious but it’s important to be creative and give the users what they need, when there a need it. They should hide unwanted functions and provide information in an effective way all without spoiling the experience.Designers can leverage their knowledge of creating user flows and create a strategy for the product. This can involve action, audio, input action and should be able to narrate the flow of the experience, which makes it easier for prototyping before it heads into the development process
Here are some of the possible interactions offered by the AR core.
1.Drag and drop
2.Voice( can be done using google SDK- so cool right?)
3. Tap, Pinch and zoom.
It’s important for interaction designers to be aware of this, a badly designed interaction can break the immersive experience
Well, this was just an attempt to summarise what I learned from my research. I hope this has given a general idea about AR tech and UX design consideration.
In the next article, I will write about some quick resources available to get started with AR core.
I will also be writing about some prototyping tools that are available in the market. If you have any recommendations, do comment below as I’m sure everyone is quite curious to explore them.
Thank you for reading