My first augmented reality app

Year 2022 was not just awesome in terms of travel, This year I started working on a new domain. This new domain was Metaverse.

I started exploring various technologies for this domain along with few other friends.

We explored a lot of technologies during our initial investigation. We had even explored GPT3 before this whole hype of chatGPT got created.

We explored Microsoft mesh platform for its capabilities. Microsoft Mesh is an amazing platform to create virtual space. People can holoport themselves into virtual meetings. It has vast amount of usage. But sadly we came to know that it’s SDK is not available for public use. So we could not develop any of our applications on that platform.

We explored Microsoft cognitive services for facial recognition. Then we stuck to Azure face api for facial recognition. Azure face api is an amazing service for facial recognition feature. One just need to create a face api resource, insert face data through rest apis (create person group, create persongroup person, add face in persongroup person), train data and in no time facial recognition application will be ready to recognise people.

To create iOS and Microsoft HoloLens 2 application in AR space we explored Unity engine, Microsoft mixed reality toolkit. Through MRTK we created very cool menus of our application in 3D space. ARKit library can be used to create AR applications for iOS device. Universal Windows platform library can be used for HoloLens 2 application creation.

We explored Xcode to build, debug and run iOS application in iPhone.

Finally using Unity, Xcode, ARKit, AR Foundation, MRTK, Azure face api, C#, Microsoft Visual studio we created our first AR application for iOS and HoloLens 2 device. Our application recognises people and display their information in 3D space.

Now we are developing our second application in webAR.