Posted on March 25, 2017

The Augmented Reality application resented in this post was created to address the IEEE 3DUI 2017 contest challenge and was selected for presentation at the conference in Los Angeles, USA in 2017.

The task was to build an AR application using mobile devices which allows manipulation of object states and parameters present in the scene to build an art piece. The task was particularly challenging as the use of any devices or sensors external to the mobile device were prohibited. For this reason the application has to use the camera present on it for AR tracking. This makes the use of sensors like the gyroscope, accelerometer, etc. difficult as these require reorienting the device potentially leading to the loss of AR tag tracking. Therefore, our solution to the problem uses the back camera of the mobile device for AR marker tracking and displaying the art pieces corresponding to the marker. For interactions, the system uses finger based gestures like swiping, pinching, etc. and the device’s accelerometer. Most touch gestures used for the interaction are already consolidated in everyday mobile applications which made our interactions intuitive, easier to comprehend and get accustomed to. See images and video below for interaction demonstrations.

More details on the application can be found in the publications listed below.

• Bhargava, A., Bertrand, J., Babu, S. V. (2017, March). “AACT – A Mobile Augmented Reality Application for Art Creation”, accepted as contest paper in the Proceedings of the IEEE Symposium on 3D User Interfaces (IEEE 3DUI), Los Angeles, California