Amity University Haryana
Department of Computer Science
& Engineering
Major Project on
“AUGMENTED REALITY”
Under the Guidance of: By:
Mr.Utpal Shrivastava Yash Kaushik(A51405212006)
Asst. Professor
Ms. Juhi Singh
Asst. Professor
Augmented Reality
• Modifying Reality
• Implements Informative Layar
Basic Example
• Invented Head-Mounted Display which was the first
step in making AR a possibility
• Coined the term “Augmented Reality”
• Developed Complex Software at Boeing to help
technicians assemble cables into aircraft
Prof. Tom Caudell
• In 1999, Hirokazu Kato of the Nara Institute of
Science and Technology released the ARToolKit to the
open source community.
• Although the smartphone was yet to be invented, it was
what allowed a simple, handheld device with a camera and
an internet connection to bring AR to the masses.
Hirokazu Kato
 Free kick radius /
Offside.
 Advertising spots
 Weather Forecast
 Stock
Already common in TV shows
Types of Augmented Reality
Marker Based Augmented
Reality
Markerless Augmented Reality
 Location Based
Marker based Augmented Reality
• Left image shows the augmented version
• Right image is the marker on which
augmentation is done.
Markerless Augmented Reality
Basic example: Google Glass, Live Feeds etc.
• GPS + Compass + Gyro + Accelerometer
• Location-based applications use the
ability of a particular device to record
its position in the world and then offer
data that’s relevant to that location:
finding your way around a city,
remembering where you parked the
car, naming the mountains around you
or the stars in the sky.
Why?
Need to create an AR app:
• To help people understand the structure
in an easier way.
• For Advancing the Technology used on a
daily basis to next level.
• Introduce the concept AR in Digital Age.
• Increases Brand Image.
AmiMap
A Marker Based Augmented Reality App which
help you to assess current location when triggered
with AR markers and show the map of your
surroundings. And one can also interact with it to
find the place they may be looking for. And other
applications covering some aspects of augmented
reality.
Purpose of the App
• The purpose of the application is to
introduce the concept of augmented
reality in our life on daily basis.
Some Snaps of AmiMap
• C Block Ground Floor on a marker.
C Block 3rd Floor
How?
• Softwares Used
• Portals Used
• Process
• Deployment
Software Used
• Blender  Used to make 3D models.
• Unity  Implementation of Augmented
Reality in an Android APP.
• Android SDK  Used by unity to generate
the android application.
• Eclipse  for apk signing and adding user
friendly interface.
Recognition
Tracking
Content
rendering
AUGMENTED REALITY SDK
What to track
Where it is (3D pose)
Your Interesting Stuff
Development Portal Used
• Just like android.developer.com we have
used Vuforia Portal for the app
development.
• One more portal recommended by
Vuforia named brosvision came handy to
generate AR Markers.
Workflow of AR Apps Via Vuforia
Vuforia WorkFlow Objects
Process
• Open Vuforia Developer Portal
• Select Target Manager upload the images
that you want to be used as markers
• Download the database for unity
(.unitypackage)
• In the main page of the portal download
the VuforiaSDk for unity as it contains the
ARCamera.
Continued
• Import the packages in unity.
• Delete the main camera from hierarchy
use ArCamera instead.
• Import the makers on the scene
• Import the 3d model that is to be
displayed
• Put the 3d model on the marker
• In ArCamera load the dataset and
activate
• Add some Directional Light into the scene
• Press Play Button in Unity if you have
webcam and let the augmentation begin.
• Place the marker in front of the Webcam and
a 3d model will be displayed on top of it.
• Switch Platform in build setting and import
the Android App.
Problems
Performance,
Image Recognition
• Symmetry/similar elements
• Contrast/illumination
Real world sizing,
Fixed Camera vs Fixed Space,
Physics
Tips and Advices
• No more than 3objects/marker
• Attach marker to cardboard
• Good lighting but avoid Reflections
• Disable objects that are not in the View
• Scale correctly from the beginning
Extra Work Done
Kinect
• Kinect is an input device by Microsoft which features an "RGB
camera, depth sensor and multi-array microphone running
proprietary software", which provide full-body 3D motion
capture and facial recognition. The Kinect is currently the
hardware that provides developers with the greatest
opportunities for innovative programs both games and serious
artificial applications. A depth camera, which sees in 3-D,
creates a skeleton image of a player and a motion sensor
detects their movements. Speech recognition software allows
the system to understand spoken commands and gesture
recognition enables the tracking of player movements.
• Kinect’s camera is powered by both hardware
and software. And it does two things: generate
a three-dimensional (moving) image of the
objects in its field of view, and recognize
(moving) human beings among those objects.
• We have Used Three Softwares to acquire a
better understanding of its work. And how its
can be used in augmented reality projects.
Software Used
• Skanect = To generate 3D models.
• OpenNi Virtual WebCam = A virtual WebCam
software to show IR(infrared), Depth Sensor.
• FaceTrackNoIr= An Open Source software used
to track Face Movement.
Skanect Snaps
OpenNi Virtaul WebCam Snaps
FaceTrackNoIr Snaps
3D model generated via skanect
Future Scope
• Ar and Vr is about to become one.
• AR + VR = Mixed Reality
• HoloLens is about to change the way we perceive
things.
• After there are even rumours of Ar Contact Lens
and even a lot of studies is going on this topic in
University of Washington.
References
[1] http://www.3pillarglobal.com/insights/how-to-
create-an-augmented-reality-app
[2] http://habiletechnologies.com/kickstarting-
augmented-reality-hello-world-vuforia-tutorial/
[3] http://developer.vuforia.com
[4] http://brosvision.com/ar-marker-generator
[5] http://forums.unity3.com/
[6]
http://www.slideshare.net/aquarioverde/introductio
n-to-ar-with-unity3d
THANK YOU

Augmented Reality Application - Final Year Project

  • 1.
    Amity University Haryana Departmentof Computer Science & Engineering Major Project on “AUGMENTED REALITY” Under the Guidance of: By: Mr.Utpal Shrivastava Yash Kaushik(A51405212006) Asst. Professor Ms. Juhi Singh Asst. Professor
  • 2.
    Augmented Reality • ModifyingReality • Implements Informative Layar
  • 4.
  • 5.
    • Invented Head-MountedDisplay which was the first step in making AR a possibility • Coined the term “Augmented Reality” • Developed Complex Software at Boeing to help technicians assemble cables into aircraft Prof. Tom Caudell
  • 6.
    • In 1999,Hirokazu Kato of the Nara Institute of Science and Technology released the ARToolKit to the open source community. • Although the smartphone was yet to be invented, it was what allowed a simple, handheld device with a camera and an internet connection to bring AR to the masses. Hirokazu Kato
  • 7.
     Free kickradius / Offside.  Advertising spots  Weather Forecast  Stock Already common in TV shows
  • 8.
    Types of AugmentedReality Marker Based Augmented Reality Markerless Augmented Reality  Location Based
  • 9.
    Marker based AugmentedReality • Left image shows the augmented version • Right image is the marker on which augmentation is done.
  • 10.
    Markerless Augmented Reality Basicexample: Google Glass, Live Feeds etc.
  • 11.
    • GPS +Compass + Gyro + Accelerometer • Location-based applications use the ability of a particular device to record its position in the world and then offer data that’s relevant to that location: finding your way around a city, remembering where you parked the car, naming the mountains around you or the stars in the sky.
  • 12.
    Why? Need to createan AR app: • To help people understand the structure in an easier way. • For Advancing the Technology used on a daily basis to next level. • Introduce the concept AR in Digital Age. • Increases Brand Image.
  • 13.
    AmiMap A Marker BasedAugmented Reality App which help you to assess current location when triggered with AR markers and show the map of your surroundings. And one can also interact with it to find the place they may be looking for. And other applications covering some aspects of augmented reality.
  • 14.
    Purpose of theApp • The purpose of the application is to introduce the concept of augmented reality in our life on daily basis.
  • 15.
    Some Snaps ofAmiMap • C Block Ground Floor on a marker.
  • 16.
  • 17.
    How? • Softwares Used •Portals Used • Process • Deployment
  • 18.
    Software Used • Blender Used to make 3D models. • Unity  Implementation of Augmented Reality in an Android APP. • Android SDK  Used by unity to generate the android application. • Eclipse  for apk signing and adding user friendly interface.
  • 19.
    Recognition Tracking Content rendering AUGMENTED REALITY SDK Whatto track Where it is (3D pose) Your Interesting Stuff
  • 21.
    Development Portal Used •Just like android.developer.com we have used Vuforia Portal for the app development. • One more portal recommended by Vuforia named brosvision came handy to generate AR Markers.
  • 23.
    Workflow of ARApps Via Vuforia
  • 24.
  • 25.
    Process • Open VuforiaDeveloper Portal • Select Target Manager upload the images that you want to be used as markers • Download the database for unity (.unitypackage) • In the main page of the portal download the VuforiaSDk for unity as it contains the ARCamera.
  • 26.
    Continued • Import thepackages in unity. • Delete the main camera from hierarchy use ArCamera instead. • Import the makers on the scene • Import the 3d model that is to be displayed • Put the 3d model on the marker • In ArCamera load the dataset and activate
  • 27.
    • Add someDirectional Light into the scene • Press Play Button in Unity if you have webcam and let the augmentation begin. • Place the marker in front of the Webcam and a 3d model will be displayed on top of it. • Switch Platform in build setting and import the Android App.
  • 28.
    Problems Performance, Image Recognition • Symmetry/similarelements • Contrast/illumination Real world sizing, Fixed Camera vs Fixed Space, Physics
  • 29.
    Tips and Advices •No more than 3objects/marker • Attach marker to cardboard • Good lighting but avoid Reflections • Disable objects that are not in the View • Scale correctly from the beginning
  • 30.
    Extra Work Done Kinect •Kinect is an input device by Microsoft which features an "RGB camera, depth sensor and multi-array microphone running proprietary software", which provide full-body 3D motion capture and facial recognition. The Kinect is currently the hardware that provides developers with the greatest opportunities for innovative programs both games and serious artificial applications. A depth camera, which sees in 3-D, creates a skeleton image of a player and a motion sensor detects their movements. Speech recognition software allows the system to understand spoken commands and gesture recognition enables the tracking of player movements.
  • 31.
    • Kinect’s camerais powered by both hardware and software. And it does two things: generate a three-dimensional (moving) image of the objects in its field of view, and recognize (moving) human beings among those objects. • We have Used Three Softwares to acquire a better understanding of its work. And how its can be used in augmented reality projects.
  • 32.
    Software Used • Skanect= To generate 3D models. • OpenNi Virtual WebCam = A virtual WebCam software to show IR(infrared), Depth Sensor. • FaceTrackNoIr= An Open Source software used to track Face Movement.
  • 33.
  • 34.
  • 35.
  • 36.
    3D model generatedvia skanect
  • 37.
    Future Scope • Arand Vr is about to become one. • AR + VR = Mixed Reality • HoloLens is about to change the way we perceive things. • After there are even rumours of Ar Contact Lens and even a lot of studies is going on this topic in University of Washington.
  • 38.
    References [1] http://www.3pillarglobal.com/insights/how-to- create-an-augmented-reality-app [2] http://habiletechnologies.com/kickstarting- augmented-reality-hello-world-vuforia-tutorial/ [3]http://developer.vuforia.com [4] http://brosvision.com/ar-marker-generator [5] http://forums.unity3.com/ [6] http://www.slideshare.net/aquarioverde/introductio n-to-ar-with-unity3d
  • 39.