Augmented Reality On iOS With ARKit Xamarin and C#
Download as PPTX, PDF•0 likes•508 views
The document discusses augmented reality development for iOS using ARKit, Xamarin, C#, and .NET. It provides an overview of ARKit capabilities such as image recognition, object recognition, plane detection, and facial tracking. The presentation encourages .NET developers to use these tools to build augmented reality experiences for iOS, noting the growing opportunities in both consumer and business AR applications.
Augmented Reality On iOS With ARKit Xamarin and C#
- 1. ©2021 Avanade Inc. All Rights Reserved. <Highly Confidential> 1 Augmented Reality for iOS with ARKit, Xamarin, C# & .NET (30 minute brown bag session) Lee Englestone
- 2. ©2021 Avanade Inc. All Rights Reserved. 2 Lee Englestone Manager, Full Stack Development Microsoft MVP @LeeEnglestone About Me https://XamarinArkit.com/
- 3. ©2021 Avanade Inc. All Rights Reserved. <Highly Confidential> 3 Introduction
- 4. ©2021 Avanade Inc. All Rights Reserved. <Restricted> 4 Real World Uses of AR
- 5. ©2021 Avanade Inc. All Rights Reserved. <Restricted> 5 Pokemon Go = $4 Billion Revenue in 4 Years
- 6. ©2021 Avanade Inc. All Rights Reserved. <Restricted> 6 ©2021 Avanade Inc. All Rights Reserved. <Restricted> 6
- 7. ©2021 Avanade Inc. All Rights Reserved. <Confidential> 7 • ARKit is Apples AR Framework • Xamarin ported ARKit to .NET • Use C# to create AR for iOS • Can be used with other ported Frameworks What is ARKit?
- 8. ©2021 Avanade Inc. All Rights Reserved. <Restricted> 8 ©2021 Avanade Inc. All Rights Reserved. <Restricted> 8 • Augmented Reality gaining popularity • Xamarin = Cross Platform & Visual Studio • C# = Popular programming language • iOS = Sooo popular • ARKit = Many built in capabilities Why ARKit, Xamarin & C# on iOS
- 9. ©2021 Avanade Inc. All Rights Reserved. <Highly Confidential> 9 ARKit Capabilities
- 10. ©2021 Avanade Inc. All Rights Reserved. <Highly Confidential> 10
- 11. ©2021 Avanade Inc. All Rights Reserved. <Highly Confidential> 11 What can ARKit do? Image recognition Object recognition Plane detection Touch gestures Face tracking Facial expression detection Body tracking Lighting Physics Sound Video Animations
- 12. ©2021 Avanade Inc. All Rights Reserved. <Restricted> 12 ©2021 Avanade Inc. All Rights Reserved. <Restricted> 12 • Can recognise up to 100 different images • Can identify position of recognised image • Useful for markers Image Recognition
- 13. ©2021 Avanade Inc. All Rights Reserved. <Restricted> 13 ©2021 Avanade Inc. All Rights Reserved. <Restricted> 13 • Can ‘scan’ a 3D object • Can recognise scanned 3D object Object Recognition
- 14. ©2021 Avanade Inc. All Rights Reserved. <Restricted> 14 ©2021 Avanade Inc. All Rights Reserved. <Restricted> 14 • Can detect horizontal and vertical surfaces • Understanding of surfaces increases with more info • Uses • Product placement • Interior design • Various Plane Detection
- 15. ©2021 Avanade Inc. All Rights Reserved. <Restricted> 15 ©2021 Avanade Inc. All Rights Reserved. <Restricted> 15 • Screen gestures can be translated to AR • Swipe, Pan, Pinch, Rotate, Tap, Double Tap Touch Gestures
- 16. ©2021 Avanade Inc. All Rights Reserved. <Restricted> 16 ©2021 Avanade Inc. All Rights Reserved. <Restricted> 16 • Can track up to 3 faces in a scene • Not facial recognition! • Uses • Cosmetics • Wearables (glasses etc) Face Tracking
- 17. ©2021 Avanade Inc. All Rights Reserved. <Restricted> 17 ©2021 Avanade Inc. All Rights Reserved. <Restricted> 17 • Can detect over 50 facial movements • EyeBlinkLeft • BrowOuterUpperLeft • MouthClose • Etc • Floating point from 0 to 1 Facial Expression Detection
- 18. ©2021 Avanade Inc. All Rights Reserved. <Restricted> 18 ©2021 Avanade Inc. All Rights Reserved. <Restricted> 18 • In realtime • Tracks major joints • Infers other joints • Uses • Fashion/Wearables • Healthcare • Exercise Body Tracking
- 19. ©2021 Avanade Inc. All Rights Reserved. <Restricted> 19 ©2021 Avanade Inc. All Rights Reserved. <Restricted> 19 • Lighting is important for realism • Can cast artificial shadows Lighting (From SceneKit)
- 20. ©2021 Avanade Inc. All Rights Reserved. <Restricted> 20 ©2021 Avanade Inc. All Rights Reserved. <Restricted> 20 • Gravity • Solid bodies/collisions • Apply force, Friction, Mass Physics (From SceneKit)
- 21. ©2021 Avanade Inc. All Rights Reserved. <Restricted> 21 ©2021 Avanade Inc. All Rights Reserved. <Restricted> 21 • Can play video and sound • Onto very large 2D planes if desired • Can add opacity Video & Sound
- 22. ©2021 Avanade Inc. All Rights Reserved. <Restricted> 22 ©2021 Avanade Inc. All Rights Reserved. <Restricted> 22 • Opacity • Location • Scale • Can be repeated • Can eased • Can be sequenced • Can be grouped Animations (Actions)
- 23. ©2021 Avanade Inc. All Rights Reserved. <Restricted> 23 Some Code
- 24. ©2021 Avanade Inc. All Rights Reserved. <Restricted> 24 More Code
- 25. ©2021 Avanade Inc. All Rights Reserved. <Restricted> 25 ©2021 Avanade Inc. All Rights Reserved. <Restricted> 25 Other experiments
- 26. ©2021 Avanade Inc. All Rights Reserved. <Restricted> 26 Summary
- 27. ©2021 Avanade Inc. All Rights Reserved. <Restricted> 27 ©2021 Avanade Inc. All Rights Reserved. <Restricted> 27 • AR is growing • Especially consumer AR • Increasing business opportunities • .NET Developers can develop AR experiences for iOS today ARKit with Xamarin, C# and .NET Summary
- 28. ©2021 Avanade Inc. All Rights Reserved. <Confidential> 28 • XamarinArkit.com • Longer video / more detail https://youtu.be/qQc106lklpE?t=184 Further Information
- 29. ©2021 Avanade Inc. All Rights Reserved. <Restricted> 29 Thank You
- 30. ©2021 Avanade Inc. All Rights Reserved. <Restricted> 30 Q&A
- 31. 31 ©2021 Avanade Inc. All Rights Reserved