Download as PDF, PPTX
Uploaded byGraziano Terenzi
ARmedia SDK: new Features and Capabilities
Inglobe Technologies' Armedia SDK offers scalable 3D tracking and object recognition for mobile applications in mixed reality and virtual reality contexts. It features a modular, flexible architecture that supports various tracking methods and rendering capabilities, allowing developers to create sophisticated mixed-reality experiences. The SDK is compatible with popular platforms and includes tools for recognizing and tracking objects, planar images, and geolocation data, making it suitable for diverse applications such as gaming, architecture, and marketing.
More Related Content
Similar to ARmedia SDK: new Features and Capabilities
ARmedia SDK: new Features and Capabilities
- 1.
- 2.
- 3. Not Just AnotherAR SDK • 3D tracking of mobile device is a challenge in many application areas: Mixed reality, Location-aware services, Navigation, Robotics, User Interfaces • No SDK Vendor is offering scalable 3D Object Recognition and Tracking methods • The need of integrating different tracking methods in one solution is evident • Expansion of Virtual Reality requires bridging the gap between AR and VR
- 4. What is Required •Flexibility: provide a variety of methods that can be employed to deal with challenging application scenarios • Modularity: availability of tracking module that developers can use in any combination depending on their needs • Mixed Reality SDK: provide tools that enable a smooth transition between AR and VR visualization on mobiles and wearables • Advanced CV Methods: to be able to identify and track real objects from any angle is the key, accurate estimation of 3D position and 3D orientation
- 5.
- 6. Overview of theSDK • Develop Mobile Applications to recognize and track • Build powerful Mixed Reality applications, all in one tool • Bind your project to any available IoT SDK/API, use Beacons, NFC or any other Sensor or communication device Object Planar Images Locations Device Movements
- 7. Features Library iOS Android Tracking Rendering Plugins (Unity3D) Tools Examples Developer Portal
- 8. Architecture Application Layer Tracking Module OpenCVIMU Rendering Module Open Scene Graph Unity3D SDK Plugin
- 9.
- 10. Overview of theTracking Module • Different tracking methods independent one of each other • Tracking methods can be combined – sequentially – in parallel • The Tracking API can be used in association with any other SDK through suitable matrix conversion • The tracking module is independent of the Rendering Engine
- 11. Tracking Module Tracking iOSAndroid Object Planar Location Device Motion
- 12. Object Tracking • Recognizeand Track real world 3D objects and view them from any angle • Provides accurate 3D position and 3D orientation with respect to a given 3D object
- 13. Planar Tracking • Recognizeand Track multiple planar images in the same application • Provides accurate 3D position and 3D orientation with respect to a set of planar images • Several images
- 14. Location Tracking • Createapplications that employ geo-location data from mobile devices • Provides contextual access to location information • Dedicated and simple API
- 15. Motion Tracking • Usethe Gyroscope and Sensors of the mobile device to interact with 3D contents • No camera background is available with this method • Useful for a range of MR applications
- 16.
- 17. Overview of theRendering Module • A visualization layer that can be quickly used in your App • The rendering components are associated with the tracking methods • They also provide a number of nice VR visualization features • Types of contents: Video 3D files Images
- 18. Rendering Module Rendering iOSAndroid Object Planar Location VR Motion 3D Viewer VR Panorama
- 19. Rendering: Object • Associatedigital contents with a specific object that is tracked by the Object Tracker + Video 3D files Images
- 20. Rendering: Planar • Associatedigital contents with any specific image that is tracked by the Planar Tracker Video 3D files Images +
- 21. Rendering: Location • Associatedigital contents to any location defined in the Geo-location Tracker Video 3D files Images +
- 22. Rendering: VR Motion •Create interactive VR viewers using the gyroscope and magnetometer Video 3D files Images +
- 23. Rendering: 3D Viewer •A 3D viewer without background video. Contents can be manipulated with user’s gestures Video 3D files Images +
- 24. Rendering: VR Panorama •Create interactive 360° Panoramas using equirectangular images and mobile sensors Video 3D files Images +
- 25.
- 26. Unity3D Plugin • Allthe tracking features of the SDK can be used in Unity3D applications. • The Unity3D Plugin allows to manage Prefabs in the implementation of iOS/Android applications.
- 27.
- 28. ARmedia SDK Toolset •The App is a set of tools to create and test 3D maps (targets) suitable for the ARMedia SDK and related products/plugins • Available for iOS and Android
- 29. Developer Portal: TargetManager The Target Manager is a web application that helps generate 3D targets to be used with the SDK
- 30.
- 31. Using a Combinationof SDK Tracking Methods Estimate Approximate Position •Use GPS or other location techniques to get approximate position Improve estimation •Use Camera View and image database to improve estimation Load 3D Targets •Load nearby point 3D Target for the tracker Matching •Find corresponding points between the camera view and the 3D Target Tracking •Track the features and update pose estimation accordingly
- 32. 3D Targets Canbe Generated Through Different Methods • Reconstruct automatically using photos of the objects – The reconstruction is done by taking a number of pictures usually 16, 24 or more depending on the actual object/scenario • Reconstruct using depth camera images (e.g. Kinect) • Use LIDAR to scan the environment
- 33. Tracker Properties Property Notes Veryaccurate • Pixel level precision Fast • Running at more than 60 fps on iPhone Wide operating range • Works close and far from target Robust • Fast recovery from error situations • Tolerating shaking and fast movements of camera • Tolerating different and changing lighting conditions
- 34.
- 35. Some Possible Applications •Mixed Reality Mobile Games • Architecture, Engineering & Construction • Service & Maintenance • Marketing & Publishing • Smart Environments • Cultural Heritage
- 36.
- 37. Supported Platforms iOS version Androidversion Windows version AVAILABLE AVAILABLE NOT PUBLIC
- 38. Planned Release Samsung GearVR Zeiss VR Epson Moverio NOT PUBLIC NOT PUBLIC NOT PUBLIC