Develop Store Apps with Kinect for Windows v2

Editor's Notes

• #2: 1
• #7: The big success of Kinect is linked to the “magic” perceived by the user. Kinect allows to create an immersive user experience where the user is swept into an other world and transformed in an avatar or in a magical elf
• #10: Wider/expanded field of view The expanded field of view enables a larger area of a scene to be captured by the camera. As a result, users can be closer to the camera and still in view, and the camera is effective over a larger total area. In a retail scenario, for example, the sensor could be placed on a wall and track more people within a larger area for more versatile and effective interactions.
• #13: Called “Streams” in V1
• #14: 1080p color camera30 Hz (15 Hz in low light) The color camera captures full, beautiful 1080p video that can be displayed in the same resolution as the viewing screen, allowing for a broad range of powerful scenarios. In addition to improving video communications and video analytics applications, this provides a stable input on which to build high quality, interactive applications. Build high-quality, augmented reality scenarios that could be used with digital signage for retail, museums, lobbies, and public spaces.
• #15: Not heat – different frequency People have used this for: night vision, computer vision applications that need consistent illumination like face recognition, retro reflective materials also show up very well New active infrared (IR) capabilities512 x 42430 Hz In addition to allowing the sensor to see in the dark, the new infrared (IR) capabilities produce a lighting-independent view—and you can now use IR and color at the same time. The new IR capabilities enable new machine learning applications, such as face recognition in varying light conditions.
• #16: Depth sensing512 x 42430 HzFOV: 70 x 60One mode: .5–4.5 meters With higher depth fidelity and a significantly improved noise floor, the sensor gives you improved 3D visualization, improved ability to see smaller objects and all objects more clearly, and improves the stability of body tracking. Fitness, wellness, and entertainment scenarios can take advantage of the improved 3D visualization.
• #17: Could detect a body moved by comparing one frame to the next Can be used directly for some background removalFull Skeleton Tracked:- v1 2- v2 6
• #20: Latency v1 ~90 ms with processingLatency v2 ~60 ms with processing
• #21: Unity Pro Support:For more than just gaming, Unity Pro offers cross-platform rapid prototyping. Build and publish apps by using tools that you already know across multiple platforms. From Unity 5.x version you don’t require Pro edition.
• #23: One instance of the service per session All the same – not lower-higher level Talk to USB3, Windows 8, GPU requirement
• #25: Everything is currently “WindowsPreview.Kinect” That, of course, will change before final RTM.
• #26: Simultaneous multi-app support Improved multi-app support enables multiple applications to access a single sensor simultaneously. For example, by allowing a retail app and a business intelligence app to access the same sensor, you can get business intelligence in real time in your retail space.
• #31: Replaces AllFramesReady event in V1
• #32: Windows Store support You can now create Windows Store apps by using tools you already know, and offer them to a broad consumer audience. You can list and sell your Kinect v2 applications in the Windows Store.
• #33: Skeleton Hoints Defined: -v1 20 joints -v2 25 jointsImproved body, hand and joint orientation With the ability to track as many as six people and 25 skeletal joints per person—including new joints for hand tips, thumbs, and shoulder center—and improved understanding of the soft connective tissue and body positioning, you get more anatomically correct positions for crisp interactions, more accurate avateering, and avatars that are more lifelike. New and better scenarios in fitness, wellness, education and training, entertainment, gaming, movies, and communications
• #34: Improved body tracking The enhanced fidelity of the depth camera, combined with improvements in the software, have led to a number of body tracking developments. The latest sensor tracks as many as six complete skeletons (compared to two with the original sensor), and 25 joints per person (compared to 20 with the original sensor). The tracked positions are more anatomically correct and stable and the range of tracking is broader. In interactive scenarios, your avatars will be more stable—with more accurate body position evaluation and crisper interactions—and you have the potential for bystanders to participate.
• #35: The first generation sensor never really understood hips before. In the new generation we’ve lowered the hips to be anatomically correct Seated positions are far superior with the new generation (no more seated mode so no more toggling…you always get all 25 joints now) “Strong Leans” (more then 30 degrees of lean…all the way to 90 degrees) This gives us more reliable tracking and enables things like ST tracking for push-ups Spine Mid joint –> used to be called “spine” and was lower Spine Base joint was higher Clavicle is new…called “Spine Shoulder” Xbox 360 had 20 joints and joint orientations
• #37: CameraSpacePoint was named SkeletonPoint in the V1 API. But it applies more generally, not only to Body joint positions, but to any point that is within the depth camera’s field of view. Hence, the new name.
• #39: Powerful tooling Kinect Studio provides enhanced recording and playback, and Visual Gesture Builder lets developers build their own custom gestures that the system recognizes and uses to write code by using machine learning, increasing productivity and cost efficiency. Develop on the go without the need to bring the Kinect sensor with you. Create custom gestures that decrease the time to prototype and test solutions.
• #43: Applications can combine triggers and progress at runtime Use trigger to determine context, e.g. punching, walking, etc. Use progress to drive animation once we know the context
• #51: KinectRegion kinectRegion = new KinectRegion(); Grid grid = new Grid(); KinectUserViewer userViewer = new KinectUserViewer() { Height = 100, Width = 121, HorizontalAlignment = HorizontalAlignment.Center, VerticalAlignment = VerticalAlignment.Top, }; grid.Children.Add(kinectRegion); grid.Children.Add(userViewer); kinectRegion.Content = rootFrame; // Place the frame in the current Window Window.Current.Content = grid;
• #61: Ultima slide, obbligatoria