Elevator Pitch:
"What if you could play rhythm games like Beat Saber or Guitar Hero - but with just your hands, in your own living space?"
This prototype demonstrates the potential of controller-free interaction in XR, using hand tracking as a next-gen game mechanic. By combining:
- 🎶 Music rhythm gameplay
- ✋ Hand pose matching
- 🏠 Room-scale presence
We create an immersive experience that challenges players' agility and fine motor skills in their actual physical environment.
Why It's Great for XR?
- Showcases the future of natural interaction beyond controllers
- Leverages passthrough AR for safer play in personal spaces
- Opens new possibilities for accessibility in rhythm games
These are the essential elements to prove our concept:
| Feature | Description | Key Benefit |
|---|---|---|
| ✋ Hand Tracking | Accurate finger/hand detection | Natural controller-free input |
| 👐 Hand Pose Detection | Recognizes specific gestures (e.g., "rock" vs "open palm") | Enables gameplay mechanics |
| 👀 Passthrough | Mixed reality view of real environment | Safe spatial awareness |
| 🏠 Room Presence | Adapts to player's physical space | Personalized gameplay arena |
| 🎵 Audio Manager w/ Beat Spawner | Synchronized beat mapping system | Core rhythm gameplay |