Mon, Jan 13, 2025
Redefine Multitouch Interactivity with Object Recognition
Some interactive features have the power to inspire awe. Imagine an interactive table or screen where you can move physical objects to unlock digital content, trigger animations, or explore interactive stories. This fusion of physical objects and digital content brings experiences to life in extraordinary and engaging ways.
At PandaSuite, tangible object recognition has always been part of our vision for our no-code platform. We’ve been particularly inspired by the projects of Étienne Mineur and Éditions Volumiques, which blended physical objects (dice, tokens, cards) with digital applications long before it became trendy.
Today, with the integration of the TUIO protocol, PandaSuite empowers you to turn these ideas into reality. Compatible with any interactive screen, including interactive tables, this feature is revolutionizing how you can design your projects.
Physical objects + digital content + no-code = a new era of interactivity.
What is the TUIO protocol?
TUIO (Tangible User Interface Object) is an open and widely used protocol for transmitting information between physical objects and an interactive interface. It sends real-time data such as:
- Position: Where the object is placed on the screen.
- Orientation: How it is rotated.
- Movements: Whether it is being moved or manipulated.
This is the first protocol we’ve chosen to use, but others exist, and we may integrate them in the future as well.
Displax, a leader in multitouch and interactive solutions, offers devices that are natively compatible with the TUIO protocol, significantly simplifying the integration of this technology. By combining PandaSuite with Displax hardware, you get a robust, high-performance, and ready-to-use solution, perfect for large touchscreen displays or interactive tables.
Potential applications
The combination of physical objects and digital content unlocks endless possibilities. Here are some concrete examples:
Museums and exhibitions
Offer visitors a unique interactive experience. Imagine a museum where tangible objects, like replicas of artifacts or 3D models, unlock additional information or activate immersive animations.
Examples:
- Move a dinosaur figurine on a map to display its habitat and videos of its ecosystem.
- Place a replica of a historical artifact on a table to access an interactive timeline.
Trade shows and events
Create interactive booths where tokens or cards activate product presentations, explanatory videos, or real-time demonstrations.
Examples:
- A product-shaped token triggers an animation detailing its technical specifications.
- A card placed on a screen displays specific statistics or data.
Educational experiences
Teach in a fun and interactive way. Children or students can use tangible pieces to explore complex concepts.
Examples:
- Place puzzle pieces on a screen to learn about the human body.
- Match physical geometric shapes to projected mathematical concepts.
Games
Transform board games into interactive experiences using object detection.
Examples:
- A smart die interacts with on-screen elements when rolled.
- Game cards trigger animations when placed on the screen.
Benefits of object recognition in PandaSuite
- No-code: With PandaSuite, no programming skills are required. Simply configure interactions using PandaSuite’s visual editor.
- Flexibility: Compatible with a wide range of interactive devices, including multitouch tables.
- Creativity: Develop custom experiences tailored to your industry or specific needs.
Getting started with object recognition in PandaSuite
- Prepare your tangible objects:
Equip yourself with devices or surfaces compatible with the TUIO protocol.
- Set up TUIO:
Activate the protocol in PandaSuite using the App-to-App component and connect your interactive screen or multitouch table.
- Design your interactions:
Link each tangible object to specific actions, such as synchronizing with another component, displaying multimedia content, switching screens, or launching animations.
- Test and iterate:
Preview your experiences in PandaSuite Studio to ensure they work as intended
It’s your turn
At PandaSuite, we believe that object detection will revolutionize how interactive experiences are created. Museums, schools, events, games… the applications are vast, and the results are stunning.
Who knows? The next great TUIO-powered experience might just be yours.
So, what are you waiting for? 😊
Start today your project for free on pandasuite.com