Tangible Touchscreen Object Recognition / Detection for All Interactive Displays, Tables & Videowalls: Capacitive (PCAP), IR Frame, Optical (Camera).
Request free consultation Media DownloadsThe recognition of objects on large-scale touch screens utilizes the well-known principle of the cashier barcode scanning system and takes it to a new level: objects which are equipped with a special marker chip or printed code can be detected and processed from Multitouch displays in real-time.
Complement your touch screens and interactive systems by adding premium object recognition technology - no need for expensive additional hardware, simply add our software plugin. Standardized marker objects as well as custom designs can be acquired on request.
Click on the button to start the video.
The recognition of objects on large-scale touch screens utilizes the well-known principle of the cashier barcode scanning system and takes it to a new level: objects which are equipped with a special marker chip can be detected and processed by interactive displays in real-time.
eyefactive cooperates successfully with the following partners in the fields of hardware and software:
So-called marker objects (markers) simulate a steady pattern consisting out of 3-4 touch points, which will be automatically learned and saved by our algorithm. Every fingerprint-like pattern is allocated an unique identification number, which can be used for different actions within the software.
Display |
LCD / LED |
Recognition |
Point-pattern (capacitive) |
Runtime |
Infinite (passive) |
Marker-size / Weight |
⌀ 7,5 cm / 40g |
Number of IDs / Parallel |
10 / 10 |
Fast Movement |
Yes |
Protocol |
TUIO |
Display |
LCD / LED |
Recognition |
Point-pattern (optical) |
Runtime |
Infinite (passive) |
Marker-size / Weight |
⌀ 7,5 cm / 52g |
Numer of IDs / Parallel |
10 / 4 |
Fast Movement |
No |
Protocol |
TUIO |
Technical background information on object recognition: components, connection plan and TUIO protocol.
This whitepaper presents some of the most exiting usecases of touchscreen object recognition for interactive displays, tables and video walls.
Read ArticleLearn how to use innovative object recognition on touchscreens in our workshops on site or virtually via video conference.
Learn moreClick on the headlines to learn more.
Touchscreen object recognition is an innovative technology that allows large-scale touchscreens to detect and interact with physical objects placed on their surface. This technology utilizes special marker chips (also: tags or fiducials) attached to objects, which can be recognized by the touchscreen's sensors.
The technology works by simulating touch inputs through these marker chips, which create unique patterns of 3-4 touch points. These patterns are then detected and interpreted by the touchscreen's software, allowing for real-time interaction between physical objects and digital content.
This object recognition capability enables a seamless blend of the physical and digital worlds, opening up new possibilities for interactive experiences in various industries such as retail, museums, events and corporate communications.
Touchscreen object recognition technology primarily works with projected capacitive (PCAP) or infrared (IR) touchscreen sensors. When an object with a marker chip is placed on the screen, it interferes with the screen's electrical field, simulating specific touch patterns.
The touchscreen's controller detects these patterns and interprets them as unique object identifiers. This allows the system to recognize not only the presence of an object but also its exact position and orientation on the screen.
The advanced object recognition technology provided by eyefactive offers a highly precise and stable recognition of objects on screens of various sizes.
Object recognition technology for touchscreens offers several key benefits:
Intuitive interaction: Users can simply place objects on the screen to trigger digital content, making the interaction process natural and easy to understand.
Personalization: The system can recognize specific objects and display tailored content, enhancing the user experience.
Enhanced engagement: By bridging the physical and digital worlds, this technology creates more immersive and interactive experiences for users.
Versatility: It can be applied in various settings, from retail and museums to corporate environments and events, offering new ways to present information and engage with audiences.
Touchscreen object recognition technology has a wide range of applications across various industries:
Retail: In stores, it can be used for product comparisons, providing detailed information about items, or creating interactive product displays.
Museums and galleries: Objects can trigger multimedia content about exhibits, creating more engaging and informative experiences for visitors.
Restaurants and bars: Menus or drink options can be displayed when specific objects are placed on the screen, enhancing the dining experience.
Events and exhibitions: Interactive displays can be created where attendees interact with physical objects to access digital content or participate in activities.
Corporate communications: In office settings, the technology can be used for presentations, data visualization, or interactive information displays.
Education: Schools and training centers can use object recognition for interactive learning experiences, where physical objects trigger educational content or simulations.
Up to 10 marker chips can be recognized simultaneously. If more objects are required, customized solutions can be developed.
No, the marker chips used in most touchscreen object recognition systems by eyefactive do not require batteries. These are typically referred to as 'passive' markers because they don't need an external power source to function.
The marker chips work by creating a specific pattern of touch points on the capacitive touchscreen. This is achieved through a arrangement of conductive materials in the marker, which interacts with the touchscreen's electrical field. When placed on the screen, these markers simulate touch inputs without needing any power of their own.
This passive design offers several advantages:
Durability: With no electronic components or batteries to fail, passive markers are highly durable and long-lasting.
Cost-effectiveness: The simple construction of passive markers makes them relatively inexpensive.
Ease of use: There's no need to worry about charging or replacing batteries, making the system more user-friendly and maintenance-free.
The integration of touchscreen software with object recognition technology is crucial for creating interactive experiences. There are typically two main approaches to this integration:
AppSuite CMS: We offer comprehensive solutions that include both the object recognition technology and the software to utilize it. Our touchscreen content management software AppSuite integrates object recognition technology seamlessly. The platform includes various apps designed specifically for object recognition, allowing users to create interactive experiences without any programming knowledge.
MORE Engine Plugin: For developers who want to create custom applications, eyefactive offers this third-party plugin that can be integrated into existing software frameworks. For instance, eyefactive's MORE Engine plugin allows developers to incorporate object recognition capabilities into their own software, often built with game engines like Unity or Unreal Engine.
In both cases, the software needs to be able to interpret the data from the touchscreen sensors, identifying when an object has been placed, moved, or rotated on the screen. The software then triggers appropriate responses, such as displaying information, launching animations, or updating interactive elements on the screen.
Using eyefactive's cloud based analytics platform, businesses are able to track how users interact with objects and content, providing valuable insights for improving the user experience or optimizing ROI strategies.
A touchscreen object recognition system consists of several key components working together to create an interactive experience:
Touchscreen Display: This is typically a large-format touchscreen, often using Projected Capacitive (PCAP) or Infrared (IR) technology. These displays can range from 43 inches to 98 inches or even larger for video walls.
Marker Chips (or: Tags, Fiducials): These are small objects, about 7-8cm in diameter, that can be recognized by the touchscreen. They use conductive materials to create unique touch patterns that the system can identify.
Recognition Middleware: This is the brain of the system, interpreting the touch inputs from the marker chips and translating them into actions within the application.
Content Management System (CMS): eyefactive's AppSuite CMS allows users to create, manage, and deploy interactive content that responds to object recognition events.
Apps: These are the actual programs that run on the touchscreen, utilizing the object recognition capabilities to create engaging experiences.
Physical Objects: In addition to the marker chips, there may be larger objects or product replicas to which the markers are attached, creating a more tangible interactive experience.
Data Analytics Tools: Capabilities for tracking user interactions and generating insights to improve the experience or inform business decisions.
Together, these components create a system that can seamlessly blend physical object interaction with digital content, opening up new possibilities for engagement across various industries.
TUIO is an open-source framework and defines a data transfer protocol for interactive multitouch systems and applications.
You can buy or rent multitouch object recognition / detection technologies as well as tangible objects and markers for permanent installations or temporary trade shows.
We are pleased to support you with free, non-binding consultation and an individual offer - for your successful interactive digital signage project.
Contact us now!