12 May 2010 · Source: EUREKA Success Story · Download PDF

Enabling video systems to react intelligently to content

Highly sophisticated video-content analysis now makes possible fast and reliable diagnosis of pulmonary embolisms, automatically detects threatening situations in surveillance scenarios and can provides more enjoyable and customised home entertainment. The systems achieve this by reacting not only to the contents of the data but also to the context. Commercial applications are already developing across Europe. 

The EUREKA ITEA 2 software Cluster CANTATA project has made possible advanced and automatic analysis of digital video content to improve surveillance, speed medical diagnosis in life-threatening situations and provide consumers with fast access to preferred home entertainment material. Advanced digital technologies and the availability of greater systems power have enabled the development of robust analytical algorithms for content interpretation, a scalable platform facilitating analysis across a wide range of applications, content presentation that adapts to the device, user and content, and a common understanding of quality levels in content analysis. Demonstrations of surveillance, medical and multimedia applications developed for the project are already leading to commercial products.

The amount of digital video content now available makes automated interpretation essential to ensure optimal use of data in the shortest possible time. Massive expansion of video applications over the Internet and corporate networks is becoming a reality and additional content-analysis-based applications are about to follow.

Such applications involve transferring and interpreting huge amounts of data – from multi-camera security installations functioning 24 hours a day, 7 days a week, through the increasing amount of graphical information in medical diagnosis from for example high resolution 3D scanners that put a high stress on the medical experts involved, to the homeconsumer who has access to virtually unlimited multimedia content, increasingly over the Internet.


Making the system aware
Current video systems are limited as human interpretation is required to discriminate. The ITEA CANTATA project saw a need to make the system itself aware of both the contents and its context, and to use this knowledge to establish an action or control the environment autonomously. As a result, the quality and reliability of automatic content analysis will become an important discriminating factor in market choice.

“Even intelligent state-of-the-art systems currently fail compared with human intelligence as the context of information on which the adaptive behaviour is based is completely ignored,” explains Dr. Egbert Jaspers from Philips Research. “Realistic context models are needed to improve the decision making of complex vision systems and to produce faithful and meaningful behaviour.”
CANTATA set out to bridge the gap between academic research into such content analysis and economic feasibility. “Bringing together universities, large companies and small and medium-sized enterprises (SMEs) enabled a wide range of competencies to be focused on the challenges,” says Jaspers. “Such co-operation is of great benefit to SMEs as they can’t normally afford such a level of investment in research. Moreover, the project was particular suited to the EUREKA ITEA Cluster.”


Developments included: algorithms for content analysis in different domains; an analytical and presentation platform suitable for all areas; visualisation and user interaction, focusing mainly on home consumers; and methodology for validation of content-aware products.
Fast commercial exploitation possible
Key innovations were demonstrated in home multimedia, video surveillance and medical diagnostics and the results have been exploited commercially very quickly after the end of the project:

Boosting company growth
In addition, the ITEA project enabled many of the partners involved to grow. Spin-off companies have developed significantly since the start of the project. For example, high-tech start-up ViNotion, which specialises in automation systems based on video-content analysis, has grown from zero to six full-time equivalents. And VDG Security has nearly tripled its research staff to 20.


This EUREKA Success story was also published by News Wires Alpha Galileo and Science Daily

Related projects



ITEA Call 8

Content Analysis & Networked Technologies towards Advanced and Tailored Assistance.



ITEA 2 Call 4