VIDEOSORVEGLIANZA: LA RICERCA IN VISIONE ARTIFICIALE PER IL RICONOSCIMENTO AUTOMATICO DI PERSONE ED EVENTI

http://www.Imagelab.ing.unimore.it

Prof. Rita Cucchiara, Università di Modena e Reggio Emilia, Direttore del centro Softech ICT

VIDEOSORVEGLIANZA Profili sociologici, criminologici, culturali e giuridici nell’ottica smart city Milano 24 Maggio, Università Cattolica del Sacro Cuore

Università di Modena e Reggio Emilia, Italy

WELCOME IN MODENAThe Second Short Spring School in Surveillance

is organized by

-University of Modena and Reggio Emilia

-Softech-ICT Interdip. Research Center in ICT

-Dipartimento di Ingegneria Enzo Ferrari

- ImageLab

Co-Sponsored by

- Fondazione Cassa di Risparmio di Modena

- GIRPR (Italian chapter of IAPR)

Università di Modena e Reggio Emilia, Italy

UNIMORE: WHERE WE ARE…

Dipartimento di Ingegneria“Enzo Ferrari”

ImageLab

Università diModena e Reggio Emilia

Emilia Romagna,Italia

Università di Modena e Reggio Emilia, Italy

WHY S5?A research School in

(computer vision and pattern recognition for)

Video Surveillance.

Mainly a school for researchers

few hot selected topics

Short (but intensive) school in Spring period

A Second edition…

Università di Modena e Reggio Emilia, Italy

S4 THE 2011 EDITION

Multicamera & applications

Tracking

Security and Forensics

Face and expression

Architecture and systemsLarge Crowd

Università di Modena e Reggio Emilia, Italy

AGAIN SURVEILLANCE…

Why another (short spring) School in surveillance?

Surveillance

Surely is an industrial gold filed

… is it still an open research problem?

Università di Modena e Reggio Emilia, Italy

THE MARKETThe global Intelligent Video Surveillance (IVS) & Video Analytics (VA) industry revenues*

• totaled $13.5 billion in 2012,

• and are estimated to reach $39 billion in 2020.

The rapid market growth is driven by the following dynamics:

• Increased use of video surveillance.

• Migration from analog to digital cameras and to IP based cameras.

• Technology maturity. Video analytics algorithms, processors, applications and products underwent a decade of technological evolution to intelligent video processing, based on advancements in image processing, enabling automatic detection of signatures detection and identification.

• Cost reduction of video analytic systems. Driven by the falling prices of image processing DSPs and communication systems. Cost-performance of new edge-based video analytics DSP technologies (e.g., Intel, Texas Instruments DSPs).

From the "Intelligent Video Surveillance, VCA & Video Analytics: Technologies & Global Market – 2013-2020"

Università di Modena e Reggio Emilia, Italy

THE MARKET Human operators entail high cost & high rate of overlooked events.

Real time analysis of video images and recorded footage is a need that can hardly be answered effectively by human operators, and manpower cost. Furthermore, human operators fatigue and boredom cause a high rate of overlooked events.

It takes IVS, VCA and VA to process trillions of video surveillance-hours generated annually.

By 2011 over 165 million video surveillance cameras installed worldwide captured 1.4 trillion video-hours.

the investing growth of 9-11% year , captured video surveillance will reach approximately 3.3 Trillion video-hours in 2020.

A hypothetical analysis assuming that 20% of the most critical video stream should have been reviewed by human operators, results in a (hypothetical) need to employ (by 2011) a workforce of over 100 million operators (working 8 hours daily, 300 days a year).

Intelligent video surveillance and video analytics with mature technology have attracted a lot of attention. ---the global market* will triple by 2020.

Università di Modena e Reggio Emilia, Italy

THE RESEARCH1998 the first workshop on AVSS (advanced video-based surveillance system) in Genoa

2000 The first IEEE Transaction PAMI Special issue on video surveillance

2003 the first IEEE conference AVSS

….. FIFTTEEN YEARS OF RESEARCH

Università di Modena e Reggio Emilia, Italy

SOME STATISTICS“Video Surveillance” : Google scholar 54000 items,

IEEEXplore 6407 items

from IEEEXplore papers with “video surveillance” keyword

1989-1999

2000 2002 2004 2006 2008 2010 20120

20

40

60

80

100

120

140

conf (x 10)journals

2010 2011 2012surveillance 863 867 768analytics 23 27 46

Università di Modena e Reggio Emilia, Italy

STATISTICSIEEE conference papers with video surveillance and ……

0

50

100

150

200

250

300

350

400 2004

2006

2008

2010

2012

Università di Modena e Reggio Emilia, Italy

STATISTICSIEEE journal papers with video surveillance and ……

0

5

10

15

20

25

30

35

40

45

20042006200820102012

Università di Modena e Reggio Emilia, Italy

SURVEILLANCE1) A growing interest in PEOPLE surveillance

2) From SECURITY

to SOCIAL and WELLBEING

3) A research interest in computer vision AND learning

2010 2011 2012

traffic 117 104 86

people 83 85 93

Università di Modena e Reggio Emilia, Italy

VIDEO SURVEILLANCE

2000 RESEARCH

Detection

Tracking

Understanding

AcquisitionSingle camera Multiple cameras

Moving object detectionSingle object/people Multiple targets, cluttered, occluded..

Linear predictionGenerative modelsStocastic prediction

Purposive

Università di Modena e Reggio Emilia, Italy

Detection

Tracking

Learning & Inferring

Acquisition

&

SPATIO-TEMPORAL REASONING

Searching & Recognizing

BIG DATA ANALYSIS

HUMAN FEEDBACK

PEOPLESURVEILLANCE

IN THE NEW DECADE

2010 RESEARCH

Università di Modena e Reggio Emilia, Italy

PEOPLE ANALYSIS IS PERVASIVE

From Securitya) Surveillance: Real time detection, Border, Zone

control, Activity monitoring, Traffic, urban control…b) Safety: traffic-automotive control; crowd

monitoring, home, working area controlc) Forensics: Video Mining, Identity assessment,

Likelihood ratio supportTo Multimedia

Video analysis, broadcasting analysis, Digital Library annotation, Sport action recognition, Human Interaction, Gaming

To (Social) WellbeingRetail analysis, Comfort in architecture

Design, Building Automation, Healthcare, Entertainment, Graphics..

Università di Modena e Reggio Emilia, Italy

PEOPLE ANALYSISMany applications.. Same problem:

detect people, their identity and behavior

Università di Modena e Reggio Emilia, Italy

PEOPLE SURVEILLANCE: WHAT AT IMAGELAB

Detection &Tracking

People (and crowd) Detection and Tracking

With multisensory data

Learning& inferring

People Identification and (Ri-)Identification

Search & Recognition

People Search by similarity Visual Learning

A-priori Models

Università di Modena e Reggio Emilia, Italy

SURVEILLANCE AT S5The topics:

Ci penso io quando avro’ gli abstract

Università di Modena e Reggio Emilia, Italy

SURVEILLANCE AT S5The lecturers:

• Arnold Smeulders CWI Amsterdam, the Netherlands 

• Bernhard Rinner Alpen-Adria-Universität Klagenfurt, Austria

 

• Francois Bremond INRIA, France 

• Greg Mori Simon Fraser University, Canada 

Università di Modena e Reggio Emilia, Italy

SURVEILLANCE AT S5The lecturers:

• Horst Bischof Institute for Computer Graphics and Vision, Inffeldgasse Graz, Austria 

• Larry Davis Institute for Advanced Computer Studies, Univ. of Maryland, USA 

• Shmuel Peleg The Hebrew University of Jerusalem, Israel 

 

Università di Modena e Reggio Emilia, Italy

SURVEILLANCE AT S5The attendees

24%

18%58%

Participant Affiliation

CompanyResearch CenterUniversity

3%3%3%

62%

14%

14%

Participant NationAustriaDenmarkIsraelItalySpainSweden

13%

27%

43%

17%

Attendees typeCompanyMsc StudentPhd StudentResearcher

THANKS..

Prof. Rita CucchiaraDipartimento di Ingegneria Enzo FerrariRes. Center SOFTECH-ICTUniversità degli Studi di Modena e Reggio EmiliaRita.cucchiara@unimore.it

Imagelab Andrea Prati [IUAV-Venezia]Costantino Grana Roberto Vezzani Simone Calderara

Giovanni Gualdi , Paolo Piccinini, Daniele Borghesani, Adnan Rashid, Paolo Santinelli

Davide Baltieri , Dalia Coppi, Michele Fornaciari ,Marco Manfredi

VISION-E srlRudy Melli, Giuliano Pistoni, Emanuele Perini

http://imagelab.ing.unimo.it