Date post: | 08-Jul-2015 |
Category: |
Data & Analytics |
Upload: | ieee-cist |
View: | 352 times |
Download: | 1 times |
Dino Pedreschi
KDD LABUniversità di Pisa e ISTI-CNR
http://kdd.isti.cnr.it
Forum PA – Roma 27 maggio 2014
BIG DATA ANALYTICS & SOCIAL MINING
SIAMO TUTTI POLLICINI DIGITALI
La Vita Nova, e-magazine de Il Sole 24 OreFosca Giannotti, Dino Pedreschi
Shopping patterns & lifestyle
Desires, opinions, sentiments
Relationships & social ties
Movements
Big data “proxies” of social life
27 ottobre 2014Analisi di Reti Sociali. Aprile-Maggio 20118
UNDERSTANDINGHUMAN MOBILITYPartner: Octo Telematics, PA
A12 SudCascina
Marina di Pisa/TirreniaLucca
Individual Routines
Work‐Home
Home‐Work
Collective systematic patterns
http://kdd.isti.cnr.it/uma Urban Mobility Atlas
PROACTIVE CARPOOLINGPartner: Octo Telematics, PA
Car Pooling
Carpooling Network
Carpooling Communities
Trajectory matching
Carpooling potentialPISA
16467 users, 357137 trips
20% systematic trips
40% matching trips
142.740.060 saved Kms
FLORENCE
34864 users, 1040872 trips
9% systematic trips
58% matching trips
220.802.240 saved Kms
ELECTRIFIABILITY
Partner: Octo, PA
Electrifiability
90.5% of daily trips are electrifiable
In Tuscany 66% of users have a dailymobility 100% covered by an electrical vehicle(home to home)
Electrifiability index
90%
10%
Pisa
Yes No
85%
15%
Livorno
Yes No
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
dim. 1
mar. 3
jeu. 5
sam. 7
lun. 9
mer. 11
ven. 13
dim. 15
mar. 17
jeu. 19
sam. 21
lun. 23
mer. 25
ven. 27
dim. 29
mar. 31
Firenze
Yes No
CITY USERS’ SOCIOMETER
Partner: Telecomunicazioni, PA, ISTAT
Dimmi come chiami…ti dirò chi sei!
A
Residente
B
Pendolare
A
A
B
Visitore
Anonimizzazione
City User Sociometer
Chiamate
Mappa dei profili
Analisi di data mining
Pendolari
Visitatori/Turisti
ResidentiProfilo aggregato
userIDCellSta
rtIDCellEn
dIDTimestampStart TimestampEnd
109259401503
PI010U2
PI010U2
2012-01-19 18:37:15+01
2012-01-19 18:38:07+01
109259401503
PI002U2
PI002U2
2012-01-19 18:46:33+01
2012-01-19 18:46:44+01
109259401503
PI002U2
PI002U2
2012-01-19 18:53:10+01
2012-01-19 18:53:33+01
109263991410
PI034U1
PI034U1
2012-01-18 13:59:20+01
2012-01-18 14:02:33+01
109269325201
PI023U1
PI023U1
2012-01-24 11:03:21+01
2012-01-24 11:04:56+01
Urban Sociometer: the city user meter
Pisa january 2012
ISTAT – Commissione Big Data
Measuring urban population and inter-city mobility using big data in an integratedapproach
Barbara Furletti, Lorenzo Gabrielli, Giuseppe Garofalo, Fosca Giannotti, Letizia Milli, Mirco Nanni, Dino Pedreschi, Roberta Vivio
KDD LAB – Univ. Pisa & ISTI CNR, ISTAT SIS 2014 – 47° Simposio Italiano di Statistica
MP4-A Project: Mobility Planning For Africa
A joint work of &
kdd.isti.cnr.it www.goudappel.nl
Mirco Nanni, Roberto Trasarti, et al.: MP4-A Project: Mobility Planning for Africa. “Data for Development” Orange challenge, 2013
Mirco Nanni, Roberto Trasarti, et al.: MP4-A Project: Mobility Planning for Africa. “Data for Development” Orange challenge, 2013
Measuring exceptional events
0
0,01
0,02
0,03
0,04
0,05
0,06
0,07
0,08
Giovedi Venerdi Sabato Domenica
Presenze
Presence of Visitors GSM - Pisa - Historical Center
Presenze Internet Festival Presenza media settimanale
00,050,1
0,150,2
0,250,3
0,350,4
0,45
Giovedi Venerdi Sabato Domenica
Presenze
Presence of Visitors GSM - Lucca Comics 2012
Presenze Comics 2012 Presenza media settimanale
Extraordinary events
DIVERSITY & WELL‐BEING
Partner: Octo, WIND, Orange Telecom
MOBILITY BORDERS
big data | public good
“Personal data is the new oil of the Internet and the new currency of the digital world”Maglena Kuneva, former European
Commissioner of Consumer Protection
Who’s got the big benefits so far?
A few latifundists of data GAFA
Profiling for behavioral advertising and target marketing
NSA
Profiling for discovering potential terroristsMass surveillance … STASI_2.0
EUROPEAN WAY TO BIG DATA
PRIVACY-BY-DESIGN
NEW DEAL ON DATA
Privacy-by-Design in Data Analytics
Anonymization
Service ProviderMining and
Analytical Engine
Anonymization is not trivial
De‐identification is not enough
Anonimizzazione
City User Sociometer with Privacy-by-design
Chiamate
Mappa dei profili
Analisi di data mining
Pendolari
Visitatori/Turisti
ResidentiProfilo aggregato
userIDCellSta
rtIDCellEn
dIDTimestampStart TimestampEnd
109259401503
PI010U2
PI010U2
2012-01-19 18:37:15+01
2012-01-19 18:38:07+01
109259401503
PI002U2
PI002U2
2012-01-19 18:46:33+01
2012-01-19 18:46:44+01
109259401503
PI002U2
PI002U2
2012-01-19 18:53:10+01
2012-01-19 18:53:33+01
109263991410
PI034U1
PI034U1
2012-01-18 13:59:20+01
2012-01-18 14:02:33+01
109269325201
PI023U1
PI023U1
2012-01-24 11:03:21+01
2012-01-24 11:04:56+01
A NEW DEAL ON PERSONAL DATA
DEMOCRATIZING BIG DATA
A user-centric ecosystem for Big Data
Engage people in the creation and use of big data and knowledge, by empowering individuals with self-knowledge
Incentivize individual to participate, to align ownself-interest with broader societal goals
Based on transparency, trust & privacy
Collective KnowledgeCollective
Knowledge
Personal data store
for self knowledge
Personal data store
for self knowledge
Individual profiles
Collective patterns
Conoscenzadi seSelf‐awarenessNovel
Indicators
Conoscenza individuale e conoscenza collettiva
Social mining of individual histories
Mobility DataMobility Data
Mobility DataMobility Data
Mobility DataMobility Data
Mobility DataTraditional DB
sources
Social mining of many individuals
Key publications F Giannotti, M Nanni, F Pinelli, D Pedreschi. Trajectory pattern mining. ACM SIGKDD
2007 F Giannotti, D Pedreschi. Mobility, data mining and privacy: Geographic knowledge
discovery. Springer, 2008 A Monreale, F Pinelli, R Trasarti, F Giannotti. WhereNext: a location predictor on
trajectory pattern mining. ACM SIGKDD 2009 S Rinzivillo, D Pedreschi, M Nanni, F Giannotti, N Andrienko, G Andrienko. Visually
driven analysis of movement data by progressive clustering. Information Visualization7 (3-4), 225-239. 2008
D Wang, D Pedreschi, C Song, F Giannotti, AL Barabasi. Human mobility, social ties, and link prediction. ACM SIGKDD 2011
F Giannotti, M Nanni, D Pedreschi, F Pinelli, C Renso, S Rinzivillo, R Trasarti. Unveilingthe complexity of human mobility by querying and mining massive trajectory data. The VLDB 20(5) 2011
R Trasarti, F Pinelli, M Nanni, F Giannotti. Mining mobility user profiles for car pooling. ACM SIGKDD 2011
Key publications M Coscia, G Rossetti, F Giannotti, D Pedreschi. Demon: a local-first
discovery method for overlapping communities. ACM SIGKDD 2012 S Rinzivillo, S Mainardi, F Pezzoni, M Coscia, D Pedreschi, F
Giannotti. Discovering the geographical borders of human mobility. KI-Künstliche Intelligenz 26 (3) 2012
D Pennacchioli, M Coscia, S Rinzivillo, D Pedreschi, F Giannotti. Explaining the Product Range Effect in Purchase Data. IEEE BIGDATA 2013
B Furletti, L Gabrielli, C Renso, S Rinzivillo. Analysis of GSM Calls Data for Understanding User Mobility Behavior. IEEE BIG DATA 2013
L Milli, A Monreale, G Rossetti, D Pedreschi, F Giannotti, F Sebastiani. Quantification trees. IEEE ICDM 2013
Vision papers
F Giannotti, D Pedreschi, A Pentland, P Lukowicz, D Kossmann, J Crowley, D Helbing. A planetary nervous system for social mining and collective awareness. The European Physical Journal Special Topics 214 (1), 49‐75, 2012
J van den Hoven, D Helbing, D Pedreschi, J Domingo‐Ferrer, F Giannotti . FuturICT—The road towards ethical ICT. The European Physical Journal Special Topics 214 (1), 153‐181, 2012
M Batty, KW Axhausen, F Giannotti, A Pozdnoukhov, A Bazzani, M Wachowicz. Smart cities of the future. The European Physical Journal Special Topics 214 (1), 481‐518, 2012
Special thanks to …
Fosca Giannotti, co‐lead of KDD LAB [email protected]
Salvo Rinzivillo, Mirco Nanni, Roberto Trasarti, Salvatore Ruggieri, Chiara Renso, Anna Monreale, Franco Turini
all the fantastic folks at KDD LAB Pisa many international collaborators
Knowledge Discovery & Data Mining Laboratory | kdd.isti.cnr.it