Intervento di Giovanni Maria Farinella, Professore presso UniCT,
per l'evento "La Computer Vision nell'era dei Big Data"
organizzato da Big Data for You, l'8 novembre 2019.
2. Bush’s Memex, 1945
“Certainly progress in photography is not going to stop. […]
Let us project this trend ahead to a logical, if not inevitable,
outcome. The camera hound of the future wears on his
forehead a lump a little larger than a walnut.”
https://www.youtube.com/watch?v=c539cK58ees
3. Wearable Computer Vision: The Goal
Clip from movie Terminator 2 - Judgment day: https://youtu.be/9MeaaCwBW28
Ref: https://www.redsharknews.com/vr_and_ar/item/3539-terminator-2-vision-the-augmented-reality-standard-for-25-years
5. Three Fundamental Tasks of a First Person Vision System
WHERE?
(localization)
WHAT?
(understanding)
WHAT’S NEXT?
(anticipation)
6. Shopping Cart Localization – Demo
https://iplab.dmi.unict.it/EgocentricShoppingCartLocalization/#demo
Emiliano Spera, Antonino Furnari, Sebastiano Battiato, Giovanni Maria Farinella (2019). EgoCart: a Benchmark Dataset for Large-
Scale Indoor Image-Based Localization in Retail Stores. IEEE Transactions on Circuits and Systems for Video Technology
7. Dataset Creation – ‘Classic’ Computer Vision!
Structure from Motion (SfM)
Images 3D Model
Attach estimated 6DOF
pose to each image
camera poses
(P,Q)
Arbitrary Coordinate System (pose/scale)
rotated poses scaled/aligned poses
PCA
E. Spera, A. Furnari, S. Battiato, G. M. Farinella, Egocentric Shopping Cart Localization, International Conference on Pattern Recognition (ICPR), 2018
8. Three Fundamental Tasks of a First Person Vision System
WHERE?
(localization)
WHAT?
(understanding)
WHAT’S NEXT?
(anticipation)
9. VEDI - Vision Exploitation for Data Interpretation
Patent Pending – See all Videos Here: https://iplab.dmi.unict.it/VEDI_project/
Where am I?
Visitor
Site ManagerComputer Vision and Machine Learning
• What are the Interesting Sites
for the users with Profile A?
• User that see X observe also Y
• Do we have to re-organize the
museum spaces?
What objects have been seen by the visitors?
How Long?
No need of surveys!
Clustered Paths - Profile A
Clustered Paths - Profile B
RI-VEDI Salient Moments
See Details!
Understanding Visitor Behaviour through
Key Performance Indicators and Visual AnaliticsProviding Services
Localization
Visual Attention
Object Recognition
Augmented Reality
Personal Recommendation
Storage/Memories/Summary
Behaviour Analysis
First Person
Vision
23. RULSTM
Antonino Furnari, Giovanni Maria Farinella, What Would You Expect? Anticipating Egocentric Actions with Rolling-Unrolling LSTMs and Modality
Attention. International Conference on Computer Vision (ICCV) 2019 - ORAL. Code available at: http://iplab.dmi.unict.it/rulstm/
24. Demo Video: Egocentric Action Anticipation
Antonino Furnari, Giovanni Maria Farinella, What Would You Expect? Anticipating Egocentric Actions with Rolling-Unrolling LSTMs and Modality
Attention. International Conference on Computer Vision (ICCV) 2019 - ORAL. Code available at: http://iplab.dmi.unict.it/rulstm/
25. Thank you for your attention
Giovanni Maria Farinella
www.dmi.unict.it/farinella
gfarinella@dmi.unict.it