SlideShare une entreprise Scribd logo
1  sur  23
Télécharger pour lire hors ligne
CREATIVE AI MEETUP - 18.04.18
"Can you make this image more neoclassical?"
Practical uses of Style Transfer in the creative industry
Marco Marchesi
Head of Technology
Happy Finish
CREATIVE AI MEETUP - 18.04.18
Summary
● So far…
● Yinka Shonibare VR
● Other approaches: GAN’s
● Deep Retouching
● This year
● Conclusions
from “Come Swim” (2017)
CREATIVE AI MEETUP - 18.04.18
So far...
Gatys, Leon A., Alexander S. Ecker, and Matthias Bethge. "A neural algorithm of artistic style." arXiv preprint arXiv:1508.06576 (2015).
https://harishnarayanan.org/writing/artistic-style-transfer
CREATIVE AI MEETUP - 18.04.18
So far...
Jing, Yongcheng, et al. "Neural style transfer: A review." arXiv preprint arXiv:1705.04058 (2018). https://github.com/ycjing/Neural-Style-Transfer-Papers
CREATIVE AI MEETUP - 18.04.18
Royal Academy - Yinka Shonibare VR
“The Townley Venus”
(1-2 century AD)
Shonibare’s
“Townley Venus”
(2017)
Gavin Hamilton’s “Venus
giving Helen to Paris as his
wife” (1782-1784)
CREATIVE AI MEETUP - 18.04.18
Royal Academy - Yinka Shonibare VR
CREATIVE AI MEETUP - 18.04.18
Texture Synthesis
Wilmot, Pierre, Eric Risser, and Connelly Barnes. "Stable and controllable neural texture synthesis and style transfer using histogram losses." arXiv preprint
arXiv:1701.08893 (2017). https://github.com/ycjing/Neural-Style-Transfer-Papers
CREATIVE AI MEETUP - 18.04.18
First Tests
Test 1 Test 2 Test 3
Style Mask
Mask Content
CREATIVE AI MEETUP - 18.04.18
Image Analogy...
Champandard, Alex J. "Semantic style transfer and turning two-bit doodles into fine artworks." arXiv preprint arXiv:1603.01768
(2016).https://github.com/DmitryUlyanov/fast-neural-doodle
Liao, Jing, et al. "Visual attribute transfer through deep image analogy." arXiv preprint arXiv:1705.01088 (2017).
https://github.com/awentzonline/image-analogies
CREATIVE AI MEETUP - 18.04.18
...that actually makes art!
CREATIVE AI MEETUP - 18.04.18
Our Process
CONTENT
TEXTURE IMAGE
STYLE
IMAGE
CONTENT
MASK
STYLE
MASK
NEURAL STYLE TRANSFER
TARGET
IMAGE
CONTENT
MASK
TARGET
TEXTURE IMAGE
video
CREATIVE AI MEETUP - 18.04.18
Final Result
video
CREATIVE AI MEETUP - 18.04.18
Another Approach: Generative Adversarial Networks
Zhu, Jun-Yan, et al. "Unpaired image-to-image translation using cycle-consistent adversarial networks." arXiv preprint arXiv:1703.10593 (2017).
https://github.com/junyanz/CycleGAN
Huang, Xun, et al. “Multimodal Unsupervised Image-to-Image Translation”. arXiv preprint arXiv:1804.04732 (2018)) https://github.com/NVlabs/MUNIT
CycleGAN (2017) MUNIT (2018)
CREATIVE AI MEETUP - 18.04.18
Deep Retouching (Happy Finish, 2017)
Patent Pending
CREATIVE AI MEETUP - 18.04.18
Deep Retouching (Happy Finish, 2017)
Patent Pending
CREATIVE AI MEETUP - 18.04.18
Deep Retouching (Happy Finish, 2017)
Patent Pending
CREATIVE AI MEETUP - 18.04.18
This year: Deep Painterly Harmonization
(Cornell U., Adobe, 2018)
Luan, Fujun, et al. "Deep Painterly Harmonization." arXiv preprint arXiv:1804.03189 (2018). https://github.com/luanfujun/deep-painterly-harmonization
CREATIVE AI MEETUP - 18.04.18
This year: Fast Photo Style (NVIDIA, 2018)
Li, Yijun, et al. "A Closed-form Solution to Photorealistic Image Stylization." arXiv preprint arXiv:1802.06474 (2018). https://github.com/NVIDIA/FastPhotoStyle
CREATIVE AI MEETUP - 18.04.18
The semantic limitations of style transfer
CREATIVE AI MEETUP - 18.04.18
This year: Photo Style Transfer (theprintspace, 2018)
Patent Pending
ContentStyle Cornell U., Adobe 2017 NVIDIA 2018 theprintspace 2018
CREATIVE AI MEETUP - 18.04.18
This year: Photo Style Transfer (theprintspace, 2018)
Patent Pending
ContentStyle Cornell U., Adobe 2017 NVIDIA 2018 theprintspace 2018
CREATIVE AI MEETUP - 18.04.18
Conclusions
Patent Pending
● Semantically consistent results
● Really Hi-Res
● More content transformation
What’s next?
www.happyfinish.com Everything is possible.
Marco Marchesi| Head of Technology
marco.marchesi@happyfinish.com

Contenu connexe

Similaire à Marco Marchesi - Practical uses of style transfer in the creative industry

UXPin: State of the Union Product Keynote by Marcin Treder
UXPin: State of the Union Product Keynote by Marcin TrederUXPin: State of the Union Product Keynote by Marcin Treder
UXPin: State of the Union Product Keynote by Marcin Trederuxpin
 
Roadmap - SiriusCon2016
Roadmap - SiriusCon2016Roadmap - SiriusCon2016
Roadmap - SiriusCon2016Cédric Brun
 
Using AI as a Tool in Artistic Creation
Using AI as a Tool in Artistic CreationUsing AI as a Tool in Artistic Creation
Using AI as a Tool in Artistic CreationFITC
 
Exploring platform boundary resources with a data-driven approach
Exploring platform boundary resources with a data-driven approachExploring platform boundary resources with a data-driven approach
Exploring platform boundary resources with a data-driven approachJukka Huhtamäki
 
Leveraging the Crowd: Supporting Newcomers to Build an OSS Community
Leveraging the Crowd: Supporting Newcomers to Build an OSS CommunityLeveraging the Crowd: Supporting Newcomers to Build an OSS Community
Leveraging the Crowd: Supporting Newcomers to Build an OSS CommunityMarco Aurelio Gerosa
 

Similaire à Marco Marchesi - Practical uses of style transfer in the creative industry (6)

UXPin: State of the Union Product Keynote by Marcin Treder
UXPin: State of the Union Product Keynote by Marcin TrederUXPin: State of the Union Product Keynote by Marcin Treder
UXPin: State of the Union Product Keynote by Marcin Treder
 
Resume
ResumeResume
Resume
 
Roadmap - SiriusCon2016
Roadmap - SiriusCon2016Roadmap - SiriusCon2016
Roadmap - SiriusCon2016
 
Using AI as a Tool in Artistic Creation
Using AI as a Tool in Artistic CreationUsing AI as a Tool in Artistic Creation
Using AI as a Tool in Artistic Creation
 
Exploring platform boundary resources with a data-driven approach
Exploring platform boundary resources with a data-driven approachExploring platform boundary resources with a data-driven approach
Exploring platform boundary resources with a data-driven approach
 
Leveraging the Crowd: Supporting Newcomers to Build an OSS Community
Leveraging the Crowd: Supporting Newcomers to Build an OSS CommunityLeveraging the Crowd: Supporting Newcomers to Build an OSS Community
Leveraging the Crowd: Supporting Newcomers to Build an OSS Community
 

Plus de Luba Elliott

Luba Elliott - AI art - ICCV Conference
Luba Elliott - AI art - ICCV ConferenceLuba Elliott - AI art - ICCV Conference
Luba Elliott - AI art - ICCV ConferenceLuba Elliott
 
Luba Elliott - AI in contemporary art practice - Oxford
Luba Elliott - AI in contemporary art practice - OxfordLuba Elliott - AI in contemporary art practice - Oxford
Luba Elliott - AI in contemporary art practice - OxfordLuba Elliott
 
Luba Elliott - AI in recent art practice - ML Prague
Luba Elliott - AI in recent art practice - ML PragueLuba Elliott - AI in recent art practice - ML Prague
Luba Elliott - AI in recent art practice - ML PragueLuba Elliott
 
Three Images of the New - Richard Hames - Creative AI meetup
Three Images of the New - Richard Hames - Creative AI meetupThree Images of the New - Richard Hames - Creative AI meetup
Three Images of the New - Richard Hames - Creative AI meetupLuba Elliott
 
AI Art Gallery Overview - Luba Elliott - NeurIPS Creativity Workshop
AI Art Gallery Overview - Luba Elliott - NeurIPS Creativity WorkshopAI Art Gallery Overview - Luba Elliott - NeurIPS Creativity Workshop
AI Art Gallery Overview - Luba Elliott - NeurIPS Creativity WorkshopLuba Elliott
 
Creativity is Intelligence - Kenneth Stanley - NeurIPS Creativity Workshop
Creativity is Intelligence - Kenneth Stanley - NeurIPS Creativity WorkshopCreativity is Intelligence - Kenneth Stanley - NeurIPS Creativity Workshop
Creativity is Intelligence - Kenneth Stanley - NeurIPS Creativity WorkshopLuba Elliott
 
Seen by machine: Computational Spectatorship in the BBC Archive
Seen by machine: Computational Spectatorship in the BBC ArchiveSeen by machine: Computational Spectatorship in the BBC Archive
Seen by machine: Computational Spectatorship in the BBC ArchiveLuba Elliott
 
Luba Elliott AI art overview
Luba Elliott AI art overview Luba Elliott AI art overview
Luba Elliott AI art overview Luba Elliott
 
Natasha Jaques - Learning via Social Awareness - Creative AI meetup
Natasha Jaques - Learning via Social Awareness - Creative AI meetupNatasha Jaques - Learning via Social Awareness - Creative AI meetup
Natasha Jaques - Learning via Social Awareness - Creative AI meetupLuba Elliott
 
Sander Dieleman - Generating music in the raw audio domain - Creative AI meetup
Sander Dieleman - Generating music in the raw audio domain - Creative AI meetupSander Dieleman - Generating music in the raw audio domain - Creative AI meetup
Sander Dieleman - Generating music in the raw audio domain - Creative AI meetupLuba Elliott
 
Hooman Shayani - CAD/CAM in the Age of AI: Designers’ Journey from Earth to Sky
Hooman Shayani - CAD/CAM in the Age of AI: Designers’ Journey from Earth to SkyHooman Shayani - CAD/CAM in the Age of AI: Designers’ Journey from Earth to Sky
Hooman Shayani - CAD/CAM in the Age of AI: Designers’ Journey from Earth to SkyLuba Elliott
 
Lucas Theis - Compressing Images with Neural Networks - Creative AI meetup
Lucas Theis - Compressing Images with Neural Networks - Creative AI meetupLucas Theis - Compressing Images with Neural Networks - Creative AI meetup
Lucas Theis - Compressing Images with Neural Networks - Creative AI meetupLuba Elliott
 
Emily Denton - Unsupervised Learning of Disentangled Representations from Vid...
Emily Denton - Unsupervised Learning of Disentangled Representations from Vid...Emily Denton - Unsupervised Learning of Disentangled Representations from Vid...
Emily Denton - Unsupervised Learning of Disentangled Representations from Vid...Luba Elliott
 
Luba Elliott - Seeing AI through Art
Luba Elliott - Seeing AI through ArtLuba Elliott - Seeing AI through Art
Luba Elliott - Seeing AI through ArtLuba Elliott
 
Georgia Ward Dyer - O Time thy pyramids - Creative AI meetup
Georgia Ward Dyer - O Time thy pyramids - Creative AI meetupGeorgia Ward Dyer - O Time thy pyramids - Creative AI meetup
Georgia Ward Dyer - O Time thy pyramids - Creative AI meetupLuba Elliott
 
Daniel Berio - Graffiti synthesis, a motion centric approach - Creative AI me...
Daniel Berio - Graffiti synthesis, a motion centric approach - Creative AI me...Daniel Berio - Graffiti synthesis, a motion centric approach - Creative AI me...
Daniel Berio - Graffiti synthesis, a motion centric approach - Creative AI me...Luba Elliott
 
Ali Eslami - Artificial Intelligence and Computer Aided Design - Creative AI ...
Ali Eslami - Artificial Intelligence and Computer Aided Design - Creative AI ...Ali Eslami - Artificial Intelligence and Computer Aided Design - Creative AI ...
Ali Eslami - Artificial Intelligence and Computer Aided Design - Creative AI ...Luba Elliott
 
Daghan Cam - Adaptive Autonomous Manufacturing with AI - Creative AI meetup
Daghan Cam - Adaptive Autonomous Manufacturing with AI - Creative AI meetupDaghan Cam - Adaptive Autonomous Manufacturing with AI - Creative AI meetup
Daghan Cam - Adaptive Autonomous Manufacturing with AI - Creative AI meetupLuba Elliott
 
Martin Arjovsky - Wasserstein GAN - Creative AI meetup
Martin Arjovsky - Wasserstein GAN - Creative AI meetupMartin Arjovsky - Wasserstein GAN - Creative AI meetup
Martin Arjovsky - Wasserstein GAN - Creative AI meetupLuba Elliott
 

Plus de Luba Elliott (20)

Luba Elliott - AI art - ICCV Conference
Luba Elliott - AI art - ICCV ConferenceLuba Elliott - AI art - ICCV Conference
Luba Elliott - AI art - ICCV Conference
 
Luba Elliott - AI in contemporary art practice - Oxford
Luba Elliott - AI in contemporary art practice - OxfordLuba Elliott - AI in contemporary art practice - Oxford
Luba Elliott - AI in contemporary art practice - Oxford
 
Luba Elliott - AI in recent art practice - ML Prague
Luba Elliott - AI in recent art practice - ML PragueLuba Elliott - AI in recent art practice - ML Prague
Luba Elliott - AI in recent art practice - ML Prague
 
Three Images of the New - Richard Hames - Creative AI meetup
Three Images of the New - Richard Hames - Creative AI meetupThree Images of the New - Richard Hames - Creative AI meetup
Three Images of the New - Richard Hames - Creative AI meetup
 
AI Art Gallery Overview - Luba Elliott - NeurIPS Creativity Workshop
AI Art Gallery Overview - Luba Elliott - NeurIPS Creativity WorkshopAI Art Gallery Overview - Luba Elliott - NeurIPS Creativity Workshop
AI Art Gallery Overview - Luba Elliott - NeurIPS Creativity Workshop
 
Creativity is Intelligence - Kenneth Stanley - NeurIPS Creativity Workshop
Creativity is Intelligence - Kenneth Stanley - NeurIPS Creativity WorkshopCreativity is Intelligence - Kenneth Stanley - NeurIPS Creativity Workshop
Creativity is Intelligence - Kenneth Stanley - NeurIPS Creativity Workshop
 
Seen by machine: Computational Spectatorship in the BBC Archive
Seen by machine: Computational Spectatorship in the BBC ArchiveSeen by machine: Computational Spectatorship in the BBC Archive
Seen by machine: Computational Spectatorship in the BBC Archive
 
Luba Elliott AI art overview
Luba Elliott AI art overview Luba Elliott AI art overview
Luba Elliott AI art overview
 
Natasha Jaques - Learning via Social Awareness - Creative AI meetup
Natasha Jaques - Learning via Social Awareness - Creative AI meetupNatasha Jaques - Learning via Social Awareness - Creative AI meetup
Natasha Jaques - Learning via Social Awareness - Creative AI meetup
 
Sander Dieleman - Generating music in the raw audio domain - Creative AI meetup
Sander Dieleman - Generating music in the raw audio domain - Creative AI meetupSander Dieleman - Generating music in the raw audio domain - Creative AI meetup
Sander Dieleman - Generating music in the raw audio domain - Creative AI meetup
 
Design in AI
Design in AIDesign in AI
Design in AI
 
Hooman Shayani - CAD/CAM in the Age of AI: Designers’ Journey from Earth to Sky
Hooman Shayani - CAD/CAM in the Age of AI: Designers’ Journey from Earth to SkyHooman Shayani - CAD/CAM in the Age of AI: Designers’ Journey from Earth to Sky
Hooman Shayani - CAD/CAM in the Age of AI: Designers’ Journey from Earth to Sky
 
Lucas Theis - Compressing Images with Neural Networks - Creative AI meetup
Lucas Theis - Compressing Images with Neural Networks - Creative AI meetupLucas Theis - Compressing Images with Neural Networks - Creative AI meetup
Lucas Theis - Compressing Images with Neural Networks - Creative AI meetup
 
Emily Denton - Unsupervised Learning of Disentangled Representations from Vid...
Emily Denton - Unsupervised Learning of Disentangled Representations from Vid...Emily Denton - Unsupervised Learning of Disentangled Representations from Vid...
Emily Denton - Unsupervised Learning of Disentangled Representations from Vid...
 
Luba Elliott - Seeing AI through Art
Luba Elliott - Seeing AI through ArtLuba Elliott - Seeing AI through Art
Luba Elliott - Seeing AI through Art
 
Georgia Ward Dyer - O Time thy pyramids - Creative AI meetup
Georgia Ward Dyer - O Time thy pyramids - Creative AI meetupGeorgia Ward Dyer - O Time thy pyramids - Creative AI meetup
Georgia Ward Dyer - O Time thy pyramids - Creative AI meetup
 
Daniel Berio - Graffiti synthesis, a motion centric approach - Creative AI me...
Daniel Berio - Graffiti synthesis, a motion centric approach - Creative AI me...Daniel Berio - Graffiti synthesis, a motion centric approach - Creative AI me...
Daniel Berio - Graffiti synthesis, a motion centric approach - Creative AI me...
 
Ali Eslami - Artificial Intelligence and Computer Aided Design - Creative AI ...
Ali Eslami - Artificial Intelligence and Computer Aided Design - Creative AI ...Ali Eslami - Artificial Intelligence and Computer Aided Design - Creative AI ...
Ali Eslami - Artificial Intelligence and Computer Aided Design - Creative AI ...
 
Daghan Cam - Adaptive Autonomous Manufacturing with AI - Creative AI meetup
Daghan Cam - Adaptive Autonomous Manufacturing with AI - Creative AI meetupDaghan Cam - Adaptive Autonomous Manufacturing with AI - Creative AI meetup
Daghan Cam - Adaptive Autonomous Manufacturing with AI - Creative AI meetup
 
Martin Arjovsky - Wasserstein GAN - Creative AI meetup
Martin Arjovsky - Wasserstein GAN - Creative AI meetupMartin Arjovsky - Wasserstein GAN - Creative AI meetup
Martin Arjovsky - Wasserstein GAN - Creative AI meetup
 

Dernier

🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘RTylerCroy
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUK Journal
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024The Digital Insurer
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businesspanagenda
 
Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024The Digital Insurer
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherRemote DBA Services
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsJoaquim Jorge
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyKhushali Kathiriya
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century educationjfdjdjcjdnsjd
 
Top 10 Most Downloaded Games on Play Store in 2024
Top 10 Most Downloaded Games on Play Store in 2024Top 10 Most Downloaded Games on Play Store in 2024
Top 10 Most Downloaded Games on Play Store in 2024SynarionITSolutions
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024The Digital Insurer
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CVKhem
 
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live StreamsTop 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live StreamsRoshan Dwivedi
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...Martijn de Jong
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processorsdebabhi2
 

Dernier (20)

🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Top 10 Most Downloaded Games on Play Store in 2024
Top 10 Most Downloaded Games on Play Store in 2024Top 10 Most Downloaded Games on Play Store in 2024
Top 10 Most Downloaded Games on Play Store in 2024
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live StreamsTop 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 

Marco Marchesi - Practical uses of style transfer in the creative industry

  • 1. CREATIVE AI MEETUP - 18.04.18 "Can you make this image more neoclassical?" Practical uses of Style Transfer in the creative industry Marco Marchesi Head of Technology Happy Finish
  • 2. CREATIVE AI MEETUP - 18.04.18 Summary ● So far… ● Yinka Shonibare VR ● Other approaches: GAN’s ● Deep Retouching ● This year ● Conclusions from “Come Swim” (2017)
  • 3. CREATIVE AI MEETUP - 18.04.18 So far... Gatys, Leon A., Alexander S. Ecker, and Matthias Bethge. "A neural algorithm of artistic style." arXiv preprint arXiv:1508.06576 (2015). https://harishnarayanan.org/writing/artistic-style-transfer
  • 4. CREATIVE AI MEETUP - 18.04.18 So far... Jing, Yongcheng, et al. "Neural style transfer: A review." arXiv preprint arXiv:1705.04058 (2018). https://github.com/ycjing/Neural-Style-Transfer-Papers
  • 5. CREATIVE AI MEETUP - 18.04.18 Royal Academy - Yinka Shonibare VR “The Townley Venus” (1-2 century AD) Shonibare’s “Townley Venus” (2017) Gavin Hamilton’s “Venus giving Helen to Paris as his wife” (1782-1784)
  • 6. CREATIVE AI MEETUP - 18.04.18 Royal Academy - Yinka Shonibare VR
  • 7. CREATIVE AI MEETUP - 18.04.18 Texture Synthesis Wilmot, Pierre, Eric Risser, and Connelly Barnes. "Stable and controllable neural texture synthesis and style transfer using histogram losses." arXiv preprint arXiv:1701.08893 (2017). https://github.com/ycjing/Neural-Style-Transfer-Papers
  • 8. CREATIVE AI MEETUP - 18.04.18 First Tests Test 1 Test 2 Test 3 Style Mask Mask Content
  • 9. CREATIVE AI MEETUP - 18.04.18 Image Analogy... Champandard, Alex J. "Semantic style transfer and turning two-bit doodles into fine artworks." arXiv preprint arXiv:1603.01768 (2016).https://github.com/DmitryUlyanov/fast-neural-doodle Liao, Jing, et al. "Visual attribute transfer through deep image analogy." arXiv preprint arXiv:1705.01088 (2017). https://github.com/awentzonline/image-analogies
  • 10. CREATIVE AI MEETUP - 18.04.18 ...that actually makes art!
  • 11. CREATIVE AI MEETUP - 18.04.18 Our Process CONTENT TEXTURE IMAGE STYLE IMAGE CONTENT MASK STYLE MASK NEURAL STYLE TRANSFER TARGET IMAGE CONTENT MASK TARGET TEXTURE IMAGE video
  • 12. CREATIVE AI MEETUP - 18.04.18 Final Result video
  • 13. CREATIVE AI MEETUP - 18.04.18 Another Approach: Generative Adversarial Networks Zhu, Jun-Yan, et al. "Unpaired image-to-image translation using cycle-consistent adversarial networks." arXiv preprint arXiv:1703.10593 (2017). https://github.com/junyanz/CycleGAN Huang, Xun, et al. “Multimodal Unsupervised Image-to-Image Translation”. arXiv preprint arXiv:1804.04732 (2018)) https://github.com/NVlabs/MUNIT CycleGAN (2017) MUNIT (2018)
  • 14. CREATIVE AI MEETUP - 18.04.18 Deep Retouching (Happy Finish, 2017) Patent Pending
  • 15. CREATIVE AI MEETUP - 18.04.18 Deep Retouching (Happy Finish, 2017) Patent Pending
  • 16. CREATIVE AI MEETUP - 18.04.18 Deep Retouching (Happy Finish, 2017) Patent Pending
  • 17. CREATIVE AI MEETUP - 18.04.18 This year: Deep Painterly Harmonization (Cornell U., Adobe, 2018) Luan, Fujun, et al. "Deep Painterly Harmonization." arXiv preprint arXiv:1804.03189 (2018). https://github.com/luanfujun/deep-painterly-harmonization
  • 18. CREATIVE AI MEETUP - 18.04.18 This year: Fast Photo Style (NVIDIA, 2018) Li, Yijun, et al. "A Closed-form Solution to Photorealistic Image Stylization." arXiv preprint arXiv:1802.06474 (2018). https://github.com/NVIDIA/FastPhotoStyle
  • 19. CREATIVE AI MEETUP - 18.04.18 The semantic limitations of style transfer
  • 20. CREATIVE AI MEETUP - 18.04.18 This year: Photo Style Transfer (theprintspace, 2018) Patent Pending ContentStyle Cornell U., Adobe 2017 NVIDIA 2018 theprintspace 2018
  • 21. CREATIVE AI MEETUP - 18.04.18 This year: Photo Style Transfer (theprintspace, 2018) Patent Pending ContentStyle Cornell U., Adobe 2017 NVIDIA 2018 theprintspace 2018
  • 22. CREATIVE AI MEETUP - 18.04.18 Conclusions Patent Pending ● Semantically consistent results ● Really Hi-Res ● More content transformation What’s next?
  • 23. www.happyfinish.com Everything is possible. Marco Marchesi| Head of Technology marco.marchesi@happyfinish.com