Tim Peacock - Emotion AI Developer Day 2016
•Télécharger en tant que PPTX, PDF•
5 j'aime•546 vues
Please tweet to us using: @Affectiva and #EmoDev16 Key Websites: Affectiva: http://affectiva.com Developer Portal: http://developer.affectiva.com Affectiva Demo: http://go.affectiva.com/affectiva-demo Emotion AI Developer Day brought together the largest remote conference of emotion recognition developers in the world, including Affectiva staff, affective computing thought leaders and companies offering complementary technologies. Emotion AI Developer Day provided opportunities for attendees to learn, as we as to help shape the future of Affectiva. Find us on: Facebook: https://www.facebook.com/Affectiva/ Twitter: https://twitter.com/Affectiva LinkedIn: https://www.linkedin.com/company/affectiva_2
Recommandé
Recommandé
Contenu connexe
Similaire à Tim Peacock - Emotion AI Developer Day 2016
Similaire à Tim Peacock - Emotion AI Developer Day 2016 (20)
Dernier
Dernier (20)
Tim Peacock - Emotion AI Developer Day 2016
- 1. @affectiva Affectiva Developer Day Closing Remarks November 16, 2016
- 3. Emotions Matter Affectiva was founded on the premise that emotions matter Today, we believe that more than ever We’ve packaged up our Emotion AI as SDKs on pretty much every major platform The SDKs are free to developers in small companies (or in no company at all) • Under $1M in annual revenue And reasonably priced for larger firms Why? Because emotions matter … everywhere And everywhere is a big place
- 5. How is Affectiva technology being used? Insights & Analytics Understand how people engage emotionally in the digital world Real Time Interaction Power apps and digital experiences to adapt to our emotions in real time @affectiva
- 6. Insights & analytics with easy to use dashboard and norms Displays moment-by-moment emotion trace in synch with your content; filter by demo and survey data Benchmark performance of ads using industry leading norms @affectiva
- 7. Real-time emotion interaction Software Development Kit iOS, Android, Windows, OS X, Linux, Unity, Javascript Embed real time emotion sensing and analytics in devices, mobile apps, digital experiences and applications. Get SDK at: affectiva.com/sdk @affectiva
- 8. Threaten the Guard Unity demo @affectiva
- 9. How are developers using Affdex SDKs? @affectiva
- 10. Affectiva emotion recognition technology drives innovation in a number of industries Media and entertainment Advertising Human resources Automotive Robotics Healthcare and quantified self Video communication Online education Devices Gaming @affectiva
- 11. TrueCar L.E.D. (Light Emotion Data) Unique sensory concert experience Captures real time, crowd-sourced emotive information Displays data with a dazzling, interactive LED light show to transform the traditional concert experience @affectiva
- 12. Bentley Inspirator luxury commissioning experience Guided through an immersive film – shaped, directed and inspired by your facial and emotional reactions – a bespoke Bentayga is recommended for you.
- 13. The Hershey Smile Sampler Builds a brand connection by delivering an in-store happiness moment centered around a smile – at the point of purchase. @affectivaSee how it works here
- 14. Cloverleaf Media, LLC Unique sensory concert experience Captures real time, crowd-sourced emotive information Displays data with a dazzling, interactive LED light show to transform the traditional concert experience Cloverleaf Media, LLC Gather insights shopper emotions, age, gender, ethnicity Personalized experience Ads in digital signage on retail shelved adapt to this data
- 15. Emotion recognition tech in gaming Real Time Interaction Sense player emotion and adapt game in real time Insights & Analytics Play test player emotional engagement Gather emotion data for analysis in Free to Play games @affectiva
- 16. Nevermind – Flying Mollusk Psychological thriller game becomes more challenging when sensing player distress
- 17. @affectiva Flinch - Krush Technologies Flinch is a totally new take on the classic staring contest – just make ‘em smile. Video streaming and emotion recognition technology determine the outcome – automatically!
- 18. Humanizing Job Interviews Applying Deep Learning to Job Interviews and Coaching Data Analyzed: NONVERBAL FEATURES BUSINESS TARGETS Audio Data Analyzed: Video Characteristics Language Job Performance Promotions Turnover Safety INSIGHTS MODEL Candidate Ranking @affectiva
- 19. Top performers are more expressive @affectiva Data pulled from 13,356 interviews that also had performance model scores. They smile more, but its not just that. They show a wider range of emotion compared to bottom performers – more authentic?
- 20. Little Dragon is the first mobile app responsive to the emotional state of each learner, for a happy, personalized, and effective learning experience. Little Dragon Learning App @affectiva TEACHING FEEDBACK ATTUNEMENT
- 21. Tega learning companion for kids MIT Media Lab integrated the Affectiva SDK in Tega, a new robot platform to support educational interactions with children. It’s been deployed to 34 kids for 2 months. Students who used Tega learnt more vocabulary and were more engaged. @affectiva
- 22. @affectiva
- 23. Retail kiosk recommendations based on your reaction Smartphones that react to your mood Cars that sense emotion and engage people in it Games that adapt to players in real time Social robots with empathy Remote healthcare monitors emotional state Better Education outcomes with adaptive learning systems Emotion Chip: a future where technology is enriched with emotion @affectiva
- 24. How to get started ? Developer portal: • Documentation and how to guides to show how to use the SDKs Sample code and utilities on GitHub Ask questions through Stack Exchange • Tag: affdex-sdk tag: affdex-sdk /Affectiva Visit: http://developer.affectiva.com
- 25. @affectiva @ahamino #emodev16 #EmotionAI Get started today developer.affectiva.com
Notes de l'éditeur
- Hi, I’m Tim Peacock, VP of Engineering and COO here at Affectiva. About 33 years ago (yes, we had computers back then), I took my newly minted MIT degree, turned down an offer from BB&N (internet?) and joined a small video game startup who had just brought out a video game add-on board which you now know as Ms. Pacman. For the next few years, General Computer, developed (and monetized) a considerable reputation for delivering video games that were “not possible.” We weren’t really that much better than others, we just worked in a place that really, really liked to “go for it.” And that’s my message to you, today, GO FOR IT. Take what you’ve learned here today, and go out a build stuff. Build amazing stuff. Build silly stuff. Fun stuff. Boring stuff. Build stuff. Why? …
- Our technology is used in two distinct ways: On the one hand to gather insights and analytics on how people engage emotionally in the digital world – this is where for example brands and advertisers measure how consumers respond to their video ads. On the other hand to drive real time interaction. This is where we license our technology to others so the can emotion-enable their own solutions, essentially adding the ability to sense and adapt to human emotions to their own apps, digital experiences, devices etc.
- Forest and Steve pulled this demo together in 7.2 hours combined The premise comes from the classic adventure scenario. You need to get into the town, but it’s gate is guarded. How do you get in?
- Let’s look at some examples
- Our emotion recognition technology is now being deployed in a number of different industries. We first got our start in media and advertising – especially in market research and ad testing where the need to understand how consumers engage with brand content. With the SDK, developers have started to explore other areas, such as: Gaming Education Video communication Automotive Robotics Healthcare … Here are a few examples:
- Describe the app. Concert settings Reflects the mood of the crowd An app submitted selfies to a server … a form of self-sampling of the crowd Today you could do this directly using the SDK on a mobile phone, or using the multi-face capabilities in the SDKs and a camera pointed at the crowd.
- In this digital experience, would be Bentley buyers watch videos and their emotional reactions are used to recommend a bespoke, personal Bentley, a Bentayga. Sadly, we are not giving away a Bentayga as a prize today.
- Chase link and play video …
- Delivers double digit sales uplift via engaging interactive experience at point of decision Captures real time traffic, awareness and conversion Optimizes marketing messages by capturing measurable demographics and emotive data
- Flying Mollusk, the game studio that uses emerging technology to create entertaining and impactful games, has integrated Affectiva's emotion-sensing technology with its psychological thriller game Nevermind. Using Affectiva's Affdex SDK, Nevermind can sense a player's facial expressions for signs of emotional distress. Nevermind uses biofeedback to make the game more surreal and challenging when players feel scared or nervous. For example, if players cannot manage their stress or fear, rooms might flood, spikes might jut out from the floor, or the screen might fill with increasingly dense static. However, once the biofeedback algorithms determine that the player has calmed down, the game becomes easier and more forgiving. This indirectly teaches the player real, applied techniques that they can use to help manage feelings of stress and anxiety in their everyday lives. Psychological thriller game Nevermind uses the Affdex SDK, to sense a player's facial expressions for signs of emotional distress. Using biofeedback the game becomes more surreal and challenging when players feel scared or nervous, and easier and more forgiving when the player calms down
- Flinch is a totally new take on the classic staring contest – just make ‘em smile. No need for a friend or third-party to call the shots. Flinch pairs up the latest in video streaming and emotional tracking technology to determine the outcome - automatically! Finding an opponent is simple, because they already exist in places like Facebook or in your contacts. Though, if you find it hard to compete against those you know, you can always join a spur-of-the-moment game and make a new friend. To keep things interesting…and fun, we’ve decided to give you a little help. Trip up your opponent with surprising sounds and photos. Oh, and don't forget to let your competitive side out as you collect points for defeating your friends and rise through the ranks of the unemotional; the impassive; the truly indomitable! Flinch is a fun and entertaining game!
- HireVue automates the first round of job interviews. Prior to working with Affectiva’s SDK, they relied on natural language processing. By using our SDK, they can now consider expressions and emotions in assessing candidates. How does it work? Candidates answer 3-6 questions via online video.. The video is analyzed both for the natural language and the emotional content. These features feed a model based on past hiring decisions and select candidates for further, human powered interview rounds. NEXT PAGE About HireVue Key Statistics: 600 Customers including 30% of Fortune’s Most Admired. Clients such as Hilton, Delta, Under Armor, Chipotle, American Express, Nordstrom & Red Bull 190 Countries (interviews completed in) 17 Languages ~20M Total Interview Interactions Hirevue is a video recruiting company ..They believe that people are more than just bullets on a resume – they want to humanize the interviewing process. As a candidate you do a video interview, answering a number of questions about yourself, your past experiences, some of the highlights of your career but also tough work experiences that you’ve had to go through. Then they use a combination of audio and lauguage analysis paried with Affectiva’s emotion technology to rank candidates. They then build follow these people – did they get hired, how are they doing on the job, so they can build predictive models of what features really matter in interviewing. They also have a coaching product so that as a candidate I can get feedback on what I am doing .. ----- From hirevue. Purpose: To give people a voice and enable them to tell their stories and unlock their true potential – HireVue believe people are more than just bullets on a resume or lines on a profile. Platform: HireVue Digital Recruiting – allowing companies to build modern teams The (AI) Solution: HireVue’s Digital Assessments. The predictive accuracy of a traditional enterprise hiring assessment in the experience of a video interview using AI. Partnership with Affectiva: HireVue is utilizing the Affectiva solution to contribute to our digital feature set by analyzing the video characteristics of the recorded video interview Overview on Digital Assessments: HireVue Digital Assessments are designed to provide the predictive power and quality of a validated assessment of a traditional hiring assessment with 3-6 digital questions focused on job requirements. It treats the candidate with respect while teaching them about the job, all in a modern digital experinece. HireVue leverages traditional IO combined with the HireVue Insights engine built on Deep Learning to extract and understand behavioral patterns derived from structural digital interviews.
- Little Dragon is the first mobile app responsive to the emotional state of each learner, for a happy, personalized, and effective learning experience. Utilizes Affectiva’s Emotion AI to read and respond to the student’s emotional needs Incorporates face tracking to identify the student’s level of engagement Continually improves understanding of each user’s personal study patterns through machine learning
- Researchers at the Personal Robots Group at the MIT Media Lab integrated the Affectiva SDK in Tega, a new robot platform to support educational interactions with children. This enables Tega to sense and respond to the affective content of children’s facial expressions, which the researchers combined into a reward signal, and fed into an affective reinforcement learning algorithm that guides the robot’s behavior
- The way we are interacting with machines is changing – it’s becoming a lot more relational, intimate. When people are faced with problems—even severe or life threatening ones-- they often reach for their smartphones. People are confiding with Siri that they are depressed, or telling Cortana that they got raped, or FBs chatbot that “They are off to their chemo therapy session – Wish me luck”!. In most cases these AIs wlll say something like “I am sorry I don’t know what you mean by that.” And at best, these virtual AI assistants will refer you to a hotline. What people are really looking for is an empathetic, trustworthy companion, advisor, champion .. And this can have real value in terms of motivating behavior change, such as losing weight, sleeping better, taking our medication or being more productive in our lives.