SlideShare une entreprise Scribd logo

NIPS 2016 Overview and Deep Learning Topics

•
•
Koichi Hamada
Koichi Hamada

NIPS2016読み会の登壇資料です。NIPS2016 の、Overview、及び、Generative Adversarial Networks (GANs)、Recurrent Neural Networks (RNNs) の本会議論文に関して紹介しています。

Sciences
1  sur  38
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. NIPS 2016 読み会 @Preferred Networks 2017/1/19 NIPS 2016 Overview and Deep Learning Topics @hamadakoichi 濱田晃一 Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved.
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 2 AGENDA ◆Deep Learning Topics ◆NIPS 2016 Overview ◆Generative Adversarial Networks(GANs) ◆Recurrent Neural Networks(RNNs) ◆GANs ◆GANs in NIPS2016 ◆Recent GANs ◆RNNs in NIPS2016
3 Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. 講師 ・TokyoWebmining 主催者 　- 機械学習の実活用コミュニティ。登録人数 1500人超。 　- 7年継続、累積59回開催 濱田晃一 (@hamadakoichi) ・執筆：Mobageを支える技術 Analytics Architect ・博士 : 量子統計場の理論 (理論物理) ・DeNA全サービスを対象とし、大規模機械学習活用したサービス開発 　- 数千万ユーザー、50億アクション/日、テキスト、画像、ソーシャルグラフ 　- 体験設計から、分散学習アルゴリズムの設計・実装まで ・Deep Learning 　- 画像表現学習・画像生成 　　 対話・キャラクター表現学習、等
4 Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. AGENDA ◆Deep Learning Topics ◆NIPS 2016 Overview ◆Generative Adversarial Networks(GANs) ◆Recurrent Neural Networks(RNNs) ◆GANs ◆GANs in NIPS2016 ◆Recent GANs ◆RNNs in NIPS2016
5 Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. AGENDA ◆Deep Learning Topics ◆NIPS 2016 Overview ◆Generative Adversarial Networks(GANs) ◆Recurrent Neural Networks(RNNs) ◆GANs ◆GANs in NIPS2016 ◆Recent GANs ◆RNNs in NIPS2016
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 6 NIPS 2016 ・第30回の開催 ・期間： 2016年12月5-10日 ・ICML 33回に続き長い伝統 ・チュートリアル: 5(1日) ・本会議: 5-8(4日) ・ワークショップ: 9-10(2日) ・開催地： バルセロナ(スペイン) 貼る：会場雰囲気
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 7 NIPS 2016 参加者が 6000人に増加 (2015年の1.5倍) ※Terrence Sejnowskiは NIPS foundationの President
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 8 NIPS Features ・採択の92%はポスター ・採択率: 23% ・投稿数: 2500+、採択数： 568 ・Oral(45) : 20分の口頭発表 + ポスター ・Poster(523) ： ポスターのみ ・少数トラックでの進行(最大3) （昨年までシングルトラックだったがパラレルに）
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 9 NIPS Features ・ポスター発表による活発な議論 (昨年までの19-24時の5時間ポスターからは時間縮小したが、最後まで活発な議論） ・210 min(3.5 hour)/ day ・130 Poster x 4 days
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 10 NIPS2016 Hot Topics 引用元： The review process for NIPS 2016 http://www.tml.cs.uni-tuebingen.de/team/ luxburg/misc/nips2016/index.php Deep Learning Computer Vision Large Scale Learning Learning Theory Optimization Sparsity
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 11 NIPS2016 Hot Topics Tutorial 3/9、Symposium 2/3 が Deep Learning Reinforcement Learning, Generative Adversarial Net, Recurrent Net Tutorial Symposium
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 12 NIPS2016 Hot Topics Tutorial Symposium Tutorial 3/9、Symposium 2/3 が Deep Learning Reinforcement Learning, Generative Adversarial Net, Recurrent Net 上記2トピックに関し、本会議論文をピックアップし概要紹介します (Reinforcement Learningは、このNIPS読み会での個別論文の発表も多いため)
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 13 AGENDA ◆Deep Learning Topics ◆NIPS 2016 Overview ◆Generative Adversarial Networks(GANs) ◆Recurrent Neural Networks(RNNs) ◆GANs ◆GANs in NIPS2016 ◆Recent GANs ◆RNNs in NIPS2016
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 14 AGENDA ◆Deep Learning Topics ◆NIPS 2016 Overview ◆Generative Adversarial Networks(GANs) ◆Recurrent Neural Networks(RNNs) ◆GANs ◆GANs in NIPS2016 ◆Recent GANs ◆RNNs in NIPS2016
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 15 AGENDA ◆Deep Learning Topics ◆NIPS 2016 Overview ◆Generative Adversarial Networks(GANs) ◆Recurrent Neural Networks(RNNs) ◆GANs ◆GANs in NIPS2016 ◆Recent GANs ◆RNNs in NIPS2016
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 16 Generative Adversarial Network (GAN) Generative Adversarial Nets(GAN) Goodfellow+, NIPS2014
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 17 Generative Adversarial Network (GAN) Generator(生成器)と Discriminator(識別器)を戦わせ 生成精度を向上させる 識別器: “本物画像”と “生成器が作った偽画像”を識別する 生成器: 生成画像を識別器に“本物画像”と誤識別させようとする (Goodfellow+, NIPS2014, Deep Learning Workshop, Presentation)
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 18 Generative Adversarial Network (GAN) Minimax Objective function Discriminator が 「本物画像」を「本物」と識別 (Goodfellow+, NIPS2014, Deep Learning Workshop, Presentation) Discriminator が 「生成画像」を「偽物」と識別する Discriminatorは 正しく識別しようとする （最大化） Generatorは Discriminator に誤識別させようとする（最小化） Generator(生成器)と Discriminator(識別器)を戦わせ 生成精度を向上させる
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 19 自然画像の表現ベクトル空間学習・演算・画像生成 ICLR16: Deep Convolutional GAN : DCGAN (Radford+) 自然画像のクリアな画像生成 画像演算 Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks. Alec Radford, Luke Metz, Soumith Chintala. arXiv:1511.06434. In ICLR 2016.
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 20 ICML16: Autoencoding beyond pixels (Larsen+) Autoencoding beyond pixels using a learned similarity metric. Anders Boesen Lindbo Larsen, Søren Kaae Sønderby, Hugo Larochelle, Ole Winther. arXiv:1512.09300. In ICML 2016. 自然画像の表現ベクトル空間学習・演算・画像生成
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 21 ICML16: Generative Adversarial Text to Image Synthesis(Reed+) Generative Adversarial Text to Image Synthesis. Scott Reed, Zeynep Akata, Xinchen Yan, Lajanugen Logeswaran, Bernt Schiele, Honglak Lee. arXiv:1605.05396. In ICML 2016. 文章からの画像生成 文章で条件付したGAN
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 22 AGENDA ◆Deep Learning Topics ◆NIPS 2016 Overview ◆Generative Adversarial Networks(GANs) ◆Recurrent Neural Networks(RNNs) ◆GANs ◆GANs in NIPS2016 ◆Recent GANs ◆RNNs in NIPS2016
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 23 Generative Adversarial Text to Image Synthesis(Reed+) Learning What and Where to Draw. Scott Reed, Zeynep Akata, Santosh Mohan, Samuel Tenka, Bernt Schiele, Honglak Lee. arXiv:1610.02454. In NIPS 2016. 文章からの画像生成 表示位置情報も条件付したGAN
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 24 InfoGAN (Chen+) InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Nets. Xi Chen, Yan Duan, Rein Houthooft, John Schulman, Ilya Sutskever, Pieter Abbeel. arXiv:1606.03657. In NIPS 2016 Latent code c、Generator 出力との Mutual Information を加え GANで狙って表現ベクトル空間を学習
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 25 3Dモデルの表現ベクトル空間学習・演算・生成 3D GAN (Wu+) 3Dモデルの生成 3Dモデル演算 写真からの3Dモデル生成 3D VAE-GAN 3D GAN Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modeling. Jiajun Wu, Chengkai Zhang, Tianfan Xue, William T. Freeman, Joshua B. Tenenbaum. arXiv:1610.07584. In NIPS 2016.
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 26 Generating Videos with Scene Dynamics(Vondrick+) 動画の表現ベクトル空間学習・動画生成 Generating Videos with Scene Dynamics. Carl Vondrick, Hamed Pirsiavash, Antonio Torralba. In NIPS 2016. http://web.mit.edu/vondrick/tinyvideo/ 動画生成 1画像からその後の動画生成
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 27 f-GAN (Nowozin+) GAN目的関数を Symmetric JS-divergence から f-divergence に一般化。各Divergence を用い学習・評価 f-GAN: Training Generative Neural samplers using variational Divergence Minimization. Sebastian Nowozin, Botond Cseke, Ryota Tomioka. arXiv:1606.00709. In NIPS 2016. Kernel Density Estimation on the MNIST f-divergence LSUN
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 28 Improved Techniques for Training GANs (Salimans+) Improved Techniques for Training GANs. Tim Salimans, Ian Goodfellow, Wojciech Zaremba, Vicki Cheung, Alec Radford, Xi Chen. arXiv:1606.03498. In NIPS 2016. 収束が難しいGANの学習方法論 GAN半教師あり学習 1. Feature Matching 2. Minibatch discrimination 3. Historical averaging 4. One-sided label smoothing 5. Virtual batch normalization Techniques Semi-supervised learning MNIST Semi-supervised training with feature matching Semi-supervised training with feature matching and minibatch discrimination CIFAR-10 Generated samples
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 29 AGENDA ◆Deep Learning Topics ◆NIPS 2016 Overview ◆Generative Adversarial Networks(GANs) ◆Recurrent Neural Networks(RNNs) ◆GANs ◆GANs in NIPS2016 ◆Recent GANs ◆RNNs in NIPS2016
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 30 Extended Architectures for Generative Adversarial Nets 2016 Extended Architectures for GANs Figure by Chris Olah (2016) : https://twitter.com/ch402/status/793535193835417601 Ex) Conditional Image Synthesis With Auxiliary Classifier GANs. Augustus Odena, Christopher Olah, Jonathon Shlens. arXiv:1610.09585. Generative Adversarial Net の各種拡張
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 31 Stack GAN: Text to PhotoRealistic Image Synthesis(Zhang+2016) 1段目で文章から低解像度画像を生成 2段目で低解像度画像から高解像度画像を生成 StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generative Adversarial Networks. Han Zhang, Tao Xu, Hongsheng Li, Shaoting Zhang, Xiaolei Huang, Xiaogang Wang, Dimitris Metaxas. arXiv:1612.03242.
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 32 Plug & Play Generative Networks (Nguyen+2016) 高解像度な画像生成 227 x 227 ImageNet Plug & Play Generative Networks: Conditional Iterative Generation of Images in Latent Space. Anh Nguyen, Jason Yosinski, Yoshua Bengio, Alexey Dosovitskiy, Jeff Clune. arXiv:1612.00005.
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 33 AGENDA ◆Deep Learning Topics ◆NIPS 2016 Overview ◆Generative Adversarial Networks(GANs) ◆Recurrent Neural Networks(RNNs) ◆GANs ◆GANs in NIPS2016 ◆Recent GANs ◆RNNs in NIPS2016
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 34 Phased LSTM (Neil+) 時間で開閉するGateを導入した LSTM Sensor Data 等、Event 駆動の長期系列特徴を学習 Phased LSTM: Accelerating Recurrent Network Training for Long or Event-based Sequences. Daniel Neil, Michael Pfeiffer, Shih-Chii Liu. arXiv:1610.09513. In NIPS 2016. LSTM Phased LSTM Phased LSTM Behavior Frequency Discrimination Task
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 35 Using Fast Weights to Attend to the Recent Past (Ba+) 早く学習・減衰する Fast Weight 追加で、系列固有の情報を扱う Slow Weight での長期特徴とあわせ、双方の系列特徴を学習 Using Fast Weights to Attend to the Recent Past. Jimmy Ba, Geoffrey Hinton, Volodymyr Mnih, Joel Z. Leibo, Catalin Ionescu. arXiv:1610.06258. In NIPS 2016. Associative Retrieval Task Classification Error Test Log Likelihood
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 36 Learning to learn by GD by GD (Andrychowicz+) LSTMを用いたOptimizer Parameterごとに 勾配系列から適切な次の更新量を算出 Learning to learn by gradient descent by gradient descent. Marcin Andrychowicz, Misha Denil, Sergio Gomez, Matthew W. Hoffman, David Pfau, Tom Schaul, Brendan Shillingford, Nando de Freitas. arXiv:1606.04474. In NIPS 2016.
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 37 Matching Network for One Shot Learning (Vinyals+) Attention Mechanism を用いた One Shot Learning 参照構造を学習しておき、新規小規模データセットでも高精度で動作 Matching Networks for One Shot Learning. Oriol Vinyals, Charles Blundell, Timothy Lillicrap, Koray Kavukcuoglu, Daan Wierstra. arXiv:1606.04080. In NIPS 2016. Omniglot miniImageNet
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 38 AGENDA ◆Deep Learning Topics ◆NIPS 2016 Overview ◆Generative Adversarial Networks(GANs) ◆Recurrent Neural Networks(RNNs) ◆GANs ◆GANs in NIPS2016 ◆Recent GANs ◆RNNs in NIPS2016

Recommandé

Anime Generation with AI
Anime Generation with AIAnime Generation with AI
Anime Generation with AIKoichi Hamada
 
Generative Adversarial Networks (GANs) and Disentangled Representations @ N...
Generative Adversarial Networks (GANs) and Disentangled Representations @ N...Generative Adversarial Networks (GANs) and Disentangled Representations @ N...
Generative Adversarial Networks (GANs) and Disentangled Representations @ N...Koichi Hamada
 
AIによるアニメ生成の挑戦
AIによるアニメ生成の挑戦AIによるアニメ生成の挑戦
AIによるアニメ生成の挑戦Koichi Hamada
 
Generative Adversarial Networks @ ICML 2019
Generative Adversarial Networks @ ICML 2019Generative Adversarial Networks @ ICML 2019
Generative Adversarial Networks @ ICML 2019Koichi Hamada
 
Deepfakesの生成および検出
Deepfakesの生成および検出Deepfakesの生成および検出
Deepfakesの生成および検出Plot Hong
 
Deep Learning Jump Start
Deep Learning Jump StartDeep Learning Jump Start
Deep Learning Jump StartMichele Toni
 
[DL輪読会]Image-to-Image Translation with Conditional Adversarial Networks
[DL輪読会]Image-to-Image Translation with Conditional Adversarial Networks[DL輪読会]Image-to-Image Translation with Conditional Adversarial Networks
[DL輪読会]Image-to-Image Translation with Conditional Adversarial NetworksDeep Learning JP
 
Generative Adversarial Networks (GAN) の学習方法進展・画像生成・教師なし画像変換
Generative Adversarial Networks (GAN) の学習方法進展・画像生成・教師なし画像変換Generative Adversarial Networks (GAN) の学習方法進展・画像生成・教師なし画像変換
Generative Adversarial Networks (GAN) の学習方法進展・画像生成・教師なし画像変換Koichi Hamada
 

Recommandé

Anime Generation with AI
Anime Generation with AIAnime Generation with AI
Anime Generation with AIKoichi Hamada
 
Generative Adversarial Networks (GANs) and Disentangled Representations @ N...
Generative Adversarial Networks (GANs) and Disentangled Representations @ N...Generative Adversarial Networks (GANs) and Disentangled Representations @ N...
Generative Adversarial Networks (GANs) and Disentangled Representations @ N...Koichi Hamada
 
AIによるアニメ生成の挑戦
AIによるアニメ生成の挑戦AIによるアニメ生成の挑戦
AIによるアニメ生成の挑戦Koichi Hamada
 
Generative Adversarial Networks @ ICML 2019
Generative Adversarial Networks @ ICML 2019Generative Adversarial Networks @ ICML 2019
Generative Adversarial Networks @ ICML 2019Koichi Hamada
 
Deepfakesの生成および検出
Deepfakesの生成および検出Deepfakesの生成および検出
Deepfakesの生成および検出Plot Hong
 
Deep Learning Jump Start
Deep Learning Jump StartDeep Learning Jump Start
Deep Learning Jump StartMichele Toni
 
[DL輪読会]Image-to-Image Translation with Conditional Adversarial Networks
[DL輪読会]Image-to-Image Translation with Conditional Adversarial Networks[DL輪読会]Image-to-Image Translation with Conditional Adversarial Networks
[DL輪読会]Image-to-Image Translation with Conditional Adversarial NetworksDeep Learning JP
 
Generative Adversarial Networks (GAN) の学習方法進展・画像生成・教師なし画像変換
Generative Adversarial Networks (GAN) の学習方法進展・画像生成・教師なし画像変換Generative Adversarial Networks (GAN) の学習方法進展・画像生成・教師なし画像変換
Generative Adversarial Networks (GAN) の学習方法進展・画像生成・教師なし画像変換Koichi Hamada
 
Value iteration networks
Value iteration networksValue iteration networks
Value iteration networksFujimoto Keisuke
 
InfoGAN: Interpretable Representation Learning by Information Maximizing Gen...
InfoGAN: Interpretable Representation Learning by Information Maximizing Gen...InfoGAN: Interpretable Representation Learning by Information Maximizing Gen...
InfoGAN: Interpretable Representation Learning by Information Maximizing Gen...Shuhei Yoshida
 
Dual Learning for Machine Translation (NIPS 2016)
Dual Learning for Machine Translation (NIPS 2016)Dual Learning for Machine Translation (NIPS 2016)
Dual Learning for Machine Translation (NIPS 2016)Toru Fujino
 
時系列データ3
時系列データ3時系列データ3
時系列データ3graySpace999
 
Fast and Probvably Seedings for k-Means
Fast and Probvably Seedings for k-MeansFast and Probvably Seedings for k-Means
Fast and Probvably Seedings for k-MeansKimikazu Kato
 
Interaction Networks for Learning about Objects, Relations and Physics
Interaction Networks for Learning about Objects, Relations and PhysicsInteraction Networks for Learning about Objects, Relations and Physics
Interaction Networks for Learning about Objects, Relations and PhysicsKen Kuroki
 
Introduction of "TrailBlazer" algorithm
Introduction of "TrailBlazer" algorithmIntroduction of "TrailBlazer" algorithm
Introduction of "TrailBlazer" algorithmKatsuki Ohto
 
Learning to learn by gradient descent by gradient descent
Learning to learn by gradient descent by gradient descentLearning to learn by gradient descent by gradient descent
Learning to learn by gradient descent by gradient descentHiroyuki Fukuda
 
Conditional Image Generation with PixelCNN Decoders
Conditional Image Generation with PixelCNN DecodersConditional Image Generation with PixelCNN Decoders
Conditional Image Generation with PixelCNN Decoderssuga93
 
Safe and Efficient Off-Policy Reinforcement Learning
Safe and Efficient Off-Policy Reinforcement LearningSafe and Efficient Off-Policy Reinforcement Learning
Safe and Efficient Off-Policy Reinforcement Learningmooopan
 
Introduction of “Fairness in Learning: Classic and Contextual Bandits”
Introduction of “Fairness in Learning: Classic and Contextual Bandits”Introduction of “Fairness in Learning: Classic and Contextual Bandits”
Introduction of “Fairness in Learning: Classic and Contextual Bandits”Kazuto Fukuchi
 
Improving Variational Inference with Inverse Autoregressive Flow
Improving Variational Inference with Inverse Autoregressive FlowImproving Variational Inference with Inverse Autoregressive Flow
Improving Variational Inference with Inverse Autoregressive FlowTatsuya Shirakawa
 
[DL輪読会]Convolutional Sequence to Sequence Learning
[DL輪読会]Convolutional Sequence to Sequence Learning[DL輪読会]Convolutional Sequence to Sequence Learning
[DL輪読会]Convolutional Sequence to Sequence LearningDeep Learning JP
 
論文紹介 Combining Model-Based and Model-Free Updates for Trajectory-Centric Rein...
論文紹介 Combining Model-Based and Model-Free Updates for Trajectory-Centric Rein...論文紹介 Combining Model-Based and Model-Free Updates for Trajectory-Centric Rein...
論文紹介 Combining Model-Based and Model-Free Updates for Trajectory-Centric Rein...Kusano Hitoshi
 
Differential privacy without sensitivity [NIPS2016読み会資料]
Differential privacy without sensitivity [NIPS2016読み会資料]Differential privacy without sensitivity [NIPS2016読み会資料]
Differential privacy without sensitivity [NIPS2016読み会資料]Kentaro Minami
 
Matching networks for one shot learning
Matching networks for one shot learningMatching networks for one shot learning
Matching networks for one shot learningKazuki Fujikawa
 
ICML2016読み会　概要紹介
ICML2016読み会　概要紹介ICML2016読み会　概要紹介
ICML2016読み会　概要紹介Kohei Hayashi
 
論文紹介 Pixel Recurrent Neural Networks
論文紹介 Pixel Recurrent Neural Networks論文紹介 Pixel Recurrent Neural Networks
論文紹介 Pixel Recurrent Neural NetworksSeiya Tokui
 
Deep Learning - The Past, Present and Future of Artificial Intelligence
Deep Learning - The Past, Present and Future of Artificial IntelligenceDeep Learning - The Past, Present and Future of Artificial Intelligence
Deep Learning - The Past, Present and Future of Artificial IntelligenceLukas Masuch
 
Python for Data: Past, Present, Future (PyCon JP 2017 Keynote)
Python for Data: Past, Present, Future (PyCon JP 2017 Keynote)Python for Data: Past, Present, Future (PyCon JP 2017 Keynote)
Python for Data: Past, Present, Future (PyCon JP 2017 Keynote)Peter Wang
 
Achieving Software Assurance with Hybrid Analysis Mapping
Achieving Software Assurance with Hybrid Analysis Mapping Achieving Software Assurance with Hybrid Analysis Mapping
Achieving Software Assurance with Hybrid Analysis Mapping Denim Group
 
PROTEUS H2020 at Ficloud2016
PROTEUS H2020 at Ficloud2016PROTEUS H2020 at Ficloud2016
PROTEUS H2020 at Ficloud2016Nacho García Fernández
 

Contenu connexe

En vedette

InfoGAN: Interpretable Representation Learning by Information Maximizing Gen...
InfoGAN: Interpretable Representation Learning by Information Maximizing Gen...InfoGAN: Interpretable Representation Learning by Information Maximizing Gen...
InfoGAN: Interpretable Representation Learning by Information Maximizing Gen...Shuhei Yoshida
 
Dual Learning for Machine Translation (NIPS 2016)
Dual Learning for Machine Translation (NIPS 2016)Dual Learning for Machine Translation (NIPS 2016)
Dual Learning for Machine Translation (NIPS 2016)Toru Fujino
 
時系列データ3
時系列データ3時系列データ3
時系列データ3graySpace999
 
Fast and Probvably Seedings for k-Means
Fast and Probvably Seedings for k-MeansFast and Probvably Seedings for k-Means
Fast and Probvably Seedings for k-MeansKimikazu Kato
 
Interaction Networks for Learning about Objects, Relations and Physics
Interaction Networks for Learning about Objects, Relations and PhysicsInteraction Networks for Learning about Objects, Relations and Physics
Interaction Networks for Learning about Objects, Relations and PhysicsKen Kuroki
 
Introduction of "TrailBlazer" algorithm
Introduction of "TrailBlazer" algorithmIntroduction of "TrailBlazer" algorithm
Introduction of "TrailBlazer" algorithmKatsuki Ohto
 
Learning to learn by gradient descent by gradient descent
Learning to learn by gradient descent by gradient descentLearning to learn by gradient descent by gradient descent
Learning to learn by gradient descent by gradient descentHiroyuki Fukuda
 
Conditional Image Generation with PixelCNN Decoders
Conditional Image Generation with PixelCNN DecodersConditional Image Generation with PixelCNN Decoders
Conditional Image Generation with PixelCNN Decoderssuga93
 
Safe and Efficient Off-Policy Reinforcement Learning
Safe and Efficient Off-Policy Reinforcement LearningSafe and Efficient Off-Policy Reinforcement Learning
Safe and Efficient Off-Policy Reinforcement Learningmooopan
 
Introduction of “Fairness in Learning: Classic and Contextual Bandits”
Introduction of “Fairness in Learning: Classic and Contextual Bandits”Introduction of “Fairness in Learning: Classic and Contextual Bandits”
Introduction of “Fairness in Learning: Classic and Contextual Bandits”Kazuto Fukuchi
 
Improving Variational Inference with Inverse Autoregressive Flow
Improving Variational Inference with Inverse Autoregressive FlowImproving Variational Inference with Inverse Autoregressive Flow
Improving Variational Inference with Inverse Autoregressive FlowTatsuya Shirakawa
 
[DL輪読会]Convolutional Sequence to Sequence Learning
[DL輪読会]Convolutional Sequence to Sequence Learning[DL輪読会]Convolutional Sequence to Sequence Learning
[DL輪読会]Convolutional Sequence to Sequence LearningDeep Learning JP
 
論文紹介 Combining Model-Based and Model-Free Updates for Trajectory-Centric Rein...
論文紹介 Combining Model-Based and Model-Free Updates for Trajectory-Centric Rein...論文紹介 Combining Model-Based and Model-Free Updates for Trajectory-Centric Rein...
論文紹介 Combining Model-Based and Model-Free Updates for Trajectory-Centric Rein...Kusano Hitoshi
 
Differential privacy without sensitivity [NIPS2016読み会資料]
Differential privacy without sensitivity [NIPS2016読み会資料]Differential privacy without sensitivity [NIPS2016読み会資料]
Differential privacy without sensitivity [NIPS2016読み会資料]Kentaro Minami
 
Matching networks for one shot learning
Matching networks for one shot learningMatching networks for one shot learning
Matching networks for one shot learningKazuki Fujikawa
 
ICML2016読み会　概要紹介
ICML2016読み会　概要紹介ICML2016読み会　概要紹介
ICML2016読み会　概要紹介Kohei Hayashi
 
論文紹介 Pixel Recurrent Neural Networks
論文紹介 Pixel Recurrent Neural Networks論文紹介 Pixel Recurrent Neural Networks
論文紹介 Pixel Recurrent Neural NetworksSeiya Tokui
 
Deep Learning - The Past, Present and Future of Artificial Intelligence
Deep Learning - The Past, Present and Future of Artificial IntelligenceDeep Learning - The Past, Present and Future of Artificial Intelligence
Deep Learning - The Past, Present and Future of Artificial IntelligenceLukas Masuch
 

En vedette (19)

Value iteration networks
Value iteration networksValue iteration networks
Value iteration networks
 
InfoGAN: Interpretable Representation Learning by Information Maximizing Gen...
InfoGAN: Interpretable Representation Learning by Information Maximizing Gen...InfoGAN: Interpretable Representation Learning by Information Maximizing Gen...
InfoGAN: Interpretable Representation Learning by Information Maximizing Gen...
 
Dual Learning for Machine Translation (NIPS 2016)
Dual Learning for Machine Translation (NIPS 2016)Dual Learning for Machine Translation (NIPS 2016)
Dual Learning for Machine Translation (NIPS 2016)
 
時系列データ3
時系列データ3時系列データ3
時系列データ3
 
Fast and Probvably Seedings for k-Means
Fast and Probvably Seedings for k-MeansFast and Probvably Seedings for k-Means
Fast and Probvably Seedings for k-Means
 
Interaction Networks for Learning about Objects, Relations and Physics
Interaction Networks for Learning about Objects, Relations and PhysicsInteraction Networks for Learning about Objects, Relations and Physics
Interaction Networks for Learning about Objects, Relations and Physics
 
Introduction of "TrailBlazer" algorithm
Introduction of "TrailBlazer" algorithmIntroduction of "TrailBlazer" algorithm
Introduction of "TrailBlazer" algorithm
 
Learning to learn by gradient descent by gradient descent
Learning to learn by gradient descent by gradient descentLearning to learn by gradient descent by gradient descent
Learning to learn by gradient descent by gradient descent
 
Conditional Image Generation with PixelCNN Decoders
Conditional Image Generation with PixelCNN DecodersConditional Image Generation with PixelCNN Decoders
Conditional Image Generation with PixelCNN Decoders
 
Safe and Efficient Off-Policy Reinforcement Learning
Safe and Efficient Off-Policy Reinforcement LearningSafe and Efficient Off-Policy Reinforcement Learning
Safe and Efficient Off-Policy Reinforcement Learning
 
Introduction of “Fairness in Learning: Classic and Contextual Bandits”
Introduction of “Fairness in Learning: Classic and Contextual Bandits”Introduction of “Fairness in Learning: Classic and Contextual Bandits”
Introduction of “Fairness in Learning: Classic and Contextual Bandits”
 
Improving Variational Inference with Inverse Autoregressive Flow
Improving Variational Inference with Inverse Autoregressive FlowImproving Variational Inference with Inverse Autoregressive Flow
Improving Variational Inference with Inverse Autoregressive Flow
 
[DL輪読会]Convolutional Sequence to Sequence Learning
[DL輪読会]Convolutional Sequence to Sequence Learning[DL輪読会]Convolutional Sequence to Sequence Learning
[DL輪読会]Convolutional Sequence to Sequence Learning
 
論文紹介 Combining Model-Based and Model-Free Updates for Trajectory-Centric Rein...
論文紹介 Combining Model-Based and Model-Free Updates for Trajectory-Centric Rein...論文紹介 Combining Model-Based and Model-Free Updates for Trajectory-Centric Rein...
論文紹介 Combining Model-Based and Model-Free Updates for Trajectory-Centric Rein...
 
Differential privacy without sensitivity [NIPS2016読み会資料]
Differential privacy without sensitivity [NIPS2016読み会資料]Differential privacy without sensitivity [NIPS2016読み会資料]
Differential privacy without sensitivity [NIPS2016読み会資料]
 
Matching networks for one shot learning
Matching networks for one shot learningMatching networks for one shot learning
Matching networks for one shot learning
 
ICML2016読み会　概要紹介
ICML2016読み会　概要紹介ICML2016読み会　概要紹介
ICML2016読み会　概要紹介
 
論文紹介 Pixel Recurrent Neural Networks
論文紹介 Pixel Recurrent Neural Networks論文紹介 Pixel Recurrent Neural Networks
論文紹介 Pixel Recurrent Neural Networks
 
Deep Learning - The Past, Present and Future of Artificial Intelligence
Deep Learning - The Past, Present and Future of Artificial IntelligenceDeep Learning - The Past, Present and Future of Artificial Intelligence
Deep Learning - The Past, Present and Future of Artificial Intelligence
 

Similaire à NIPS 2016 Overview and Deep Learning Topics

Python for Data: Past, Present, Future (PyCon JP 2017 Keynote)
Python for Data: Past, Present, Future (PyCon JP 2017 Keynote)Python for Data: Past, Present, Future (PyCon JP 2017 Keynote)
Python for Data: Past, Present, Future (PyCon JP 2017 Keynote)Peter Wang
 
Achieving Software Assurance with Hybrid Analysis Mapping
Achieving Software Assurance with Hybrid Analysis Mapping Achieving Software Assurance with Hybrid Analysis Mapping
Achieving Software Assurance with Hybrid Analysis Mapping Denim Group
 
Deep Learningによる超解像の進歩
Deep Learningによる超解像の進歩Deep Learningによる超解像の進歩
Deep Learningによる超解像の進歩Hiroto Honda
 
What you need to know to start an AI company?
What you need to know to start an AI company?What you need to know to start an AI company?
What you need to know to start an AI company?Mo Patel
 
DataStax | Meaningful User Experience with Graph Data (Chris Lacava, Expero) ...
DataStax | Meaningful User Experience with Graph Data (Chris Lacava, Expero) ...DataStax | Meaningful User Experience with Graph Data (Chris Lacava, Expero) ...
DataStax | Meaningful User Experience with Graph Data (Chris Lacava, Expero) ...DataStax
 
IBM Power Systems Update 2Q17
IBM Power Systems Update 2Q17IBM Power Systems Update 2Q17
IBM Power Systems Update 2Q17David Spurway
 
NAT64/DNS64 experiments, warnings and one useful tool
NAT64/DNS64 experiments, warnings and one useful toolNAT64/DNS64 experiments, warnings and one useful tool
NAT64/DNS64 experiments, warnings and one useful toolAPNIC
 
20160809_Keynote4_WD_Sivaram
20160809_Keynote4_WD_Sivaram20160809_Keynote4_WD_Sivaram
20160809_Keynote4_WD_SivaramSiva Sivaram
 
OpenPOWER SC16 Recap: Day 2
OpenPOWER SC16 Recap: Day 2OpenPOWER SC16 Recap: Day 2
OpenPOWER SC16 Recap: Day 2OpenPOWERorg
 
Demystifying Deep Learning - Roberto Paredes Palacios @ PAPIs Connect
Demystifying Deep Learning - Roberto Paredes Palacios @ PAPIs ConnectDemystifying Deep Learning - Roberto Paredes Palacios @ PAPIs Connect
Demystifying Deep Learning - Roberto Paredes Palacios @ PAPIs ConnectPAPIs.io
 
Meaningful User Experience
Meaningful User ExperienceMeaningful User Experience
Meaningful User ExperienceNeo4j
 
Fiducia & GAD IT AG: From Fraud Detection to Big Data Platform: Bringing Hado...
Fiducia & GAD IT AG: From Fraud Detection to Big Data Platform: Bringing Hado...Fiducia & GAD IT AG: From Fraud Detection to Big Data Platform: Bringing Hado...
Fiducia & GAD IT AG: From Fraud Detection to Big Data Platform: Bringing Hado...Seeling Cheung
 
SAAS IS THE ENEMY OF OPEN SOURCE GOOD THING THAT WE ARE IN THE POST-SAAS ERA
SAAS IS THE ENEMY OF OPEN SOURCE GOOD THING THAT WE ARE IN THE POST-SAAS ERASAAS IS THE ENEMY OF OPEN SOURCE GOOD THING THAT WE ARE IN THE POST-SAAS ERA
SAAS IS THE ENEMY OF OPEN SOURCE GOOD THING THAT WE ARE IN THE POST-SAAS ERAOri Pekelman
 
Cwin16 tls-datalab for scientists
Cwin16 tls-datalab for scientistsCwin16 tls-datalab for scientists
Cwin16 tls-datalab for scientistsCapgemini
 
Image Segmentation: Approaches and Challenges
Image Segmentation: Approaches and ChallengesImage Segmentation: Approaches and Challenges
Image Segmentation: Approaches and ChallengesApache MXNet
 
GTC Europe 2017 Keynote
GTC Europe 2017 KeynoteGTC Europe 2017 Keynote
GTC Europe 2017 KeynoteNVIDIA
 

Similaire à NIPS 2016 Overview and Deep Learning Topics (20)

Python for Data: Past, Present, Future (PyCon JP 2017 Keynote)
Python for Data: Past, Present, Future (PyCon JP 2017 Keynote)Python for Data: Past, Present, Future (PyCon JP 2017 Keynote)
Python for Data: Past, Present, Future (PyCon JP 2017 Keynote)
 
Achieving Software Assurance with Hybrid Analysis Mapping
Achieving Software Assurance with Hybrid Analysis Mapping Achieving Software Assurance with Hybrid Analysis Mapping
Achieving Software Assurance with Hybrid Analysis Mapping
 
PROTEUS H2020 at Ficloud2016
PROTEUS H2020 at Ficloud2016PROTEUS H2020 at Ficloud2016
PROTEUS H2020 at Ficloud2016
 
Deep Learningによる超解像の進歩
Deep Learningによる超解像の進歩Deep Learningによる超解像の進歩
Deep Learningによる超解像の進歩
 
What you need to know to start an AI company?
What you need to know to start an AI company?What you need to know to start an AI company?
What you need to know to start an AI company?
 
DataStax | Meaningful User Experience with Graph Data (Chris Lacava, Expero) ...
DataStax | Meaningful User Experience with Graph Data (Chris Lacava, Expero) ...DataStax | Meaningful User Experience with Graph Data (Chris Lacava, Expero) ...
DataStax | Meaningful User Experience with Graph Data (Chris Lacava, Expero) ...
 
IBM Power Systems Update 2Q17
IBM Power Systems Update 2Q17IBM Power Systems Update 2Q17
IBM Power Systems Update 2Q17
 
NAT64/DNS64 experiments, warnings and one useful tool
NAT64/DNS64 experiments, warnings and one useful toolNAT64/DNS64 experiments, warnings and one useful tool
NAT64/DNS64 experiments, warnings and one useful tool
 
Benchmarking Linked Data Introductory Remarks
Benchmarking Linked Data Introductory RemarksBenchmarking Linked Data Introductory Remarks
Benchmarking Linked Data Introductory Remarks
 
20160809_Keynote4_WD_Sivaram
20160809_Keynote4_WD_Sivaram20160809_Keynote4_WD_Sivaram
20160809_Keynote4_WD_Sivaram
 
ION Durban - NAT64/DNS64 Experiments and the NAT64Check Tool
ION Durban - NAT64/DNS64 Experiments and the NAT64Check ToolION Durban - NAT64/DNS64 Experiments and the NAT64Check Tool
ION Durban - NAT64/DNS64 Experiments and the NAT64Check Tool
 
OpenPOWER SC16 Recap: Day 2
OpenPOWER SC16 Recap: Day 2OpenPOWER SC16 Recap: Day 2
OpenPOWER SC16 Recap: Day 2
 
Demystifying Deep Learning - Roberto Paredes Palacios @ PAPIs Connect
Demystifying Deep Learning - Roberto Paredes Palacios @ PAPIs ConnectDemystifying Deep Learning - Roberto Paredes Palacios @ PAPIs Connect
Demystifying Deep Learning - Roberto Paredes Palacios @ PAPIs Connect
 
Meaningful User Experience
Meaningful User ExperienceMeaningful User Experience
Meaningful User Experience
 
Fiducia & GAD IT AG: From Fraud Detection to Big Data Platform: Bringing Hado...
Fiducia & GAD IT AG: From Fraud Detection to Big Data Platform: Bringing Hado...Fiducia & GAD IT AG: From Fraud Detection to Big Data Platform: Bringing Hado...
Fiducia & GAD IT AG: From Fraud Detection to Big Data Platform: Bringing Hado...
 
SAAS IS THE ENEMY OF OPEN SOURCE GOOD THING THAT WE ARE IN THE POST-SAAS ERA
SAAS IS THE ENEMY OF OPEN SOURCE GOOD THING THAT WE ARE IN THE POST-SAAS ERASAAS IS THE ENEMY OF OPEN SOURCE GOOD THING THAT WE ARE IN THE POST-SAAS ERA
SAAS IS THE ENEMY OF OPEN SOURCE GOOD THING THAT WE ARE IN THE POST-SAAS ERA
 
Cwin16 tls-datalab for scientists
Cwin16 tls-datalab for scientistsCwin16 tls-datalab for scientists
Cwin16 tls-datalab for scientists
 
Image Segmentation: Approaches and Challenges
Image Segmentation: Approaches and ChallengesImage Segmentation: Approaches and Challenges
Image Segmentation: Approaches and Challenges
 
GTC Europe 2017 Keynote
GTC Europe 2017 KeynoteGTC Europe 2017 Keynote
GTC Europe 2017 Keynote
 
Janus conf'19: janus client side
Janus conf'19: janus client sideJanus conf'19: janus client side
Janus conf'19: janus client side
 

Plus de Koichi Hamada

Generative Adversarial Networks (GAN) @ NIPS2017
Generative Adversarial Networks (GAN) @ NIPS2017Generative Adversarial Networks (GAN) @ NIPS2017
Generative Adversarial Networks (GAN) @ NIPS2017Koichi Hamada
 
DeNAのAI活用したサービス開発
DeNAのAI活用したサービス開発DeNAのAI活用したサービス開発
DeNAのAI活用したサービス開発Koichi Hamada
 
対話返答生成における個性の追加反映
対話返答生成における個性の追加反映対話返答生成における個性の追加反映
対話返答生成における個性の追加反映Koichi Hamada
 
DeNAの機械学習・深層学習活用した 体験提供の挑戦
DeNAの機械学習・深層学習活用した 体験提供の挑戦DeNAの機械学習・深層学習活用した 体験提供の挑戦
DeNAの機械学習・深層学習活用した 体験提供の挑戦Koichi Hamada
 
Laplacian Pyramid of Generative Adversarial Networks (LAPGAN) - NIPS2015読み会 #...
Laplacian Pyramid of Generative Adversarial Networks (LAPGAN) - NIPS2015読み会 #...Laplacian Pyramid of Generative Adversarial Networks (LAPGAN) - NIPS2015読み会 #...
Laplacian Pyramid of Generative Adversarial Networks (LAPGAN) - NIPS2015読み会 #...Koichi Hamada
 
DeNAの大規模データマイニング活用したサービス開発
DeNAの大規模データマイニング活用したサービス開発DeNAの大規模データマイニング活用したサービス開発
DeNAの大規模データマイニング活用したサービス開発Koichi Hamada
 
『MobageのAnalytics活用したサービス開発』 - データマイニングCROSS2014 #CROSS2014
『MobageのAnalytics活用したサービス開発』 - データマイニングCROSS2014 #CROSS2014『MobageのAnalytics活用したサービス開発』 - データマイニングCROSS2014 #CROSS2014
『MobageのAnalytics活用したサービス開発』 - データマイニングCROSS2014 #CROSS2014Koichi Hamada
 
『Mobageの大規模データマイニング活用と 意思決定』- #IBIS 2012 -ビジネスと機械学習の接点-
『Mobageの大規模データマイニング活用と 意思決定』- #IBIS 2012 -ビジネスと機械学習の接点- 『Mobageの大規模データマイニング活用と 意思決定』- #IBIS 2012 -ビジネスと機械学習の接点-
『Mobageの大規模データマイニング活用と 意思決定』- #IBIS 2012 -ビジネスと機械学習の接点- Koichi Hamada
 
複雑ネットワーク上の伝搬法則の数理
複雑ネットワーク上の伝搬法則の数理複雑ネットワーク上の伝搬法則の数理
複雑ネットワーク上の伝搬法則の数理Koichi Hamada
 
データマイニングCROSS 2012 Opening Talk - データマイニングの実サービス・ビジネス適用と展望
データマイニングCROSS 2012 Opening Talk - データマイニングの実サービス・ビジネス適用と展望 データマイニングCROSS 2012 Opening Talk - データマイニングの実サービス・ビジネス適用と展望
データマイニングCROSS 2012 Opening Talk - データマイニングの実サービス・ビジネス適用と展望 Koichi Hamada
 
データマイニングCROSS 第２部－機械学習・大規模分散処理
データマイニングCROSS 第２部－機械学習・大規模分散処理データマイニングCROSS 第２部－機械学習・大規模分散処理
データマイニングCROSS 第２部－機械学習・大規模分散処理Koichi Hamada
 
Large Scale Data Mining of the Mobage Service - #PRMU 2011 #Mahout #Hadoop
Large Scale Data Mining of the Mobage Service - #PRMU 2011 #Mahout #HadoopLarge Scale Data Mining of the Mobage Service - #PRMU 2011 #Mahout #Hadoop
Large Scale Data Mining of the Mobage Service - #PRMU 2011 #Mahout #HadoopKoichi Hamada
 
"Mahout Recommendation" - #TokyoWebmining 14th
"Mahout Recommendation" - #TokyoWebmining 14th"Mahout Recommendation" - #TokyoWebmining 14th
"Mahout Recommendation" - #TokyoWebmining 14thKoichi Hamada
 
Mahout JP - #TokyoWebmining 11th #MahoutJP
Mahout JP - #TokyoWebmining 11th #MahoutJP Mahout JP - #TokyoWebmining 11th #MahoutJP
Mahout JP - #TokyoWebmining 11th #MahoutJP Koichi Hamada
 
10回開催記念 「データマイニング＋WEB ～データマイニング・機械学習活用による継続進化～」ー第10回データマイニング+WEB勉強会＠東京ー #Toky...
10回開催記念 「データマイニング＋WEB ～データマイニング・機械学習活用による継続進化～」ー第10回データマイニング+WEB勉強会＠東京ー #Toky...10回開催記念 「データマイニング＋WEB ～データマイニング・機械学習活用による継続進化～」ー第10回データマイニング+WEB勉強会＠東京ー #Toky...
10回開催記念 「データマイニング＋WEB ～データマイニング・機械学習活用による継続進化～」ー第10回データマイニング+WEB勉強会＠東京ー #Toky...Koichi Hamada
 
『モバゲーの大規模データマイニング基盤におけるHadoop活用』－Hadoop Conference Japan 2011－ #hcj2011
『モバゲーの大規模データマイニング基盤におけるHadoop活用』－Hadoop Conference Japan 2011－ #hcj2011 『モバゲーの大規模データマイニング基盤におけるHadoop活用』－Hadoop Conference Japan 2011－ #hcj2011
『モバゲーの大規模データマイニング基盤におけるHadoop活用』－Hadoop Conference Japan 2011－ #hcj2011 Koichi Hamada
 
「R言語による Random Forest 徹底入門 －集団学習による分類・予測－」 - #TokyoR #11
「R言語による Random Forest 徹底入門 －集団学習による分類・予測－」 - #TokyoR #11「R言語による Random Forest 徹底入門 －集団学習による分類・予測－」 - #TokyoR #11
「R言語による Random Forest 徹底入門 －集団学習による分類・予測－」 - #TokyoR #11Koichi Hamada
 
Mahout Canopy Clustering - #TokyoWebmining 9
Mahout Canopy Clustering - #TokyoWebmining 9Mahout Canopy Clustering - #TokyoWebmining 9
Mahout Canopy Clustering - #TokyoWebmining 9Koichi Hamada
 
Apache Mahout - Random Forests - #TokyoWebmining #8
Apache Mahout - Random Forests - #TokyoWebmining #8 Apache Mahout - Random Forests - #TokyoWebmining #8
Apache Mahout - Random Forests - #TokyoWebmining #8 Koichi Hamada
 
「樹木モデルとランダムフォレスト－機械学習による分類・予測－」－データマイニングセミナー
「樹木モデルとランダムフォレスト－機械学習による分類・予測－」－データマイニングセミナー「樹木モデルとランダムフォレスト－機械学習による分類・予測－」－データマイニングセミナー
「樹木モデルとランダムフォレスト－機械学習による分類・予測－」－データマイニングセミナーKoichi Hamada
 

Plus de Koichi Hamada (20)

Generative Adversarial Networks (GAN) @ NIPS2017
Generative Adversarial Networks (GAN) @ NIPS2017Generative Adversarial Networks (GAN) @ NIPS2017
Generative Adversarial Networks (GAN) @ NIPS2017
 
DeNAのAI活用したサービス開発
DeNAのAI活用したサービス開発DeNAのAI活用したサービス開発
DeNAのAI活用したサービス開発
 
対話返答生成における個性の追加反映
対話返答生成における個性の追加反映対話返答生成における個性の追加反映
対話返答生成における個性の追加反映
 
DeNAの機械学習・深層学習活用した 体験提供の挑戦
DeNAの機械学習・深層学習活用した 体験提供の挑戦DeNAの機械学習・深層学習活用した 体験提供の挑戦
DeNAの機械学習・深層学習活用した 体験提供の挑戦
 
Laplacian Pyramid of Generative Adversarial Networks (LAPGAN) - NIPS2015読み会 #...
Laplacian Pyramid of Generative Adversarial Networks (LAPGAN) - NIPS2015読み会 #...Laplacian Pyramid of Generative Adversarial Networks (LAPGAN) - NIPS2015読み会 #...
Laplacian Pyramid of Generative Adversarial Networks (LAPGAN) - NIPS2015読み会 #...
 
DeNAの大規模データマイニング活用したサービス開発
DeNAの大規模データマイニング活用したサービス開発DeNAの大規模データマイニング活用したサービス開発
DeNAの大規模データマイニング活用したサービス開発
 
『MobageのAnalytics活用したサービス開発』 - データマイニングCROSS2014 #CROSS2014
『MobageのAnalytics活用したサービス開発』 - データマイニングCROSS2014 #CROSS2014『MobageのAnalytics活用したサービス開発』 - データマイニングCROSS2014 #CROSS2014
『MobageのAnalytics活用したサービス開発』 - データマイニングCROSS2014 #CROSS2014
 
『Mobageの大規模データマイニング活用と 意思決定』- #IBIS 2012 -ビジネスと機械学習の接点-
『Mobageの大規模データマイニング活用と 意思決定』- #IBIS 2012 -ビジネスと機械学習の接点- 『Mobageの大規模データマイニング活用と 意思決定』- #IBIS 2012 -ビジネスと機械学習の接点-
『Mobageの大規模データマイニング活用と 意思決定』- #IBIS 2012 -ビジネスと機械学習の接点-
 
複雑ネットワーク上の伝搬法則の数理
複雑ネットワーク上の伝搬法則の数理複雑ネットワーク上の伝搬法則の数理
複雑ネットワーク上の伝搬法則の数理
 
データマイニングCROSS 2012 Opening Talk - データマイニングの実サービス・ビジネス適用と展望
データマイニングCROSS 2012 Opening Talk - データマイニングの実サービス・ビジネス適用と展望 データマイニングCROSS 2012 Opening Talk - データマイニングの実サービス・ビジネス適用と展望
データマイニングCROSS 2012 Opening Talk - データマイニングの実サービス・ビジネス適用と展望
 
データマイニングCROSS 第２部－機械学習・大規模分散処理
データマイニングCROSS 第２部－機械学習・大規模分散処理データマイニングCROSS 第２部－機械学習・大規模分散処理
データマイニングCROSS 第２部－機械学習・大規模分散処理
 
Large Scale Data Mining of the Mobage Service - #PRMU 2011 #Mahout #Hadoop
Large Scale Data Mining of the Mobage Service - #PRMU 2011 #Mahout #HadoopLarge Scale Data Mining of the Mobage Service - #PRMU 2011 #Mahout #Hadoop
Large Scale Data Mining of the Mobage Service - #PRMU 2011 #Mahout #Hadoop
 
"Mahout Recommendation" - #TokyoWebmining 14th
"Mahout Recommendation" - #TokyoWebmining 14th"Mahout Recommendation" - #TokyoWebmining 14th
"Mahout Recommendation" - #TokyoWebmining 14th
 
Mahout JP - #TokyoWebmining 11th #MahoutJP
Mahout JP - #TokyoWebmining 11th #MahoutJP Mahout JP - #TokyoWebmining 11th #MahoutJP
Mahout JP - #TokyoWebmining 11th #MahoutJP
 
10回開催記念 「データマイニング＋WEB ～データマイニング・機械学習活用による継続進化～」ー第10回データマイニング+WEB勉強会＠東京ー #Toky...
10回開催記念 「データマイニング＋WEB ～データマイニング・機械学習活用による継続進化～」ー第10回データマイニング+WEB勉強会＠東京ー #Toky...10回開催記念 「データマイニング＋WEB ～データマイニング・機械学習活用による継続進化～」ー第10回データマイニング+WEB勉強会＠東京ー #Toky...
10回開催記念 「データマイニング＋WEB ～データマイニング・機械学習活用による継続進化～」ー第10回データマイニング+WEB勉強会＠東京ー #Toky...
 
『モバゲーの大規模データマイニング基盤におけるHadoop活用』－Hadoop Conference Japan 2011－ #hcj2011
『モバゲーの大規模データマイニング基盤におけるHadoop活用』－Hadoop Conference Japan 2011－ #hcj2011 『モバゲーの大規模データマイニング基盤におけるHadoop活用』－Hadoop Conference Japan 2011－ #hcj2011
『モバゲーの大規模データマイニング基盤におけるHadoop活用』－Hadoop Conference Japan 2011－ #hcj2011
 
「R言語による Random Forest 徹底入門 －集団学習による分類・予測－」 - #TokyoR #11
「R言語による Random Forest 徹底入門 －集団学習による分類・予測－」 - #TokyoR #11「R言語による Random Forest 徹底入門 －集団学習による分類・予測－」 - #TokyoR #11
「R言語による Random Forest 徹底入門 －集団学習による分類・予測－」 - #TokyoR #11
 
Mahout Canopy Clustering - #TokyoWebmining 9
Mahout Canopy Clustering - #TokyoWebmining 9Mahout Canopy Clustering - #TokyoWebmining 9
Mahout Canopy Clustering - #TokyoWebmining 9
 
Apache Mahout - Random Forests - #TokyoWebmining #8
Apache Mahout - Random Forests - #TokyoWebmining #8 Apache Mahout - Random Forests - #TokyoWebmining #8
Apache Mahout - Random Forests - #TokyoWebmining #8
 
「樹木モデルとランダムフォレスト－機械学習による分類・予測－」－データマイニングセミナー
「樹木モデルとランダムフォレスト－機械学習による分類・予測－」－データマイニングセミナー「樹木モデルとランダムフォレスト－機械学習による分類・予測－」－データマイニングセミナー
「樹木モデルとランダムフォレスト－機械学習による分類・予測－」－データマイニングセミナー
 

Dernier

Pests of soyabean_Binomics_IdentificationDr.UPR.pdf
Pests of soyabean_Binomics_IdentificationDr.UPR.pdfPests of soyabean_Binomics_IdentificationDr.UPR.pdf
Pests of soyabean_Binomics_IdentificationDr.UPR.pdfPirithiRaju
 
GLYCOSIDES Classification Of GLYCOSIDES Chemical Tests Glycosides
GLYCOSIDES Classification Of GLYCOSIDES Chemical Tests GlycosidesGLYCOSIDES Classification Of GLYCOSIDES Chemical Tests Glycosides
GLYCOSIDES Classification Of GLYCOSIDES Chemical Tests GlycosidesNandakishor Bhaurao Deshmukh
 
well logging & petrophysical analysis.pptx
well logging & petrophysical analysis.pptxwell logging & petrophysical analysis.pptx
well logging & petrophysical analysis.pptxzaydmeerab121
 
Ai in communication electronicss[1].pptx
Ai in communication electronicss[1].pptxAi in communication electronicss[1].pptx
Ai in communication electronicss[1].pptxsubscribeus100
 
《Queensland毕业文凭-昆士兰大学毕业证成绩单》
《Queensland毕业文凭-昆士兰大学毕业证成绩单》《Queensland毕业文凭-昆士兰大学毕业证成绩单》
《Queensland毕业文凭-昆士兰大学毕业证成绩单》rnrncn29
 
Thermodynamics ,types of system,formulae ,gibbs free energy .pptx
Thermodynamics ,types of system,formulae ,gibbs free energy .pptxThermodynamics ,types of system,formulae ,gibbs free energy .pptx
Thermodynamics ,types of system,formulae ,gibbs free energy .pptxuniversity
 
trihybrid cross , test cross chi squares
trihybrid cross , test cross chi squarestrihybrid cross , test cross chi squares
trihybrid cross , test cross chi squaresusmanzain586
 
FREE NURSING BUNDLE FOR NURSES.PDF by na
FREE NURSING BUNDLE FOR NURSES.PDF by naFREE NURSING BUNDLE FOR NURSES.PDF by na
FREE NURSING BUNDLE FOR NURSES.PDF by naJASISJULIANOELYNV
 
Introduction of Human Body & Structure of cell.pptx
Introduction of Human Body & Structure of cell.pptxIntroduction of Human Body & Structure of cell.pptx
Introduction of Human Body & Structure of cell.pptxMedical College
 
Four Spheres of the Earth Presentation.ppt
Four Spheres of the Earth Presentation.pptFour Spheres of the Earth Presentation.ppt
Four Spheres of the Earth Presentation.pptJoemSTuliba
 
Servosystem Theory / Cybernetic Theory by Petrovic
Servosystem Theory / Cybernetic Theory by PetrovicServosystem Theory / Cybernetic Theory by Petrovic
Servosystem Theory / Cybernetic Theory by PetrovicAditi Jain
 
Organic farming with special reference to vermiculture
Organic farming with special reference to vermicultureOrganic farming with special reference to vermiculture
Organic farming with special reference to vermicultureTakeleZike1
 
The dark energy paradox leads to a new structure of spacetime.pptx
The dark energy paradox leads to a new structure of spacetime.pptxThe dark energy paradox leads to a new structure of spacetime.pptx
The dark energy paradox leads to a new structure of spacetime.pptxEran Akiva Sinbar
 
REVISTA DE BIOLOGIA E CIÊNCIAS DA TERRA ISSN 1519-5228 - Artigo_Bioterra_V24_...
REVISTA DE BIOLOGIA E CIÊNCIAS DA TERRA ISSN 1519-5228 - Artigo_Bioterra_V24_...REVISTA DE BIOLOGIA E CIÊNCIAS DA TERRA ISSN 1519-5228 - Artigo_Bioterra_V24_...
REVISTA DE BIOLOGIA E CIÊNCIAS DA TERRA ISSN 1519-5228 - Artigo_Bioterra_V24_...Universidade Federal de Sergipe - UFS
 
Fertilization: Sperm and the egg—collectively called the gametes—fuse togethe...
Fertilization: Sperm and the egg—collectively called the gametes—fuse togethe...Fertilization: Sperm and the egg—collectively called the gametes—fuse togethe...
Fertilization: Sperm and the egg—collectively called the gametes—fuse togethe...D. B. S. College Kanpur
 
STOPPED FLOW METHOD & APPLICATION MURUGAVENI B.pptx
STOPPED FLOW METHOD & APPLICATION MURUGAVENI B.pptxSTOPPED FLOW METHOD & APPLICATION MURUGAVENI B.pptx
STOPPED FLOW METHOD & APPLICATION MURUGAVENI B.pptxMurugaveni B
 
Manassas R - Parkside Middle School 🌎🏫
Manassas R - Parkside Middle School 🌎🏫Manassas R - Parkside Middle School 🌎🏫
Manassas R - Parkside Middle School 🌎🏫qfactory1
 
Citronella presentation SlideShare mani upadhyay
Citronella presentation SlideShare mani upadhyayCitronella presentation SlideShare mani upadhyay
Citronella presentation SlideShare mani upadhyayupadhyaymani499
 
Call Girls in Majnu Ka Tilla Delhi 🔝9711014705🔝 Genuine
Call Girls in Majnu Ka Tilla Delhi 🔝9711014705🔝 GenuineCall Girls in Majnu Ka Tilla Delhi 🔝9711014705🔝 Genuine
Call Girls in Majnu Ka Tilla Delhi 🔝9711014705🔝 Genuinethapagita
 

Dernier (20)

Pests of soyabean_Binomics_IdentificationDr.UPR.pdf
Pests of soyabean_Binomics_IdentificationDr.UPR.pdfPests of soyabean_Binomics_IdentificationDr.UPR.pdf
Pests of soyabean_Binomics_IdentificationDr.UPR.pdf
 
GLYCOSIDES Classification Of GLYCOSIDES Chemical Tests Glycosides
GLYCOSIDES Classification Of GLYCOSIDES Chemical Tests GlycosidesGLYCOSIDES Classification Of GLYCOSIDES Chemical Tests Glycosides
GLYCOSIDES Classification Of GLYCOSIDES Chemical Tests Glycosides
 
well logging & petrophysical analysis.pptx
well logging & petrophysical analysis.pptxwell logging & petrophysical analysis.pptx
well logging & petrophysical analysis.pptx
 
Ai in communication electronicss[1].pptx
Ai in communication electronicss[1].pptxAi in communication electronicss[1].pptx
Ai in communication electronicss[1].pptx
 
《Queensland毕业文凭-昆士兰大学毕业证成绩单》
《Queensland毕业文凭-昆士兰大学毕业证成绩单》《Queensland毕业文凭-昆士兰大学毕业证成绩单》
《Queensland毕业文凭-昆士兰大学毕业证成绩单》
 
Let’s Say Someone Did Drop the Bomb. Then What?
Let’s Say Someone Did Drop the Bomb. Then What?Let’s Say Someone Did Drop the Bomb. Then What?
Let’s Say Someone Did Drop the Bomb. Then What?
 
Thermodynamics ,types of system,formulae ,gibbs free energy .pptx
Thermodynamics ,types of system,formulae ,gibbs free energy .pptxThermodynamics ,types of system,formulae ,gibbs free energy .pptx
Thermodynamics ,types of system,formulae ,gibbs free energy .pptx
 
trihybrid cross , test cross chi squares
trihybrid cross , test cross chi squarestrihybrid cross , test cross chi squares
trihybrid cross , test cross chi squares
 
FREE NURSING BUNDLE FOR NURSES.PDF by na
FREE NURSING BUNDLE FOR NURSES.PDF by naFREE NURSING BUNDLE FOR NURSES.PDF by na
FREE NURSING BUNDLE FOR NURSES.PDF by na
 
Introduction of Human Body & Structure of cell.pptx
Introduction of Human Body & Structure of cell.pptxIntroduction of Human Body & Structure of cell.pptx
Introduction of Human Body & Structure of cell.pptx
 
Four Spheres of the Earth Presentation.ppt
Four Spheres of the Earth Presentation.pptFour Spheres of the Earth Presentation.ppt
Four Spheres of the Earth Presentation.ppt
 
Servosystem Theory / Cybernetic Theory by Petrovic
Servosystem Theory / Cybernetic Theory by PetrovicServosystem Theory / Cybernetic Theory by Petrovic
Servosystem Theory / Cybernetic Theory by Petrovic
 
Organic farming with special reference to vermiculture
Organic farming with special reference to vermicultureOrganic farming with special reference to vermiculture
Organic farming with special reference to vermiculture
 
The dark energy paradox leads to a new structure of spacetime.pptx
The dark energy paradox leads to a new structure of spacetime.pptxThe dark energy paradox leads to a new structure of spacetime.pptx
The dark energy paradox leads to a new structure of spacetime.pptx
 
REVISTA DE BIOLOGIA E CIÊNCIAS DA TERRA ISSN 1519-5228 - Artigo_Bioterra_V24_...
REVISTA DE BIOLOGIA E CIÊNCIAS DA TERRA ISSN 1519-5228 - Artigo_Bioterra_V24_...REVISTA DE BIOLOGIA E CIÊNCIAS DA TERRA ISSN 1519-5228 - Artigo_Bioterra_V24_...
REVISTA DE BIOLOGIA E CIÊNCIAS DA TERRA ISSN 1519-5228 - Artigo_Bioterra_V24_...
 
Fertilization: Sperm and the egg—collectively called the gametes—fuse togethe...
Fertilization: Sperm and the egg—collectively called the gametes—fuse togethe...Fertilization: Sperm and the egg—collectively called the gametes—fuse togethe...
Fertilization: Sperm and the egg—collectively called the gametes—fuse togethe...
 
STOPPED FLOW METHOD & APPLICATION MURUGAVENI B.pptx
STOPPED FLOW METHOD & APPLICATION MURUGAVENI B.pptxSTOPPED FLOW METHOD & APPLICATION MURUGAVENI B.pptx
STOPPED FLOW METHOD & APPLICATION MURUGAVENI B.pptx
 
Manassas R - Parkside Middle School 🌎🏫
Manassas R - Parkside Middle School 🌎🏫Manassas R - Parkside Middle School 🌎🏫
Manassas R - Parkside Middle School 🌎🏫
 
Citronella presentation SlideShare mani upadhyay
Citronella presentation SlideShare mani upadhyayCitronella presentation SlideShare mani upadhyay
Citronella presentation SlideShare mani upadhyay
 
Call Girls in Majnu Ka Tilla Delhi 🔝9711014705🔝 Genuine
Call Girls in Majnu Ka Tilla Delhi 🔝9711014705🔝 GenuineCall Girls in Majnu Ka Tilla Delhi 🔝9711014705🔝 Genuine
Call Girls in Majnu Ka Tilla Delhi 🔝9711014705🔝 Genuine
 

NIPS 2016 Overview and Deep Learning Topics

  • 1. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. NIPS 2016 読み会 @Preferred Networks 2017/1/19 NIPS 2016 Overview and Deep Learning Topics @hamadakoichi 濱田晃一 Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved.
  • 2. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 2 AGENDA ◆Deep Learning Topics ◆NIPS 2016 Overview ◆Generative Adversarial Networks(GANs) ◆Recurrent Neural Networks(RNNs) ◆GANs ◆GANs in NIPS2016 ◆Recent GANs ◆RNNs in NIPS2016
  • 3. 3 Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. 講師 ・TokyoWebmining 主催者 　- 機械学習の実活用コミュニティ。登録人数 1500人超。 　- 7年継続、累積59回開催 濱田晃一 (@hamadakoichi) ・執筆：Mobageを支える技術 Analytics Architect ・博士 : 量子統計場の理論 (理論物理) ・DeNA全サービスを対象とし、大規模機械学習活用したサービス開発 　- 数千万ユーザー、50億アクション/日、テキスト、画像、ソーシャルグラフ 　- 体験設計から、分散学習アルゴリズムの設計・実装まで ・Deep Learning 　- 画像表現学習・画像生成 　　 対話・キャラクター表現学習、等
  • 4. 4 Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. AGENDA ◆Deep Learning Topics ◆NIPS 2016 Overview ◆Generative Adversarial Networks(GANs) ◆Recurrent Neural Networks(RNNs) ◆GANs ◆GANs in NIPS2016 ◆Recent GANs ◆RNNs in NIPS2016
  • 5. 5 Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. AGENDA ◆Deep Learning Topics ◆NIPS 2016 Overview ◆Generative Adversarial Networks(GANs) ◆Recurrent Neural Networks(RNNs) ◆GANs ◆GANs in NIPS2016 ◆Recent GANs ◆RNNs in NIPS2016
  • 6. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 6 NIPS 2016 ・第30回の開催 ・期間： 2016年12月5-10日 ・ICML 33回に続き長い伝統 ・チュートリアル: 5(1日) ・本会議: 5-8(4日) ・ワークショップ: 9-10(2日) ・開催地： バルセロナ(スペイン) 貼る：会場雰囲気
  • 7. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 7 NIPS 2016 参加者が 6000人に増加 (2015年の1.5倍) ※Terrence Sejnowskiは NIPS foundationの President
  • 8. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 8 NIPS Features ・採択の92%はポスター ・採択率: 23% ・投稿数: 2500+、採択数： 568 ・Oral(45) : 20分の口頭発表 + ポスター ・Poster(523) ： ポスターのみ ・少数トラックでの進行(最大3) （昨年までシングルトラックだったがパラレルに）
  • 9. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 9 NIPS Features ・ポスター発表による活発な議論 (昨年までの19-24時の5時間ポスターからは時間縮小したが、最後まで活発な議論） ・210 min(3.5 hour)/ day ・130 Poster x 4 days
  • 10. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 10 NIPS2016 Hot Topics 引用元： The review process for NIPS 2016 http://www.tml.cs.uni-tuebingen.de/team/ luxburg/misc/nips2016/index.php Deep Learning Computer Vision Large Scale Learning Learning Theory Optimization Sparsity
  • 11. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 11 NIPS2016 Hot Topics Tutorial 3/9、Symposium 2/3 が Deep Learning Reinforcement Learning, Generative Adversarial Net, Recurrent Net Tutorial Symposium
  • 12. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 12 NIPS2016 Hot Topics Tutorial Symposium Tutorial 3/9、Symposium 2/3 が Deep Learning Reinforcement Learning, Generative Adversarial Net, Recurrent Net 上記2トピックに関し、本会議論文をピックアップし概要紹介します (Reinforcement Learningは、このNIPS読み会での個別論文の発表も多いため)
  • 13. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 13 AGENDA ◆Deep Learning Topics ◆NIPS 2016 Overview ◆Generative Adversarial Networks(GANs) ◆Recurrent Neural Networks(RNNs) ◆GANs ◆GANs in NIPS2016 ◆Recent GANs ◆RNNs in NIPS2016
  • 14. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 14 AGENDA ◆Deep Learning Topics ◆NIPS 2016 Overview ◆Generative Adversarial Networks(GANs) ◆Recurrent Neural Networks(RNNs) ◆GANs ◆GANs in NIPS2016 ◆Recent GANs ◆RNNs in NIPS2016
  • 15. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 15 AGENDA ◆Deep Learning Topics ◆NIPS 2016 Overview ◆Generative Adversarial Networks(GANs) ◆Recurrent Neural Networks(RNNs) ◆GANs ◆GANs in NIPS2016 ◆Recent GANs ◆RNNs in NIPS2016
  • 16. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 16 Generative Adversarial Network (GAN) Generative Adversarial Nets(GAN) Goodfellow+, NIPS2014
  • 17. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 17 Generative Adversarial Network (GAN) Generator(生成器)と Discriminator(識別器)を戦わせ 生成精度を向上させる 識別器: “本物画像”と “生成器が作った偽画像”を識別する 生成器: 生成画像を識別器に“本物画像”と誤識別させようとする (Goodfellow+, NIPS2014, Deep Learning Workshop, Presentation)
  • 18. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 18 Generative Adversarial Network (GAN) Minimax Objective function Discriminator が 「本物画像」を「本物」と識別 (Goodfellow+, NIPS2014, Deep Learning Workshop, Presentation) Discriminator が 「生成画像」を「偽物」と識別する Discriminatorは 正しく識別しようとする （最大化） Generatorは Discriminator に誤識別させようとする（最小化） Generator(生成器)と Discriminator(識別器)を戦わせ 生成精度を向上させる
  • 19. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 19 自然画像の表現ベクトル空間学習・演算・画像生成 ICLR16: Deep Convolutional GAN : DCGAN (Radford+) 自然画像のクリアな画像生成 画像演算 Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks. Alec Radford, Luke Metz, Soumith Chintala. arXiv:1511.06434. In ICLR 2016.
  • 20. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 20 ICML16: Autoencoding beyond pixels (Larsen+) Autoencoding beyond pixels using a learned similarity metric. Anders Boesen Lindbo Larsen, Søren Kaae Sønderby, Hugo Larochelle, Ole Winther. arXiv:1512.09300. In ICML 2016. 自然画像の表現ベクトル空間学習・演算・画像生成
  • 21. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 21 ICML16: Generative Adversarial Text to Image Synthesis(Reed+) Generative Adversarial Text to Image Synthesis. Scott Reed, Zeynep Akata, Xinchen Yan, Lajanugen Logeswaran, Bernt Schiele, Honglak Lee. arXiv:1605.05396. In ICML 2016. 文章からの画像生成 文章で条件付したGAN
  • 22. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 22 AGENDA ◆Deep Learning Topics ◆NIPS 2016 Overview ◆Generative Adversarial Networks(GANs) ◆Recurrent Neural Networks(RNNs) ◆GANs ◆GANs in NIPS2016 ◆Recent GANs ◆RNNs in NIPS2016
  • 23. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 23 Generative Adversarial Text to Image Synthesis(Reed+) Learning What and Where to Draw. Scott Reed, Zeynep Akata, Santosh Mohan, Samuel Tenka, Bernt Schiele, Honglak Lee. arXiv:1610.02454. In NIPS 2016. 文章からの画像生成 表示位置情報も条件付したGAN
  • 24. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 24 InfoGAN (Chen+) InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Nets. Xi Chen, Yan Duan, Rein Houthooft, John Schulman, Ilya Sutskever, Pieter Abbeel. arXiv:1606.03657. In NIPS 2016 Latent code c、Generator 出力との Mutual Information を加え GANで狙って表現ベクトル空間を学習
  • 25. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 25 3Dモデルの表現ベクトル空間学習・演算・生成 3D GAN (Wu+) 3Dモデルの生成 3Dモデル演算 写真からの3Dモデル生成 3D VAE-GAN 3D GAN Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modeling. Jiajun Wu, Chengkai Zhang, Tianfan Xue, William T. Freeman, Joshua B. Tenenbaum. arXiv:1610.07584. In NIPS 2016.
  • 26. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 26 Generating Videos with Scene Dynamics(Vondrick+) 動画の表現ベクトル空間学習・動画生成 Generating Videos with Scene Dynamics. Carl Vondrick, Hamed Pirsiavash, Antonio Torralba. In NIPS 2016. http://web.mit.edu/vondrick/tinyvideo/ 動画生成 1画像からその後の動画生成
  • 27. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 27 f-GAN (Nowozin+) GAN目的関数を Symmetric JS-divergence から f-divergence に一般化。各Divergence を用い学習・評価 f-GAN: Training Generative Neural samplers using variational Divergence Minimization. Sebastian Nowozin, Botond Cseke, Ryota Tomioka. arXiv:1606.00709. In NIPS 2016. Kernel Density Estimation on the MNIST f-divergence LSUN
  • 28. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 28 Improved Techniques for Training GANs (Salimans+) Improved Techniques for Training GANs. Tim Salimans, Ian Goodfellow, Wojciech Zaremba, Vicki Cheung, Alec Radford, Xi Chen. arXiv:1606.03498. In NIPS 2016. 収束が難しいGANの学習方法論 GAN半教師あり学習 1. Feature Matching 2. Minibatch discrimination 3. Historical averaging 4. One-sided label smoothing 5. Virtual batch normalization Techniques Semi-supervised learning MNIST Semi-supervised training with feature matching Semi-supervised training with feature matching and minibatch discrimination CIFAR-10 Generated samples
  • 29. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 29 AGENDA ◆Deep Learning Topics ◆NIPS 2016 Overview ◆Generative Adversarial Networks(GANs) ◆Recurrent Neural Networks(RNNs) ◆GANs ◆GANs in NIPS2016 ◆Recent GANs ◆RNNs in NIPS2016
  • 30. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 30 Extended Architectures for Generative Adversarial Nets 2016 Extended Architectures for GANs Figure by Chris Olah (2016) : https://twitter.com/ch402/status/793535193835417601 Ex) Conditional Image Synthesis With Auxiliary Classifier GANs. Augustus Odena, Christopher Olah, Jonathon Shlens. arXiv:1610.09585. Generative Adversarial Net の各種拡張
  • 31. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 31 Stack GAN: Text to PhotoRealistic Image Synthesis(Zhang+2016) 1段目で文章から低解像度画像を生成 2段目で低解像度画像から高解像度画像を生成 StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generative Adversarial Networks. Han Zhang, Tao Xu, Hongsheng Li, Shaoting Zhang, Xiaolei Huang, Xiaogang Wang, Dimitris Metaxas. arXiv:1612.03242.
  • 32. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 32 Plug & Play Generative Networks (Nguyen+2016) 高解像度な画像生成 227 x 227 ImageNet Plug & Play Generative Networks: Conditional Iterative Generation of Images in Latent Space. Anh Nguyen, Jason Yosinski, Yoshua Bengio, Alexey Dosovitskiy, Jeff Clune. arXiv:1612.00005.
  • 33. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 33 AGENDA ◆Deep Learning Topics ◆NIPS 2016 Overview ◆Generative Adversarial Networks(GANs) ◆Recurrent Neural Networks(RNNs) ◆GANs ◆GANs in NIPS2016 ◆Recent GANs ◆RNNs in NIPS2016
  • 34. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 34 Phased LSTM (Neil+) 時間で開閉するGateを導入した LSTM Sensor Data 等、Event 駆動の長期系列特徴を学習 Phased LSTM: Accelerating Recurrent Network Training for Long or Event-based Sequences. Daniel Neil, Michael Pfeiffer, Shih-Chii Liu. arXiv:1610.09513. In NIPS 2016. LSTM Phased LSTM Phased LSTM Behavior Frequency Discrimination Task
  • 35. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 35 Using Fast Weights to Attend to the Recent Past (Ba+) 早く学習・減衰する Fast Weight 追加で、系列固有の情報を扱う Slow Weight での長期特徴とあわせ、双方の系列特徴を学習 Using Fast Weights to Attend to the Recent Past. Jimmy Ba, Geoffrey Hinton, Volodymyr Mnih, Joel Z. Leibo, Catalin Ionescu. arXiv:1610.06258. In NIPS 2016. Associative Retrieval Task Classification Error Test Log Likelihood
  • 36. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 36 Learning to learn by GD by GD (Andrychowicz+) LSTMを用いたOptimizer Parameterごとに 勾配系列から適切な次の更新量を算出 Learning to learn by gradient descent by gradient descent. Marcin Andrychowicz, Misha Denil, Sergio Gomez, Matthew W. Hoffman, David Pfau, Tom Schaul, Brendan Shillingford, Nando de Freitas. arXiv:1606.04474. In NIPS 2016.
  • 37. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 37 Matching Network for One Shot Learning (Vinyals+) Attention Mechanism を用いた One Shot Learning 参照構造を学習しておき、新規小規模データセットでも高精度で動作 Matching Networks for One Shot Learning. Oriol Vinyals, Charles Blundell, Timothy Lillicrap, Koray Kavukcuoglu, Daan Wierstra. arXiv:1606.04080. In NIPS 2016. Omniglot miniImageNet
  • 38. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 38 AGENDA ◆Deep Learning Topics ◆NIPS 2016 Overview ◆Generative Adversarial Networks(GANs) ◆Recurrent Neural Networks(RNNs) ◆GANs ◆GANs in NIPS2016 ◆Recent GANs ◆RNNs in NIPS2016