SlideShare une entreprise Scribd logo
1  sur  19
Télécharger pour lire hors ligne
GeoNotebook
An extension to the Jupyter Notebook for
exploratory geospatial analysis
Christopher Kotfila, Aashish Chaudhary - Kitware Inc.
Petr Votava - NASA Ames
FOSS4G 2017
What is GeoNotebook?
● Python & Javascript extensions to Jupyter Notebook
○ Interactive map connected to python execution
environment via RPC.
○ Integrated tile server for rendering geospatial data onto
the map.
● Supports interactive exploration and subsetting of
geospatial data (especially raster data).
Demonstration
Development Context
● NASA ESTO - AIST 2014 Grant
○ Public cloud tools for extending analysis capabilities.
○ Bring analysis to the data, rather than data to the analyst
● NASA Earth Exchange (NEX) @ NASA Ames
○ Portal for collaborative sharing network for researchers
○ Large scale data processing pipelines for enabling ‘science-quality’
satellite data products.
Technical Objectives
● No assumptions about relationship between data access
and data visualisation.
○ Data access always at native resolution
● Support custom visualisation/data sources via third party
python packages
● Sensible defaults; target “traditional” Jupyter user.
Technical Stack
● GDAL - file I/O with custom VRT generation
● Mapnik - styling and orchestration of downsampling
● KTile - TileStache fork for serving tiles
● Jupyter Notebook - plugins + custom python kernel
● GeoJS/OpenLayers - interactive presentation of map
Current Limitations
● Complex deployment of tile rendering stack
(Mapnik/GDAL); docker image available
● Re-rendering transformations of data subsets (e.g
rendering in-memory data).
● Interactive elements break some of the implicit promises
about reproducibility of notebooks.
Call to Action
● Originally developed as a demonstration of what was
possible for Q/A on NEX data processing pipelines.
● Still early days
○ Apache 2.0 licensed software seeks interested
community of users & contributors.
○ Cathedral and the Bazaar - “plausible promise”
Many Thanks!
Contributing projects:
GDAL, Mapnik, TileStache, Jupyter Notebook, NumPy, Fiona,
Shapely, Rasterio, Pytest and many others.
Contributing humans:
Mike Little†, Raman Nemani†, Petr Votava, Andrew
Michaelis†, Jon Beazley‡, Doruk Ozturk‡, Dan Lamanna‡
† NASA, ‡ Kitware Inc.
Questions!
Github: OpenGeoscience/geonotebook
Gitter: gitter.im/OpenGeoscience/geonotebook
RTD: geonotebook.readthedocs.io
Email: chris.kotfila@kitware.com
docker run --net=host -v /path/to/notebooks:/notebooks
geonotebook/geonotebook:latest
Additional Slides
Nascent Geotrellis integration
Geotrellis & GeoPySpark
Deep Learning for Semantic Segmentation of Aerial Imagery
GeoNotebook: Interactive geospatial analysis in Jupyter
GeoNotebook: Interactive geospatial analysis in Jupyter
GeoNotebook: Interactive geospatial analysis in Jupyter
GeoNotebook: Interactive geospatial analysis in Jupyter

Contenu connexe

Tendances

Open source web-gis packages, geoserver-rest and pySLD
Open source web-gis packages, geoserver-rest and pySLDOpen source web-gis packages, geoserver-rest and pySLD
Open source web-gis packages, geoserver-rest and pySLDTek Kshetri
 
Cartaro - Geospatial CMS (en)
Cartaro - Geospatial CMS (en)Cartaro - Geospatial CMS (en)
Cartaro - Geospatial CMS (en)Uli Müller
 
ePOM - Intro to Ocean Data Science - Data Visualization
ePOM - Intro to Ocean Data Science - Data VisualizationePOM - Intro to Ocean Data Science - Data Visualization
ePOM - Intro to Ocean Data Science - Data VisualizationGiuseppe Masetti
 
NASA Earth Exchange (NEX) Overview
NASA Earth Exchange (NEX) OverviewNASA Earth Exchange (NEX) Overview
NASA Earth Exchange (NEX) OverviewPlanet OS
 
Implementing an Open Source Spatiotemporal Search Platform for Spatial Data I...
Implementing an Open Source Spatiotemporal Search Platform for Spatial Data I...Implementing an Open Source Spatiotemporal Search Platform for Spatial Data I...
Implementing an Open Source Spatiotemporal Search Platform for Spatial Data I...Paolo Corti
 
Tran Minh: big data platform in high performance computing at NISCI
Tran Minh: big data platform in high performance computing at NISCITran Minh: big data platform in high performance computing at NISCI
Tran Minh: big data platform in high performance computing at NISCIVu Hung Nguyen
 
Hack reduce introduction
Hack reduce introductionHack reduce introduction
Hack reduce introductionmontrealouvert
 
Schema, JSON-LD & the semantic web - Brighton SEO April 2015 - Kirsty Hulse -...
Schema, JSON-LD & the semantic web - Brighton SEO April 2015 - Kirsty Hulse -...Schema, JSON-LD & the semantic web - Brighton SEO April 2015 - Kirsty Hulse -...
Schema, JSON-LD & the semantic web - Brighton SEO April 2015 - Kirsty Hulse -...Linkdex
 
Open source based software ‘gxt’ mangosystem
Open source based software ‘gxt’ mangosystemOpen source based software ‘gxt’ mangosystem
Open source based software ‘gxt’ mangosystemHaNJiN Lee
 
PINOGIO : A simple way to create a web infographic map (피노지오 : 웹 인포그래픽 맵을 만드는...
PINOGIO : A simple way to create a web infographic map (피노지오 : 웹 인포그래픽 맵을 만드는...PINOGIO : A simple way to create a web infographic map (피노지오 : 웹 인포그래픽 맵을 만드는...
PINOGIO : A simple way to create a web infographic map (피노지오 : 웹 인포그래픽 맵을 만드는...HaNJiN Lee
 
[2019 Strata] Self Sevice BI meets Geospatial Analysis
[2019 Strata] Self Sevice BI meets Geospatial Analysis[2019 Strata] Self Sevice BI meets Geospatial Analysis
[2019 Strata] Self Sevice BI meets Geospatial AnalysisHeejae(Kyungtaak) Noh
 
Suricate
SuricateSuricate
Suricatebefreax
 
Twister4Azure - Iterative MapReduce for Azure Cloud
Twister4Azure - Iterative MapReduce for Azure CloudTwister4Azure - Iterative MapReduce for Azure Cloud
Twister4Azure - Iterative MapReduce for Azure CloudThilina Gunarathne
 
Energetic Systems of Tomorrow,from traditional wood stove to « IOT » multi-fu...
Energetic Systems of Tomorrow,from traditional wood stove to « IOT » multi-fu...Energetic Systems of Tomorrow,from traditional wood stove to « IOT » multi-fu...
Energetic Systems of Tomorrow,from traditional wood stove to « IOT » multi-fu...Agence du Numérique (AdN)
 

Tendances (18)

Open source web-gis packages, geoserver-rest and pySLD
Open source web-gis packages, geoserver-rest and pySLDOpen source web-gis packages, geoserver-rest and pySLD
Open source web-gis packages, geoserver-rest and pySLD
 
Cartaro - Geospatial CMS (en)
Cartaro - Geospatial CMS (en)Cartaro - Geospatial CMS (en)
Cartaro - Geospatial CMS (en)
 
ePOM - Intro to Ocean Data Science - Data Visualization
ePOM - Intro to Ocean Data Science - Data VisualizationePOM - Intro to Ocean Data Science - Data Visualization
ePOM - Intro to Ocean Data Science - Data Visualization
 
NASA Earth Exchange (NEX) Overview
NASA Earth Exchange (NEX) OverviewNASA Earth Exchange (NEX) Overview
NASA Earth Exchange (NEX) Overview
 
Implementing an Open Source Spatiotemporal Search Platform for Spatial Data I...
Implementing an Open Source Spatiotemporal Search Platform for Spatial Data I...Implementing an Open Source Spatiotemporal Search Platform for Spatial Data I...
Implementing an Open Source Spatiotemporal Search Platform for Spatial Data I...
 
Tran Minh: big data platform in high performance computing at NISCI
Tran Minh: big data platform in high performance computing at NISCITran Minh: big data platform in high performance computing at NISCI
Tran Minh: big data platform in high performance computing at NISCI
 
Hack reduce introduction
Hack reduce introductionHack reduce introduction
Hack reduce introduction
 
Schema, JSON-LD & the semantic web - Brighton SEO April 2015 - Kirsty Hulse -...
Schema, JSON-LD & the semantic web - Brighton SEO April 2015 - Kirsty Hulse -...Schema, JSON-LD & the semantic web - Brighton SEO April 2015 - Kirsty Hulse -...
Schema, JSON-LD & the semantic web - Brighton SEO April 2015 - Kirsty Hulse -...
 
Geo data analytics
Geo data analyticsGeo data analytics
Geo data analytics
 
Grid
GridGrid
Grid
 
5th board meeting_20190222_share
5th board meeting_20190222_share5th board meeting_20190222_share
5th board meeting_20190222_share
 
Open source based software ‘gxt’ mangosystem
Open source based software ‘gxt’ mangosystemOpen source based software ‘gxt’ mangosystem
Open source based software ‘gxt’ mangosystem
 
Gdal introduction
Gdal introductionGdal introduction
Gdal introduction
 
PINOGIO : A simple way to create a web infographic map (피노지오 : 웹 인포그래픽 맵을 만드는...
PINOGIO : A simple way to create a web infographic map (피노지오 : 웹 인포그래픽 맵을 만드는...PINOGIO : A simple way to create a web infographic map (피노지오 : 웹 인포그래픽 맵을 만드는...
PINOGIO : A simple way to create a web infographic map (피노지오 : 웹 인포그래픽 맵을 만드는...
 
[2019 Strata] Self Sevice BI meets Geospatial Analysis
[2019 Strata] Self Sevice BI meets Geospatial Analysis[2019 Strata] Self Sevice BI meets Geospatial Analysis
[2019 Strata] Self Sevice BI meets Geospatial Analysis
 
Suricate
SuricateSuricate
Suricate
 
Twister4Azure - Iterative MapReduce for Azure Cloud
Twister4Azure - Iterative MapReduce for Azure CloudTwister4Azure - Iterative MapReduce for Azure Cloud
Twister4Azure - Iterative MapReduce for Azure Cloud
 
Energetic Systems of Tomorrow,from traditional wood stove to « IOT » multi-fu...
Energetic Systems of Tomorrow,from traditional wood stove to « IOT » multi-fu...Energetic Systems of Tomorrow,from traditional wood stove to « IOT » multi-fu...
Energetic Systems of Tomorrow,from traditional wood stove to « IOT » multi-fu...
 

Similaire à GeoNotebook: Interactive geospatial analysis in Jupyter

JupyterCon 2017 - Geonotebook: an extension to the jupyter notebook for explo...
JupyterCon 2017 - Geonotebook: an extension to the jupyter notebook for explo...JupyterCon 2017 - Geonotebook: an extension to the jupyter notebook for explo...
JupyterCon 2017 - Geonotebook: an extension to the jupyter notebook for explo...Christopher Kotfila
 
Analysis Ready Data workshop - OGC presentation
Analysis Ready Data workshop - OGC presentation Analysis Ready Data workshop - OGC presentation
Analysis Ready Data workshop - OGC presentation George Percivall
 
Panel: Building the NRP Ecosystem with the Regional Networks on their Campuses;
Panel: Building the NRP Ecosystem with the Regional Networks on their Campuses;Panel: Building the NRP Ecosystem with the Regional Networks on their Campuses;
Panel: Building the NRP Ecosystem with the Regional Networks on their Campuses;Larry Smarr
 
Rack Cluster Deployment for SDSC Supercomputer
Rack Cluster Deployment for SDSC SupercomputerRack Cluster Deployment for SDSC Supercomputer
Rack Cluster Deployment for SDSC SupercomputerRebekah Rodriguez
 
Evolving Cyberinfrastructure, Democratizing Data, and Scaling AI to Catalyze ...
Evolving Cyberinfrastructure, Democratizing Data, and Scaling AI to Catalyze ...Evolving Cyberinfrastructure, Democratizing Data, and Scaling AI to Catalyze ...
Evolving Cyberinfrastructure, Democratizing Data, and Scaling AI to Catalyze ...inside-BigData.com
 
Understanding Hadoop
Understanding HadoopUnderstanding Hadoop
Understanding HadoopAhmed Ossama
 
Pycon 2012 Taiwan
Pycon 2012 TaiwanPycon 2012 Taiwan
Pycon 2012 TaiwanDongpo Deng
 
那些年 Python 攻佔了 GIS / The Year Python Takes Over GIS
那些年 Python 攻佔了 GIS / The Year Python Takes Over GIS那些年 Python 攻佔了 GIS / The Year Python Takes Over GIS
那些年 Python 攻佔了 GIS / The Year Python Takes Over GISpycontw
 
OpenStreetMap in 3D - current developments
OpenStreetMap in 3D - current developmentsOpenStreetMap in 3D - current developments
OpenStreetMap in 3D - current developmentsvirtualcitySYSTEMS GmbH
 
Operationalizing Machine Learning Using GPU-accelerated, In-database Analytics
Operationalizing Machine Learning Using GPU-accelerated, In-database AnalyticsOperationalizing Machine Learning Using GPU-accelerated, In-database Analytics
Operationalizing Machine Learning Using GPU-accelerated, In-database AnalyticsKinetica
 
SCAPE Presentation at the Elag2013 conference in Gent/Belgium
SCAPE Presentation at the Elag2013 conference in Gent/BelgiumSCAPE Presentation at the Elag2013 conference in Gent/Belgium
SCAPE Presentation at the Elag2013 conference in Gent/BelgiumSven Schlarb
 
Bring Satellite and Drone Imagery into your Data Science Workflows
Bring Satellite and Drone Imagery into your Data Science WorkflowsBring Satellite and Drone Imagery into your Data Science Workflows
Bring Satellite and Drone Imagery into your Data Science WorkflowsDatabricks
 
GeoKettle: A powerful open source spatial ETL tool
GeoKettle: A powerful open source spatial ETL toolGeoKettle: A powerful open source spatial ETL tool
GeoKettle: A powerful open source spatial ETL toolThierry Badard
 
Geo Analytics Canada Overview - May 2020
Geo Analytics Canada Overview - May 2020Geo Analytics Canada Overview - May 2020
Geo Analytics Canada Overview - May 2020GEO Analytics Canada
 
Q4 2016 GeoTrellis Presentation
Q4 2016 GeoTrellis PresentationQ4 2016 GeoTrellis Presentation
Q4 2016 GeoTrellis PresentationRob Emanuele
 
GTC-DC 2017 Session: Advanced Analytics and Machine Learning with Geospatial ...
GTC-DC 2017 Session: Advanced Analytics and Machine Learning with Geospatial ...GTC-DC 2017 Session: Advanced Analytics and Machine Learning with Geospatial ...
GTC-DC 2017 Session: Advanced Analytics and Machine Learning with Geospatial ...Kinetica
 
GEO Analytics Canada Overview April 2020
GEO Analytics Canada Overview April 2020GEO Analytics Canada Overview April 2020
GEO Analytics Canada Overview April 2020GEO Analytics Canada
 
Dsd int 2014 - data science symposium - application 1 - point clouds, prof. p...
Dsd int 2014 - data science symposium - application 1 - point clouds, prof. p...Dsd int 2014 - data science symposium - application 1 - point clouds, prof. p...
Dsd int 2014 - data science symposium - application 1 - point clouds, prof. p...Deltares
 

Similaire à GeoNotebook: Interactive geospatial analysis in Jupyter (20)

JupyterCon 2017 - Geonotebook: an extension to the jupyter notebook for explo...
JupyterCon 2017 - Geonotebook: an extension to the jupyter notebook for explo...JupyterCon 2017 - Geonotebook: an extension to the jupyter notebook for explo...
JupyterCon 2017 - Geonotebook: an extension to the jupyter notebook for explo...
 
Analysis Ready Data workshop - OGC presentation
Analysis Ready Data workshop - OGC presentation Analysis Ready Data workshop - OGC presentation
Analysis Ready Data workshop - OGC presentation
 
Panel: Building the NRP Ecosystem with the Regional Networks on their Campuses;
Panel: Building the NRP Ecosystem with the Regional Networks on their Campuses;Panel: Building the NRP Ecosystem with the Regional Networks on their Campuses;
Panel: Building the NRP Ecosystem with the Regional Networks on their Campuses;
 
afternoon3.pdf
afternoon3.pdfafternoon3.pdf
afternoon3.pdf
 
afternoon3.pdf
afternoon3.pdfafternoon3.pdf
afternoon3.pdf
 
Rack Cluster Deployment for SDSC Supercomputer
Rack Cluster Deployment for SDSC SupercomputerRack Cluster Deployment for SDSC Supercomputer
Rack Cluster Deployment for SDSC Supercomputer
 
Evolving Cyberinfrastructure, Democratizing Data, and Scaling AI to Catalyze ...
Evolving Cyberinfrastructure, Democratizing Data, and Scaling AI to Catalyze ...Evolving Cyberinfrastructure, Democratizing Data, and Scaling AI to Catalyze ...
Evolving Cyberinfrastructure, Democratizing Data, and Scaling AI to Catalyze ...
 
Understanding Hadoop
Understanding HadoopUnderstanding Hadoop
Understanding Hadoop
 
Pycon 2012 Taiwan
Pycon 2012 TaiwanPycon 2012 Taiwan
Pycon 2012 Taiwan
 
那些年 Python 攻佔了 GIS / The Year Python Takes Over GIS
那些年 Python 攻佔了 GIS / The Year Python Takes Over GIS那些年 Python 攻佔了 GIS / The Year Python Takes Over GIS
那些年 Python 攻佔了 GIS / The Year Python Takes Over GIS
 
OpenStreetMap in 3D - current developments
OpenStreetMap in 3D - current developmentsOpenStreetMap in 3D - current developments
OpenStreetMap in 3D - current developments
 
Operationalizing Machine Learning Using GPU-accelerated, In-database Analytics
Operationalizing Machine Learning Using GPU-accelerated, In-database AnalyticsOperationalizing Machine Learning Using GPU-accelerated, In-database Analytics
Operationalizing Machine Learning Using GPU-accelerated, In-database Analytics
 
SCAPE Presentation at the Elag2013 conference in Gent/Belgium
SCAPE Presentation at the Elag2013 conference in Gent/BelgiumSCAPE Presentation at the Elag2013 conference in Gent/Belgium
SCAPE Presentation at the Elag2013 conference in Gent/Belgium
 
Bring Satellite and Drone Imagery into your Data Science Workflows
Bring Satellite and Drone Imagery into your Data Science WorkflowsBring Satellite and Drone Imagery into your Data Science Workflows
Bring Satellite and Drone Imagery into your Data Science Workflows
 
GeoKettle: A powerful open source spatial ETL tool
GeoKettle: A powerful open source spatial ETL toolGeoKettle: A powerful open source spatial ETL tool
GeoKettle: A powerful open source spatial ETL tool
 
Geo Analytics Canada Overview - May 2020
Geo Analytics Canada Overview - May 2020Geo Analytics Canada Overview - May 2020
Geo Analytics Canada Overview - May 2020
 
Q4 2016 GeoTrellis Presentation
Q4 2016 GeoTrellis PresentationQ4 2016 GeoTrellis Presentation
Q4 2016 GeoTrellis Presentation
 
GTC-DC 2017 Session: Advanced Analytics and Machine Learning with Geospatial ...
GTC-DC 2017 Session: Advanced Analytics and Machine Learning with Geospatial ...GTC-DC 2017 Session: Advanced Analytics and Machine Learning with Geospatial ...
GTC-DC 2017 Session: Advanced Analytics and Machine Learning with Geospatial ...
 
GEO Analytics Canada Overview April 2020
GEO Analytics Canada Overview April 2020GEO Analytics Canada Overview April 2020
GEO Analytics Canada Overview April 2020
 
Dsd int 2014 - data science symposium - application 1 - point clouds, prof. p...
Dsd int 2014 - data science symposium - application 1 - point clouds, prof. p...Dsd int 2014 - data science symposium - application 1 - point clouds, prof. p...
Dsd int 2014 - data science symposium - application 1 - point clouds, prof. p...
 

Dernier

6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...
6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...
6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...Dr Arash Najmaei ( Phd., MBA, BSc)
 
Digital Indonesia Report 2024 by We Are Social .pdf
Digital Indonesia Report 2024 by We Are Social .pdfDigital Indonesia Report 2024 by We Are Social .pdf
Digital Indonesia Report 2024 by We Are Social .pdfNicoChristianSunaryo
 
Decoding Movie Sentiments: Analyzing Reviews with Data Analysis model
Decoding Movie Sentiments: Analyzing Reviews with Data Analysis modelDecoding Movie Sentiments: Analyzing Reviews with Data Analysis model
Decoding Movie Sentiments: Analyzing Reviews with Data Analysis modelBoston Institute of Analytics
 
IBEF report on the Insurance market in India
IBEF report on the Insurance market in IndiaIBEF report on the Insurance market in India
IBEF report on the Insurance market in IndiaManalVerma4
 
Role of Consumer Insights in business transformation
Role of Consumer Insights in business transformationRole of Consumer Insights in business transformation
Role of Consumer Insights in business transformationAnnie Melnic
 
Digital Marketing Plan, how digital marketing works
Digital Marketing Plan, how digital marketing worksDigital Marketing Plan, how digital marketing works
Digital Marketing Plan, how digital marketing worksdeepakthakur548787
 
DATA ANALYSIS using various data sets like shoping data set etc
DATA ANALYSIS using various data sets like shoping data set etcDATA ANALYSIS using various data sets like shoping data set etc
DATA ANALYSIS using various data sets like shoping data set etclalithasri22
 
Statistics For Management by Richard I. Levin 8ed.pdf
Statistics For Management by Richard I. Levin 8ed.pdfStatistics For Management by Richard I. Levin 8ed.pdf
Statistics For Management by Richard I. Levin 8ed.pdfnikeshsingh56
 
English-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdf
English-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdfEnglish-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdf
English-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdfblazblazml
 
why-transparency-and-traceability-are-essential-for-sustainable-supply-chains...
why-transparency-and-traceability-are-essential-for-sustainable-supply-chains...why-transparency-and-traceability-are-essential-for-sustainable-supply-chains...
why-transparency-and-traceability-are-essential-for-sustainable-supply-chains...Jack Cole
 
Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...
Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...
Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...Boston Institute of Analytics
 
Bank Loan Approval Analysis: A Comprehensive Data Analysis Project
Bank Loan Approval Analysis: A Comprehensive Data Analysis ProjectBank Loan Approval Analysis: A Comprehensive Data Analysis Project
Bank Loan Approval Analysis: A Comprehensive Data Analysis ProjectBoston Institute of Analytics
 
Non Text Magic Studio Magic Design for Presentations L&P.pdf
Non Text Magic Studio Magic Design for Presentations L&P.pdfNon Text Magic Studio Magic Design for Presentations L&P.pdf
Non Text Magic Studio Magic Design for Presentations L&P.pdfPratikPatil591646
 
Presentation of project of business person who are success
Presentation of project of business person who are successPresentation of project of business person who are success
Presentation of project of business person who are successPratikSingh115843
 

Dernier (17)

6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...
6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...
6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...
 
Digital Indonesia Report 2024 by We Are Social .pdf
Digital Indonesia Report 2024 by We Are Social .pdfDigital Indonesia Report 2024 by We Are Social .pdf
Digital Indonesia Report 2024 by We Are Social .pdf
 
Decoding Movie Sentiments: Analyzing Reviews with Data Analysis model
Decoding Movie Sentiments: Analyzing Reviews with Data Analysis modelDecoding Movie Sentiments: Analyzing Reviews with Data Analysis model
Decoding Movie Sentiments: Analyzing Reviews with Data Analysis model
 
IBEF report on the Insurance market in India
IBEF report on the Insurance market in IndiaIBEF report on the Insurance market in India
IBEF report on the Insurance market in India
 
Role of Consumer Insights in business transformation
Role of Consumer Insights in business transformationRole of Consumer Insights in business transformation
Role of Consumer Insights in business transformation
 
Digital Marketing Plan, how digital marketing works
Digital Marketing Plan, how digital marketing worksDigital Marketing Plan, how digital marketing works
Digital Marketing Plan, how digital marketing works
 
2023 Survey Shows Dip in High School E-Cigarette Use
2023 Survey Shows Dip in High School E-Cigarette Use2023 Survey Shows Dip in High School E-Cigarette Use
2023 Survey Shows Dip in High School E-Cigarette Use
 
DATA ANALYSIS using various data sets like shoping data set etc
DATA ANALYSIS using various data sets like shoping data set etcDATA ANALYSIS using various data sets like shoping data set etc
DATA ANALYSIS using various data sets like shoping data set etc
 
Statistics For Management by Richard I. Levin 8ed.pdf
Statistics For Management by Richard I. Levin 8ed.pdfStatistics For Management by Richard I. Levin 8ed.pdf
Statistics For Management by Richard I. Levin 8ed.pdf
 
English-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdf
English-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdfEnglish-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdf
English-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdf
 
why-transparency-and-traceability-are-essential-for-sustainable-supply-chains...
why-transparency-and-traceability-are-essential-for-sustainable-supply-chains...why-transparency-and-traceability-are-essential-for-sustainable-supply-chains...
why-transparency-and-traceability-are-essential-for-sustainable-supply-chains...
 
Insurance Churn Prediction Data Analysis Project
Insurance Churn Prediction Data Analysis ProjectInsurance Churn Prediction Data Analysis Project
Insurance Churn Prediction Data Analysis Project
 
Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...
Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...
Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...
 
Bank Loan Approval Analysis: A Comprehensive Data Analysis Project
Bank Loan Approval Analysis: A Comprehensive Data Analysis ProjectBank Loan Approval Analysis: A Comprehensive Data Analysis Project
Bank Loan Approval Analysis: A Comprehensive Data Analysis Project
 
Data Analysis Project: Stroke Prediction
Data Analysis Project: Stroke PredictionData Analysis Project: Stroke Prediction
Data Analysis Project: Stroke Prediction
 
Non Text Magic Studio Magic Design for Presentations L&P.pdf
Non Text Magic Studio Magic Design for Presentations L&P.pdfNon Text Magic Studio Magic Design for Presentations L&P.pdf
Non Text Magic Studio Magic Design for Presentations L&P.pdf
 
Presentation of project of business person who are success
Presentation of project of business person who are successPresentation of project of business person who are success
Presentation of project of business person who are success
 

GeoNotebook: Interactive geospatial analysis in Jupyter

  • 1. GeoNotebook An extension to the Jupyter Notebook for exploratory geospatial analysis Christopher Kotfila, Aashish Chaudhary - Kitware Inc. Petr Votava - NASA Ames FOSS4G 2017
  • 2. What is GeoNotebook? ● Python & Javascript extensions to Jupyter Notebook ○ Interactive map connected to python execution environment via RPC. ○ Integrated tile server for rendering geospatial data onto the map. ● Supports interactive exploration and subsetting of geospatial data (especially raster data).
  • 4. Development Context ● NASA ESTO - AIST 2014 Grant ○ Public cloud tools for extending analysis capabilities. ○ Bring analysis to the data, rather than data to the analyst ● NASA Earth Exchange (NEX) @ NASA Ames ○ Portal for collaborative sharing network for researchers ○ Large scale data processing pipelines for enabling ‘science-quality’ satellite data products.
  • 5.
  • 6. Technical Objectives ● No assumptions about relationship between data access and data visualisation. ○ Data access always at native resolution ● Support custom visualisation/data sources via third party python packages ● Sensible defaults; target “traditional” Jupyter user.
  • 7. Technical Stack ● GDAL - file I/O with custom VRT generation ● Mapnik - styling and orchestration of downsampling ● KTile - TileStache fork for serving tiles ● Jupyter Notebook - plugins + custom python kernel ● GeoJS/OpenLayers - interactive presentation of map
  • 8. Current Limitations ● Complex deployment of tile rendering stack (Mapnik/GDAL); docker image available ● Re-rendering transformations of data subsets (e.g rendering in-memory data). ● Interactive elements break some of the implicit promises about reproducibility of notebooks.
  • 9. Call to Action ● Originally developed as a demonstration of what was possible for Q/A on NEX data processing pipelines. ● Still early days ○ Apache 2.0 licensed software seeks interested community of users & contributors. ○ Cathedral and the Bazaar - “plausible promise”
  • 10. Many Thanks! Contributing projects: GDAL, Mapnik, TileStache, Jupyter Notebook, NumPy, Fiona, Shapely, Rasterio, Pytest and many others. Contributing humans: Mike Little†, Raman Nemani†, Petr Votava, Andrew Michaelis†, Jon Beazley‡, Doruk Ozturk‡, Dan Lamanna‡ † NASA, ‡ Kitware Inc.
  • 11. Questions! Github: OpenGeoscience/geonotebook Gitter: gitter.im/OpenGeoscience/geonotebook RTD: geonotebook.readthedocs.io Email: chris.kotfila@kitware.com docker run --net=host -v /path/to/notebooks:/notebooks geonotebook/geonotebook:latest
  • 13.
  • 14.
  • 15. Nascent Geotrellis integration Geotrellis & GeoPySpark Deep Learning for Semantic Segmentation of Aerial Imagery