SlideShare une entreprise Scribd logo
1  sur  16
Télécharger pour lire hors ligne
Visualizing the
Bureau of Labor Statistics
Employment Dataset
by
Siva Mohan and Curran Kelleher
Outline
●Understanding the Dataset
●Data Preparation
●Visualizations
●Issues
Understanding the Dataset
as dimensions and measures
●Raw data at ftp://ftp.bls.gov/pub/special.requests/cew/
●Covers Time from 1990 to 2007
● Data for years, quarters, and months
●Covers Space for all US States
● Data for States and Counties
●Covers the NAICS Industry hierarchy
●Covers Ownership
● Government (Federal, State, Local) and
Private
●Contains measures employment, annual pay,
total wages, and number of establishments
(among others)
NAICS
North American Industry Classification System
●11 Agriculture, Forestry, Fishing and Hunting
●111 Crop Production
●1111 Oilseed and Grain Farming
●11111 Soybean Farming
●111110 Soybean Farming
●11112 Oilseed (except Soybean)
Farming
●111120 Oilseed (except Soybean)
Farming
●11113 Dry Pea and Bean Farming
●111130 Dry Pea and Bean Farming
●11114 Wheat Farming
●111140 Wheat Farming
Data Preprocessing
●We wrote shell scripts to
● Download all raw data files via FTP
● Parse the raw data files (BLS fixed width format)
● Import the raw data files into a MySQL database
●We manually imported tables mapping
● BLS “Area Code” → state name
● BLS “Area Code” → state abbreviation
● Necessary for using Tableau's map feature
● NAICS code → industry name
● BLS Ownership code → ownership name
Visualizations
Issues
●No support for hierarchical data cubes
● With this we could have seen the whole dataset
●County data too large for Tableau (1 min per vis)
●Hierarchical time was (seemingly) impossible
● Years in different tables, months in different columns
● Tableau expects each dimension as a single column
●We did not document as we went, had to backtrack
●“Cancel” query in Tableau didn't stop queries
●Overlapping labels occurred often
●(seemingly) impossible to probe with many
dimensions
the end.

Contenu connexe

En vedette

Cape may-county-data-demographics-labor-employment
Cape may-county-data-demographics-labor-employmentCape may-county-data-demographics-labor-employment
Cape may-county-data-demographics-labor-employmentfianacone
 
Lmi Orientation Pyc0311new
Lmi Orientation Pyc0311newLmi Orientation Pyc0311new
Lmi Orientation Pyc0311newGary Crossley
 
Economic Snapshot- -August 3, 2015
Economic Snapshot- -August 3, 2015Economic Snapshot- -August 3, 2015
Economic Snapshot- -August 3, 2015Kurt S. Altrichter
 
Understanding and Using Labor Market Information
Understanding and Using Labor Market InformationUnderstanding and Using Labor Market Information
Understanding and Using Labor Market InformationMichele Martin
 
Session, Tools for Labor Market Information - Center for Workforce Informatio...
Session, Tools for Labor Market Information - Center for Workforce Informatio...Session, Tools for Labor Market Information - Center for Workforce Informatio...
Session, Tools for Labor Market Information - Center for Workforce Informatio...PAPartners
 
Cass County Labor Market Data
Cass County Labor Market DataCass County Labor Market Data
Cass County Labor Market DataKinexus
 
Contextualizing Real-Time and Traditional Labor Market Data
Contextualizing Real-Time and Traditional Labor Market DataContextualizing Real-Time and Traditional Labor Market Data
Contextualizing Real-Time and Traditional Labor Market DataEMSI
 
African Americans: College Majors and Earnings
African Americans: College Majors and Earnings African Americans: College Majors and Earnings
African Americans: College Majors and Earnings CEW Georgetown
 
The Online College Labor Market
The Online College Labor MarketThe Online College Labor Market
The Online College Labor MarketCEW Georgetown
 

En vedette (12)

Cape may-county-data-demographics-labor-employment
Cape may-county-data-demographics-labor-employmentCape may-county-data-demographics-labor-employment
Cape may-county-data-demographics-labor-employment
 
2016 Labor Report FINAL
2016 Labor Report FINAL2016 Labor Report FINAL
2016 Labor Report FINAL
 
Lmi Orientation Pyc0311new
Lmi Orientation Pyc0311newLmi Orientation Pyc0311new
Lmi Orientation Pyc0311new
 
Economic Snapshot- -August 3, 2015
Economic Snapshot- -August 3, 2015Economic Snapshot- -August 3, 2015
Economic Snapshot- -August 3, 2015
 
Carlos a
Carlos aCarlos a
Carlos a
 
Understanding and Using Labor Market Information
Understanding and Using Labor Market InformationUnderstanding and Using Labor Market Information
Understanding and Using Labor Market Information
 
Session, Tools for Labor Market Information - Center for Workforce Informatio...
Session, Tools for Labor Market Information - Center for Workforce Informatio...Session, Tools for Labor Market Information - Center for Workforce Informatio...
Session, Tools for Labor Market Information - Center for Workforce Informatio...
 
County Profile Template Booklet
County Profile Template BookletCounty Profile Template Booklet
County Profile Template Booklet
 
Cass County Labor Market Data
Cass County Labor Market DataCass County Labor Market Data
Cass County Labor Market Data
 
Contextualizing Real-Time and Traditional Labor Market Data
Contextualizing Real-Time and Traditional Labor Market DataContextualizing Real-Time and Traditional Labor Market Data
Contextualizing Real-Time and Traditional Labor Market Data
 
African Americans: College Majors and Earnings
African Americans: College Majors and Earnings African Americans: College Majors and Earnings
African Americans: College Majors and Earnings
 
The Online College Labor Market
The Online College Labor MarketThe Online College Labor Market
The Online College Labor Market
 

Plus de Curran Kelleher

Plus de Curran Kelleher (9)

Resume
ResumeResume
Resume
 
Introduction to D3
Introduction to D3Introduction to D3
Introduction to D3
 
The Chiasm Visualization Platform
The Chiasm Visualization PlatformThe Chiasm Visualization Platform
The Chiasm Visualization Platform
 
Chiasm
ChiasmChiasm
Chiasm
 
Introduction to D3.js
Introduction to D3.jsIntroduction to D3.js
Introduction to D3.js
 
2011 07 14_fractalperspective
2011 07 14_fractalperspective2011 07 14_fractalperspective
2011 07 14_fractalperspective
 
Code-Hub
Code-HubCode-Hub
Code-Hub
 
Multiscale Visualization Using Data Cubes
Multiscale Visualization Using Data CubesMultiscale Visualization Using Data Cubes
Multiscale Visualization Using Data Cubes
 
CSGSO Welcome Reception Fall 2012
CSGSO Welcome Reception Fall 2012CSGSO Welcome Reception Fall 2012
CSGSO Welcome Reception Fall 2012
 

Dernier

Active Learning Strategies (in short ALS).pdf
Active Learning Strategies (in short ALS).pdfActive Learning Strategies (in short ALS).pdf
Active Learning Strategies (in short ALS).pdfPatidar M
 
Millenials and Fillennials (Ethical Challenge and Responses).pptx
Millenials and Fillennials (Ethical Challenge and Responses).pptxMillenials and Fillennials (Ethical Challenge and Responses).pptx
Millenials and Fillennials (Ethical Challenge and Responses).pptxJanEmmanBrigoli
 
Measures of Position DECILES for ungrouped data
Measures of Position DECILES for ungrouped dataMeasures of Position DECILES for ungrouped data
Measures of Position DECILES for ungrouped dataBabyAnnMotar
 
ICS2208 Lecture6 Notes for SL spaces.pdf
ICS2208 Lecture6 Notes for SL spaces.pdfICS2208 Lecture6 Notes for SL spaces.pdf
ICS2208 Lecture6 Notes for SL spaces.pdfVanessa Camilleri
 
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)lakshayb543
 
How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17Celine George
 
4.16.24 21st Century Movements for Black Lives.pptx
4.16.24 21st Century Movements for Black Lives.pptx4.16.24 21st Century Movements for Black Lives.pptx
4.16.24 21st Century Movements for Black Lives.pptxmary850239
 
The Contemporary World: The Globalization of World Politics
The Contemporary World: The Globalization of World PoliticsThe Contemporary World: The Globalization of World Politics
The Contemporary World: The Globalization of World PoliticsRommel Regala
 
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptxINTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptxHumphrey A Beña
 
ENG 5 Q4 WEEk 1 DAY 1 Restate sentences heard in one’s own words. Use appropr...
ENG 5 Q4 WEEk 1 DAY 1 Restate sentences heard in one’s own words. Use appropr...ENG 5 Q4 WEEk 1 DAY 1 Restate sentences heard in one’s own words. Use appropr...
ENG 5 Q4 WEEk 1 DAY 1 Restate sentences heard in one’s own words. Use appropr...JojoEDelaCruz
 
EMBODO Lesson Plan Grade 9 Law of Sines.docx
EMBODO Lesson Plan Grade 9 Law of Sines.docxEMBODO Lesson Plan Grade 9 Law of Sines.docx
EMBODO Lesson Plan Grade 9 Law of Sines.docxElton John Embodo
 
ROLES IN A STAGE PRODUCTION in arts.pptx
ROLES IN A STAGE PRODUCTION in arts.pptxROLES IN A STAGE PRODUCTION in arts.pptx
ROLES IN A STAGE PRODUCTION in arts.pptxVanesaIglesias10
 
Inclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdf
Inclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdfInclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdf
Inclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdfTechSoup
 
4.18.24 Movement Legacies, Reflection, and Review.pptx
4.18.24 Movement Legacies, Reflection, and Review.pptx4.18.24 Movement Legacies, Reflection, and Review.pptx
4.18.24 Movement Legacies, Reflection, and Review.pptxmary850239
 
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdfVirtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdfErwinPantujan2
 

Dernier (20)

Active Learning Strategies (in short ALS).pdf
Active Learning Strategies (in short ALS).pdfActive Learning Strategies (in short ALS).pdf
Active Learning Strategies (in short ALS).pdf
 
Millenials and Fillennials (Ethical Challenge and Responses).pptx
Millenials and Fillennials (Ethical Challenge and Responses).pptxMillenials and Fillennials (Ethical Challenge and Responses).pptx
Millenials and Fillennials (Ethical Challenge and Responses).pptx
 
LEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptx
LEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptxLEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptx
LEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptx
 
Measures of Position DECILES for ungrouped data
Measures of Position DECILES for ungrouped dataMeasures of Position DECILES for ungrouped data
Measures of Position DECILES for ungrouped data
 
ICS2208 Lecture6 Notes for SL spaces.pdf
ICS2208 Lecture6 Notes for SL spaces.pdfICS2208 Lecture6 Notes for SL spaces.pdf
ICS2208 Lecture6 Notes for SL spaces.pdf
 
Paradigm shift in nursing research by RS MEHTA
Paradigm shift in nursing research by RS MEHTAParadigm shift in nursing research by RS MEHTA
Paradigm shift in nursing research by RS MEHTA
 
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
 
How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17
 
4.16.24 21st Century Movements for Black Lives.pptx
4.16.24 21st Century Movements for Black Lives.pptx4.16.24 21st Century Movements for Black Lives.pptx
4.16.24 21st Century Movements for Black Lives.pptx
 
The Contemporary World: The Globalization of World Politics
The Contemporary World: The Globalization of World PoliticsThe Contemporary World: The Globalization of World Politics
The Contemporary World: The Globalization of World Politics
 
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptxYOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
 
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptxINTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
 
ENG 5 Q4 WEEk 1 DAY 1 Restate sentences heard in one’s own words. Use appropr...
ENG 5 Q4 WEEk 1 DAY 1 Restate sentences heard in one’s own words. Use appropr...ENG 5 Q4 WEEk 1 DAY 1 Restate sentences heard in one’s own words. Use appropr...
ENG 5 Q4 WEEk 1 DAY 1 Restate sentences heard in one’s own words. Use appropr...
 
EMBODO Lesson Plan Grade 9 Law of Sines.docx
EMBODO Lesson Plan Grade 9 Law of Sines.docxEMBODO Lesson Plan Grade 9 Law of Sines.docx
EMBODO Lesson Plan Grade 9 Law of Sines.docx
 
ROLES IN A STAGE PRODUCTION in arts.pptx
ROLES IN A STAGE PRODUCTION in arts.pptxROLES IN A STAGE PRODUCTION in arts.pptx
ROLES IN A STAGE PRODUCTION in arts.pptx
 
Inclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdf
Inclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdfInclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdf
Inclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdf
 
4.18.24 Movement Legacies, Reflection, and Review.pptx
4.18.24 Movement Legacies, Reflection, and Review.pptx4.18.24 Movement Legacies, Reflection, and Review.pptx
4.18.24 Movement Legacies, Reflection, and Review.pptx
 
YOUVE_GOT_EMAIL_PRELIMS_EL_DORADO_2024.pptx
YOUVE_GOT_EMAIL_PRELIMS_EL_DORADO_2024.pptxYOUVE_GOT_EMAIL_PRELIMS_EL_DORADO_2024.pptx
YOUVE_GOT_EMAIL_PRELIMS_EL_DORADO_2024.pptx
 
INCLUSIVE EDUCATION PRACTICES FOR TEACHERS AND TRAINERS.pptx
INCLUSIVE EDUCATION PRACTICES FOR TEACHERS AND TRAINERS.pptxINCLUSIVE EDUCATION PRACTICES FOR TEACHERS AND TRAINERS.pptx
INCLUSIVE EDUCATION PRACTICES FOR TEACHERS AND TRAINERS.pptx
 
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdfVirtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
 

Visualizing the Bureau of Labor Statistics Employment Dataset

  • 1. Visualizing the Bureau of Labor Statistics Employment Dataset by Siva Mohan and Curran Kelleher
  • 2. Outline ●Understanding the Dataset ●Data Preparation ●Visualizations ●Issues
  • 3. Understanding the Dataset as dimensions and measures ●Raw data at ftp://ftp.bls.gov/pub/special.requests/cew/ ●Covers Time from 1990 to 2007 ● Data for years, quarters, and months ●Covers Space for all US States ● Data for States and Counties ●Covers the NAICS Industry hierarchy ●Covers Ownership ● Government (Federal, State, Local) and Private ●Contains measures employment, annual pay, total wages, and number of establishments (among others)
  • 4. NAICS North American Industry Classification System ●11 Agriculture, Forestry, Fishing and Hunting ●111 Crop Production ●1111 Oilseed and Grain Farming ●11111 Soybean Farming ●111110 Soybean Farming ●11112 Oilseed (except Soybean) Farming ●111120 Oilseed (except Soybean) Farming ●11113 Dry Pea and Bean Farming ●111130 Dry Pea and Bean Farming ●11114 Wheat Farming ●111140 Wheat Farming
  • 5. Data Preprocessing ●We wrote shell scripts to ● Download all raw data files via FTP ● Parse the raw data files (BLS fixed width format) ● Import the raw data files into a MySQL database ●We manually imported tables mapping ● BLS “Area Code” → state name ● BLS “Area Code” → state abbreviation ● Necessary for using Tableau's map feature ● NAICS code → industry name ● BLS Ownership code → ownership name
  • 7.
  • 8.
  • 9.
  • 10.
  • 11.
  • 12.
  • 13.
  • 14.
  • 15. Issues ●No support for hierarchical data cubes ● With this we could have seen the whole dataset ●County data too large for Tableau (1 min per vis) ●Hierarchical time was (seemingly) impossible ● Years in different tables, months in different columns ● Tableau expects each dimension as a single column ●We did not document as we went, had to backtrack ●“Cancel” query in Tableau didn't stop queries ●Overlapping labels occurred often ●(seemingly) impossible to probe with many dimensions