Fitzhugh G., Coulon V. (2015) Can Libraries Provide STEM Learning Experiences for Patrons? Findings from the STAR_Net Project Summative Evaluation Education Development Center, Inc.

1. Overview
STAR_Net (the Science, Technology, Activities and
Resources Library Education Network) was
developed by the Space Science Institute’s National
Center for Interactive Learning with funding from
the National Science Foundation. Core partners
included the American Library Association, the
Lunar and Planetary Institute, and the National Girls
Collaborative Project.
STAR_Net brought inquiry-based STEM learning
experiences to 18 public libraries through two
traveling exhibits, associated programming for
library patrons, and a virtual community of practice
for library staff and others interested in bringing
STEM programming to libraries.
Evaluation & Research Associates (now part of
Education Development Center) evaluated the
implementation of the project and its impact on
library staff and patrons. The evaluation found that
the project had a positive impact on participating
librarians, library staff, and library patrons.
Can Libraries Provide STEM Learning Experiences for Patrons?
Findings from the STAR_Net Project Summative Evaluation
Ginger Fitzhugh
Education Development Center, Inc.
2.8
3.7
3.4
3.8
1.0 2.0 3.0 4.0 5.0
Strongly Disagree Strongly AgreeDisagree Neutral Agree
Discover Earth library staff: I am
confident I can implement my own ideas for
earth science programs at our library
Discover Tech library staff: I am
confident I can implement my
own ideas for engineering
programs at our library
Does the professional development
delivered by the STAR_Net project help
Discover Earth and Discover Tech librarians
deliver informal science education
programming?
Do host libraries develop and/or
implement informal science activities
for the targeted audiences?
Evaluation Question
1
Evaluation Question
2
2.0
2.6
3.6
2.9
1.0 2.0 3.0 4.0 5.0
Beginner Expert
Discover Earth library staff:
The difference between
weather and climate
Discover Tech
library staff:
The impact of
engineering on
people
Discover Tech library staff became more confident about their ability to
implement engineering programming; Discover Earth library staff were
already fairly confident
Evaluation Question
3
Evaluation Question
4 What, if any, are the unanticipated consequences of STAR_Net (positive or negative) on librarians,
libraries, patrons, and others?
To what extent do library patrons at the
host libraries become more interested
in, knowledgeable about, and engaged
in the STEM topics presented in the
exhibits and related programming?
42%
48%
26%
33%
18%
13%
8%
3%
5%
4%
Agree
Strongly
Agree Neutral Disagree
Strongly
Disagree
Discover Tech
Patrons
(n = 391)
Discover Earth
Patrons
(n = 690)
“The Discover Tech [Discover Earth] exhibit increased my
interest in learning more about engineering [earth science].”
27%
average increase at
Discover Earth
libraries
3%
average increase at
Discover Tech libraries
Exhibit-related circulation was 3% higher at Discover Tech libraries
and 27% higher at Discover Earth libraries while they hosted the
exhibits (compared to the equivalent period one year prior)
 The exhibits supported free-choice learning. Unlike a typical science museum, the exhibits and programming were free. Adults
and children could look at the exhibits whenever they chose. Patrons could easily return to interact with different parts of the
exhibit again.
 The exhibits scaffolded school learning. Libraries hosted school field trips and provided teachers with supplemental materials.
Teachers and parents reported that the exhibits helped to support what students were learning at school. Several libraries said
that the exhibits helped to attract home schooling groups.
 The exhibits supported intergenerational learning. Multiple generations—grandparents, parents, and their young children—
interacted with the exhibits together. Children frequently were the ones to draw their parents in to look at the exhibits. Parents
also drew their children in and helped them stay focused on the learning.
 Some libraries hoped to leverage their STAR_Net experience into seeking additional partners or other funding.
Library staff’s STEM knowledge increased after they received professional
development through STAR_Net
Librarians and library staff reported that the project
increased their knowledge, interest, and confidence in
offering STEM programming in their libraries. The exhibits appeared to spark the interest of
many patrons to learn more about science and
engineering.
Many libraries reached out and developed connections
with organizations and individuals they had not worked
with previously. Two thirds of the libraries reported that
they continued to offer STEM programming after the
exhibit had left their libraries.
Evaluation Methods
Library Staff Pre-Exhibit Survey &
Six-Month Follow-up Survey
Library Post-Exhibit Report Form
Library Patron Survey
Circulation records (1 year before
exhibit, during, 1 year after exhibit)
Interview library staff
Site visits to 5 libraries
Metrics re: Community of Practice
website use
Source: Library Staff Pre-Exhibit and Six Month Follow-up Surveys; n = 5 DT and DE n = 11 staff
Source: Library Staff Pre-Exhibit and Six Month Follow-up Surveys; DT n = 5 and DE n = 10 staff
Source: Final Report Forms; n = 5 DT libraries and n = 8 DE libraries
64%
37%
29%
8% 4% 3%
Percentageof
ProgramsOffered
DuringExhibit
14%
51%
40%
2%
13%
0%
Percentageof
ProgramsOffered
DuringExhibit
Discover
Earth
Libraries
Discover
Tech
Libraries
Other
professionally
created
materials,
programs
Our
own
creation
Other
sources
National
Girls
Collaborative
Project
(NGCP)
Lunar
and
Planetary
Institute
STAR_Net
Community
of Practice
Source: Final Report Forms; n = 5 DT libraries and n = 6 DT libraries
Exhibit Mock-up
Source: Circulation Records; n = 3 DT libraries and n = 5 DE libraries
Source: Patron Surveys
STAR_Net Host Libraries
STAR_Net libraries offered many STEM programs while they hosted the exhibits
Much of the programming that STAR_Net libraries offered was home-grown
Pre-survey
mean
Post-survey
mean
Pre-survey
mean
Post-survey
mean
MS
7
NC
11
WA
15
KY
15
AL
63
NE
6
FL
8
TX
11
CO
11
WY
12
NY
14
VA
28
PA
72
NumberofProgramsOffered
DuringExhibit
Discover Tech Libraries Discover Earth Libraries
Median = 11.5 programs
Median = 15 programs