opening minds to science - Saint Louis Science Center

Transcription

opening minds to science - Saint Louis Science Center
OPENING MINDS TO SCIENCE
The Saint Louis Science Center’s Report to the Community
2010-2011
OPENING MINDS TO SCIENCE
The Saint Louis Science Center’s Report to the Community
2010-2011
Co-Editors: Jennifer Heim, Sara Martinez, and Betsy O’Brien
Publication Design: Jason Cook
ACKNOWLEDGMENTS
The Saint Louis Science Center would like to acknowledge the contributions of
the following individuals and groups in the creation and review of this report:
Saint Louis Science Center’s Division of Education, Exhibits & Programs*
Collections
Center for Science
Community Science
Design & Creative Services
Exhibit Electronics & Production
Public Programs
Research & Evaluation
School Programs
Science & Galleries
Challenger Learning Center~St. Louis
Research & Evaluation, Contributing Writers
Elisa Israel
Sara Martinez
Betsy O’Brien
Consultants
From the Chief Scientific Officer,
Carol Valenta
Dear Partners in Science Education,
It is my pleasure to present the Science Center’s fifth annual report on the
experiences of participants in our programs, Opening Minds to Science: The Saint
Louis Science Center’s Report to the Community, 2010-11.
This program year marked important transitions for the Science Center. Our
President and CEO for the past 15 years, Doug King, left in January 2011 to become
the President of the Museum of Flight in Seattle. Following Doug’s departure, Dr.
Phil Needleman served as interim President, guiding us through the transition to
new leadership.
In December 2011, we welcomed Bert Vescolani as our new President and CEO.
With a background in both formal and informal education, Bert most recently
served as Director at the John Ball Zoological Gardens in Grand Rapids, Michigan.
We look forward to working with Bert as we continue to deliver high quality
programs and increase our level of service to the community.
This report analyzes the experiences of participants in our programs through
both quantitative and qualitative methods. We attempt to show the breadth of
programs across the Science Center, as well as offer an in-depth look into three
programs that provide more sustained engagement. We hope you will find this
report useful to your work and we look forward to your feedback.
Sincerely,
Nadine Ball, PNC Grow Up Great Project Evaluator, 2010-2011
Marie Wohlert, PNC Grow Up Great Project Evaluator 2011-present
*For a complete list of Education, Exhibits & Programs staff, see the Appendix.
Cover photos (clockwise from top left):
Science Cafe; Algaepalooza; Youth Exploring Science (YES): Communicating Climate Change; Challenger Learning
Center~St. Louis Discovery Classroom: Great Rocket Design Challenge; Unplugged: Uphill Derby; Algaepalooza.
Unless otherwise noted, all photos by the Saint Louis Science Center.
Carol J. Valenta
Chief Scientific Officer
Saint Louis Science Center
Carol Valenta
Chief Scientific Officer
CONTENTS
Open Every Mind to Science
OPEN EVERY MIND TO SCIENCE
The Saint Louis Science Center’s Educational Philosophy and Practice
1
The Saint Louis Science Center’s educational philosophy and practice.
Methodology
3
How the Science Center collects and analyzes data describing our programs.
Overview of Programs at the Science Center by Department
The Saint Louis Science Center is a free-choice, informal learning environment where
people of all ages engage with science – directly and on their own terms. We seek
to engage the broadest audience possible through programs designed for: families,
school groups, educators, teens, community organizations, adults and the general
public visiting the Science Center.
Our mission is to ignite and sustain lifelong science and technology learning.
5
Analysis of programs as a whole, as well as by individual department.
Opening Minds to Science
Our exhibitions and programs take into account the complete visitor environment
– physical, social and personal. We believe that learning is best fostered through
programs and exhibitions that encourage visitors to:
Center for Science Department
8
Challenger Learning Center~St. Louis
9
• Make personal connections to their knowledge and experiences
Community Science Department
10
• Act on their own curiosity
Public Programs Department
11
• Form and ask questions
School Programs Department
12
• Engage in hands-on exploration and experimentation
Science & Galleries Department
13
• Embrace a spirit of play and discovery
• Cultivate science process skills
• Pursue science throughout their lives
PNC: Grow Up Great!
14
Positive experiences with Science Center exhibitions and programs will encourage
repeat visits and prompt visitors to interact with science beyond their visit.
Ultimately, we hope to motivate our visitors to think differently about science and
to empower them to make informed choices in their everyday lives.
HomeSchool Days & HomeSchool Labs
18
Learning in an Informal Environment
Unplugged: Uphill Derby
22
Free-choice learning “tends to be non-linear and personally motivated.” (Falk and
Dierking, 2000, p.13) In designing our programs and exhibitions, we strive to provide
multiple levels of interaction and engagement for diverse audiences. This translates
into experiences that are accessible, multi-sensory and meaningful to people with
a variety of abilities, cultural backgrounds, experiences with science, learning
styles and interests. We also seek to support social learning, experimentation
and investigation. We believe visitors should have fun, engaging, relevant and
successful experiences with science, whatever their level of knowledge. Science
Center staff play a key role in fostering a successful experience.
Program Spotlight
14
More in-depth analysis of the experience of participants in three Science Center programs.
Looking to the Future
25
Appendix
28
Sources
32
Saint Louis Science Center
1
How We Develop Exhibitions and Programs
In order to develop exemplary exhibitions and programs, we ground our processes
in best practices in the field, current science content, current learning theory
and audience research. Clearly-articulated educational goals and objectives
drive the exhibition and program development process. As appropriate, we
correlate our offerings to national and state curriculum standards. Through frontend, formative and summative evaluation, we include our audiences and other
stakeholders in the program and exhibition development and revision process.
In developing these experiences, we seek to communicate clearly how we envision
visitors engaging with them, employing devices such as advance organizers and
tools to personalize the experience. We take risks with cutting-edge content,
ways to deliver that content and ways of including new audiences. The Science
Center supports these processes with adequate time, funding and staff.
Exhibitions at the Saint Louis Science Center capitalize on the power of
three-dimensional environments to engage our community with science. Our
exhibitions must engage a broad spectrum of visitors. We recognize that every
exhibit component cannot meet all the needs of all our audiences, but we seek
to create a balance of experiences within the exhibition as a whole.
We commit to developing exhibitions that:
• Provide multiple conceptual entry points and multiple outcomes
• Present current science information and can be adapted to stay current
• Facilitate conversations and encourage multiple groups to engage
with each other
Programs at the Saint Louis Science Center engage our community with science
via skilled, well-trained program developers and presenters. Often developed
based on the needs of specific audiences, programs both expand on conversations
begun in our galleries and incorporate topics and experiences beyond the scope
of our galleries. Consequently, programs increase our audiences’ engagement with
science and broaden the Science Center’s impact. Programs also increase the size
and diversity of our audience and generate revenue crucial to our ongoing work.
We commit to developing programs that are:
• Learner-centered
• Delivered by knowledgeable and well-trained presenters
• Facilitated in a manner that actively matches content and delivery
to the needs of the current audience
Thoughtful planning supports our exhibition and program development process.
A focused and fiscally sound plan, based on this learning philosophy, addresses
each of our audiences and content areas. A review process allows us to monitor
our impact and track our success toward opening minds to science.
2 Saint Louis Science Center
METHODOLOGY
Since 1997, the Saint Louis Science Center has collected information about the
experience of participants in our programs. At the Science Center, we define
programs as, “staff-led interactions scheduled for a specific audience with
written educational goals and objectives.” From 1997 through 2008, the Science
Center used the Better Education and Revenue Through Tracking (BERTT)
system to assess the experiences of program participants. Beginning in 2008,
the Research & Evaluation Department engaged in a systematic evaluation of
BERTT, with the goal of developing a new system that would more accurately
assess the impact of Science Center programs on participants.
In January 2009, after extensive development and testing, the Science Center
debuted the System for Assessing Mission Impact (SAMI). SAMI collects and
summarizes key performance indicators for Science Center educational programs.
SAMI tracks the following elements related to program performance:
• Average length of a program
• Number of times offered
• Number of interactions (an individual’s participation in a program)
• Total hours of interaction
• Average Knowledge, Enjoyment, Interest and Attitude ratings by
participants (each on a 4-point scale, with 4 as the highest rating)
• Participants’ descriptions of what they got out of the program
• Participants’ suggestions for improvement
• Impact Score (16-point scale, with 16 as the highest score)
SAMI tracks the following characteristics of program respondents, based on
their responses: gender, residency, membership status and visitation frequency.
Defining and Measuring Impact
On an individual level, impact results from a Science Center offering that
enables a participant to make personal connections between the content and
experience of the offering and their own knowledge and experiences.
In the short-term, this is illustrated by a change in knowledge, understanding,
enjoyment, interest or attitude. Over the long term (months to years), this is
illustrated by an incorporation of these changes into participants’ lives. The larger
effects of these long-term individual impacts are felt within the Science Center
and throughout the broader communities of which the Science Center is a part.
The Impact Score provides a numerical way to represent the impact that
participation in a program has on an individual. Program participants rate
four questions, which correspond to the four main components of the Impact
definition: knowledge/understanding, enjoyment, interest and attitude. The
Knowledge, Enjoyment, Interest and Attitude ratings are summed to produce the
Impact Score. The lowest possible Impact Score is four and the highest is 16.
Saint Louis Science Center
3
Data Collection Process
Program staff distribute comment cards to a sampling of program participants.
Respondents are invited to answer four questions, based on the Impact definition,
which are rated on a 4-point scale where 1 is “No, not at all”, 2 is “Only a little”, 3
is “Quite a lot” and 4 is “Yes, definitely!”:
• Knowledge Rating: Measures a change in knowledge or understanding.
“Did you, or others in your group, learn content and/or skills from
this program?”
• Enjoyment Rating: Measures the degree to which participants enjoyed the
program. “Did you enjoy this program?”
• Interest Rating: Measures the influence of this experience on future
interest in science or technology. "Did this program make you want to try
another experience with science or technology?"
• Attitude Rating: Measures the reinforcement or increase of positive
attitudes toward science or technology. “Did this program reinforce or
increase any positive attitudes you have towards science or technology?”
Participants are also asked to respond to the following open-ended questions:
• “Please describe what you got out of this program.”
• “How could we improve this program?”
The responses to these questions are coded for analysis.
A version of the response cards with child-friendly language is distributed to
participants under the age of 14.
OVERVIEW OF SAINT LOUIS SCIENCE CENTER PROGRAMS
September 2010 to August 2011
Broad View of Program Interaction
From September 2010 to August 2011, the Saint Louis Science Center offered
approximately 150 distinct programs to a wide range of audiences including:
children, families, teachers, school groups and adults. These programs ranged
from one-time events such as HealthFest and Engineering Career Day to
recurring programs such as Summer Science Blast and Public Telescope
Viewings. Each time a visitor participated in a program offering, this was
recorded as an “interaction” for that particular program. “Interactions” varied
in length from a five minute Segway 5-4-5 offering to an eight-day International
Explorations trip. During the timeframe covered by this report, 400,145 program
interactions took place for a total of 372,150 hours of engagement. On average,
visitors spent approximately one hour participating in a program offering.
During many of the programs, participants were given the opportunity to fill out
a comment card and rate their experience. From September 2010 to August
2011, a total of 10,687 comment cards were collected from visitors for an overall
return rate of 3%. Respondents gave the following average ratings:
• Impact Score: 14.00 (out of 16)
• Knowledge: 3.50 (out of 4)
• Enjoyment: 3.66 (out of 4)
• Interest: 3.43 (out of 4)
• Attitude: 3.41 (out of 4)
Program staff enter the responses into a shared database. This database allows
the Research & Evaluation Department to calculate average length, interactions
and participant ratings for specific programs, departments and Science Center
program offerings as a whole. This information is analyzed and presented in
monthly, quarterly and end-of-year reports, in addition to this annual report to
our community stakeholders.
In addition to the ongoing program measures collected and reported monthly,
quarterly and annually, the Science Center also conducts more in-depth
evaluation of selected programs. Periodically, the Science Center contracts with
external evaluators to conduct front-end, formative and summative evaluations
on specific programs. This report contains findings from both internal evaluations
conducted by the Science Center’s Research & Evaluation Department as well
as evaluation studies conducted by external evaluators. Unless otherwise noted,
data and findings originate from the Research & Evaluation Department.
4 Saint Louis Science Center
Saint Louis Science Center
5
Characteristics of Program Respondents
ADULTS &
CHILDREN
Adults
Adults
Males 49%
49%
Adults
49%
%
3%
o4
ear
Analysis of Ratings by Age, Gender, Residence,
Membership Status and Visitation Frequency
GENDER
40%
Females
Children
60% Children
Females
60%
51%
51%
49% 49%
Another
State
Missouri
73%
Another
St. Louis
State City
14%
City
14%7%
St. Louis
Missouri
County
Illinois
Another
Illinois
Another
Missouri
73%
Other
73%
39%
20%State 20%
State
Local
30%
7%
7%
17%
Missouri
Illinois Illinois Missouri
73% 73%
20%
20%
By State
19%
30%
Males Males
40%
St. Louis
County
39%
7%
St. Louis
County
St. Louis
City
St. Louis
City
14%
14%
Other
39%Other
Missouri
Local
Illinois
Local
St.
LouisSt. Louis
73%
20%30%
City City30%
14%
Tourist14%
Tourist
St. 17%
LouisSt. Louis17%
County County
Other Other
39% 39%
Local
Local* vs.Local
Tourist
30% 30%
Tourist Tourist
VISITATION
FREQUENCY
17% 17%
MEMBERSHIP STATUS
First time First-time First-time
visitor
in 12 months visitor
60%
RESIDENCY
Another
State St. Louis
Tourist
Total equals 101% due to rounding.
First time First time
in 12 monthsin 12 monthsFirst-time
visitor
30%
First time
in 12 months
fourteen surrounding counties in Missouri and Illinois.
3 to 4 3 to 4
times atimes
year a year
St. Louis
County
Other
Local
30%
39%
Tourist
17%
As illustrated in the table below, respondents completing adult cards gave
significantly higher ratings than those completing child cards for all four questions,
resulting in a significantly higher Impact Score from adult cards (14.41) than from
child cards (13.61). Females gave significantly higher ratings than males for all four
questions and the Impact Score for females (14.11) was also significantly higher
than that of males (13.84).
Tourist respondents (program participants from outside the St. Louis metropolitan
area) gave significantly higher ratings for all four questions, when compared to
local respondents. The Impact Score for tourists was 14.33, compared to 13.96 for
locals. Within the St. Louis metropolitan area, residents of local Missouri counties
other than St. Louis City and St. Louis County had higher Impact Scores, on
average, than residents of Illinois, St. Louis City and St. Louis County. The Impact
Score for local residents from other Missouri counties was 14.25, compared to
13.97 for local residents from Illinois, 13.79 for St. Louis City residents and 13.90
for St. Louis County residents.
*The p-value is a measure of
significance. In general, p-values
of 0.05 or less are considered
statistically significant.
Members gave significantly higher ratings than Non-members for questions
regarding Knowledge and Enjoyment. The Impact Score for Members (14.19) was
also significantly higher than for Non-members (14.02). Membership status did
not significantly affect responses regarding Interest or Attitude.
There were significant differences based on visitation frequency. Those
respondents who reported being frequent visitors (three or more visits per year)
gave significantly higher ratings on all four questions than regular (one to two
visits per year) or infrequent (fewer than one visit per year) visitors. Frequent
visitors also had a significantly higher Impact Score (14.21) than regular or
infrequent visitors (14.07 and 13.87, respectively).
IMPACT SCORE KNOWLEDGE ENJOYMENT INTEREST
19%
19%
Members
Members
Members
30%
19%
23%
First time
First-time
23%
First time
First-time23%
in 12 months
visitor visitor
in 12 months
Non15%
NonNon15%
24%
24%
24%
members
members30% 30%19%
members
15%
24%
19%
77%
13%
Members
77%
77%
Members
13%
1 to 2
1 to 2 5 or more 5 or more
1 to 2
13% 23% 23% 1 to 2
times atimes
year a yeartimes a year
times a yeartimes a 5year
or more
times a year
times a year
3 to 4
Non3 to
4
15%
Non15%
24% 24%
members
times a yeartimes a year
3members
to 4
77%a year
times
13% 13%
77%
1
to
2
1 to 2
5 or more
5
or
more
*Residing within thetimes
St. Louis
metropolitan statistical area times
which includes
Louis City, St. Louis County and
atimes
year aSt.
year
atimes
year
a year
6 Saint Louis Science Center
40%
Females
60% 60%
51%
7%
60%
40%
Females
Females
Children
Children
Males
Children
51%
Adults Adults
51%
Males
Males
40%
40% Adults
Females
49%
Overall, Science Center programs seemed to have the greatest impact on adults,
females, tourists and frequent visitors. Unless otherwise noted, all comparisons
presented here are statistically significant at p<0.05.*
Members Adults
23% Children
Females
NonMales
members
Tourists
77%
Locals
Members
Non-members
Frequent Visitors
Regular Visitors
Infrequent Visitors
14.41
13.61
14.11
13.84
14.33
13.96
14.19
14.02
14.21
14.07
13.87
3.62
3.39
3.54
3.45
3.59
3.50
3.57
3.50
3.55
3.50
3.49
3.71
3.62
3.68
3.64
3.73
3.66
3.69
3.66
3.70
3.67
3.65
3.53
3.32
3.46
3.37
3.52
3.40
3.46
3.44
3.49
3.45
3.37
ATTITUDE
3.55
3.28
3.43
3.38
3.50
3.40
3.47
3.42
3.47
3.45
3.37
Saint Louis Science Center
7
“As a sci-fi fan I like to see
the science behind the
fiction.This program did it!”
– Adult participant, SciFest:
The Science of Avatar
“The magnitude of the
problem is astounding.
Dr. Cicerone did
an excellent job
explaining the problem
& the challenges with
solutions”
– Adult participant, Dr.
Ralph Cicerone Climate
Change Lecture
PROGRAM OVERVIEW BY DEPARTMENT
At the Science Center, programs are divided into six major departments: Center
for Science, Challenger Learning Center~St. Louis, Community Science, Public
Programs, School Programs and Science & Galleries. Following is an analysis
of program offerings based on these categories. Unless otherwise noted, all
comparisons presented here are statistically significant at p<0.05.
Center for Science
The Center for Science showcases the Science Center as a scientific information
resource for the community. Programs in this department feature cuttingedge science topics and opportunities to interact with scientists. Many of the
programs are designed for adults, while some are offered for middle and high
school students. A lecture series corresponding with the Body Worlds & The
Brain exhibition covered topics ranging from ADHD to Alzheimer’s Disease. On
the topic of climate change, the Science Center hosted a lecture by Dr. Ralph
Cicerone, President of the National Academy of Sciences. Travel programs, such
as Science of National Parks, offer opportunities for authentic field work in
areas such as archaeology, paleontology and ecology.
Participants at Science Cafe Wicked Plants: The Sinister
Aspect of the Plant World discuss the history and science
behind poisonous plants.
(Photo: Saint Louis Science Center)
“I got to go out and
find dinosaur bones,
what could be cooler
than that?”
– Adult participant,
Paleotrek
8 Saint Louis Science Center
Offerings: 12 distinct programs
Reported interactions: 49,338
Total hours of engagement with programs: 32,888
Average length of engagement with programs: 40 minutes
Range of program engagement times: 10 minutes to 8 days
Overall ratings (1,832 cards collected from Sept. 2010 to Aug.
2011; 4% return rate):
• Impact Score: 13.62 (out of 16)
• Knowledge: 3.38 (out of 4)
• Enjoyment: 3.53 (out of 4)
• Interest: 3.36 (out of 4)
• Attitude: 3.36 (out of 4)
Of all respondents, 75% completed adult comment cards, 92% reported living
within the St. Louis Metropolitan Area and 34% reported visiting the Science
Center three or more times annually. Those completing adult cards had a
significantly higher Impact Score (14.05) than those completing child cards (12.34).
Members had a significantly higher Impact Score (14.13) than Non-members
(13.46). Visitation frequency also significantly impacted ratings. Frequent visitors
had a significantly higher Impact Score (14.00) than regular or infrequent
visitors (13.74 and 13.25, respectively). Respondents’ comments indicated they
gained a great deal of knowledge and skills from Center for Science programs.
Compared to comments from participants in other departments, Center for
Science program participants were more likely to mention a change in attitude
or increased interest in science due to their experiences.
Challenger Learning Center-St. Louis
Located in Ferguson, Missouri, the Challenger Learning Center provides a
variety of space and science education programs for schools, scouts, community
groups, corporations and the general public. The core programming at the Center
involves two space simulation environments: an “orbiting” space station and a
Mission Control room. The Center is part of the Challenger Center for Space
Science Education, an international, not-for-profit organization founded by the
families of the astronauts lost in the Challenger space shuttle mission in 1986. In
St. Louis, the Center is supported by a regional partnership of the Saint Louis
Science Center, the Ferguson-Florissant School District and the Cooperating
School Districts. Some of the programs offered in 2010-11 included: Voyage to
Mars, Aquatic Robotics and Corporate Teambuilding Missions.
Offerings: 12 distinct programs
Reported interactions: 19,735
Total hours of engagement with programs: 45,183
Average length of engagement with programs: 2 hours and 15 minutes
Range of program engagement times: 30 minutes to 5 days
Overall ratings (883 cards collected from Sept. 2010 - Aug. 2011; 4% return rate):
• Impact Score: 13.58 (out of 16)
• Knowledge: 3.39 (out of 4)
• Enjoyment: 3.69 (out of 4)
• Interest: 3.25 (out of 4)
• Attitude: 3.26 (out of 4)
Overall, 83% of respondents completed child cards and 80%
were first-time visitors to the Challenger Learning Center.
Approximately 99% of respondents resided in the St. Louis
Metropolitan Area, with 50% residing in St. Louis County. There
were no significant differences in ratings based on gender,
residence or visitation frequency. Those who completed
adult cards gave significantly higher ratings for Knowledge,
Enjoyment, Interest and Attitude than those who completed
child cards, resulting in a significantly higher Impact Score from
adult cards (14.93) than from child cards (13.31). Participants
frequently commented on the knowledge and skills learned
from their experiences at the Challenger Learning Center.
“I learned how a space
shuttle works, and got
to experience what it's
like to go into space!”
– Child participant,
Student Mission:
Comet
“The need for good
communication in
a group dynamic is
critical for efficient
and effective work.”
– Adult participant,
Corporate Team
Building Mission
Students in the Discovery Classroom: Great Rocket
Design Challenge watch as the commander launches a
participant-designed rocket.
(Photo: Saint Louis Science Center)
Saint Louis Science Center
9
“I learned that if you
make math fun, it's not
really that hard.”
– Adult participant,
YES: Community
Partner Meetings
“That when a tree falls
it goes bad and breaks
up and turns into dirt
and grows plants and
gives oxygen.”
– Child participant,
Summertime Science:
Rotting Logs
YES participants identify a catch in
Communicating Climate Change.
(Photo: Saint Louis Science Center)
“I appreciate that
science is in everything
we do and eat and
drink.”
– YES participant, YES
Summer AgriScience
Challenge
10 Saint Louis Science Center
Community Science Department
Public Programs Department
The Community Science Department cultivates relationships with communitybased organizations serving families throughout the St. Louis area, including
Herbert Hoover Boys and Girls Club, Girls, Inc. and Annie Malone Children’s
Services. Programs developed with these partners promote wellness, diversity
and education while integrating science, technology, engineering and math
concepts and curricula. Partner organizations also contribute to the Science
Center through participation in programs such as Minority Scientists Showcase
and through recruiting teens from their client base for the Youth Exploring
Science (YES) program.
The Public Programs Department offers programs both at the Science Center
and off-site, through ScienceOFFCenter, for a variety of audiences including:
adults, families, Scouts, children and home-school groups. School-age children can
participate in hands-on, engaging programs such as badge workshops, overnight
camp-in experiences or week-long day camps. Through the Science Center’s
Segway Tours, visitors learn how to operate the Segway and explore historic
sites in and around St. Louis. Other programs include: Summer Science Blast,
Holidazed Camps and specialized Camp-Ins focused on a theme such as space
and astronomy. The department also offers customized programming such as
team building, programs for older adults and specialized Scout badge workshops.
“Appreciation for the
wonder of science. I
work in the field of life
sciences. This brought
me back to the intrigue
& fascination I had as
a kid!”
– Adult participant,
Camp-In
Offerings: 54 distinct programs
Reported interactions: 27,040
Total hours of engagement with programs: 71,381
Average length of engagement with programs: 2 hours and 40 minutes
Range of program engagement times: 2 minutes to 5 days
Overall ratings (2,720 cards from Sept. 2010 - Aug. 2011; 10% return rate):
• Impact Score: 14.19 (out of 16)
• Knowledge: 3.54 (out of 4)
• Enjoyment: 3.72 (out of 4)
• Interest: 3.48 (out of 4)
• Attitude: 3.45 (out of 4)
“How to correctly trim an
aircraft and the proper
assent/descent and turns
for a Cessna 172.”
– Child participant,
Summer Science Blast:
Flight Academy
YES serves youth facing multiple risk factors and works with teens throughout the
course of their high school career. YES provides a work-based, inquiry-learning
environment focusing on science, technology, engineering and mathematics. As
part of the program, YES teens also take on teaching responsibilities, facilitating
hands-on science and math activities at community partner organizations. Overall,
the YES program allows participants to gain professional, academic and real-world
skills that assist in building self-confidence and achieving success. Through their
service, each individual teen greatly extends the impact of the Science Center
into the community. YES offers a number of programs, including: AgriScience,
Mystery of Matter and Robotics/Sea Perch.
Offerings: 20 distinct programs
Reported interactions: 15,027
Total hours of engagement with programs: 26,546
Average length of engagement with programs: 1 hour and 45 minutes
Range of program engagement times: 30 minutes to 4 days
Overall ratings (719 cards collected from Sept. 2010 - Aug. 2011; 5%
return rate):
• Impact Score: 13.77 (out of 16)
• Interest: 3.36 (out of 4)
• Knowledge: 3.45 (out of 4)
• Attitude: 3.40 (out of 4)
• Enjoyment: 3.56 (out of 4)
Of all respondents, 53% completed child cards and 54% were male. Community
Science program participants were more likely than participants in other
departments to be Members of the Science Center (34%), to have visited the
Science Center three or more times in the last year (48%) and to reside in St. Louis
City (58%). In general, those who completed child cards gave significantly higher
ratings than those who completed adult cards, and females gave significantly higher
ratings than males. Consequently, the Impact Score from child cards (14.06) was
significantly higher than from adult cards (13.43), and the Impact Score for females
(14.21) was significantly higher than for males (13.41). Respondents’ comments were
positive and most frequently described knowledge and skills gained.
“Confidence. I'm
not too old to learn
something new.”
– Adult participant,
Segway 101
Overall, 61% of respondents completed child cards, 19% were Science Center
members and 81% were local residents. Those who completed adult
cards rated their experience significantly higher than those who
completed child cards in all areas, leading to a significantly higher
Impact Score from adult cards (15.00) than from child cards (13.67).
Tourists also gave significantly higher ratings than local residents in
all four areas. Consequently, the Impact Score for tourists (14.63) was
significantly higher than that of locals (14.23). Gender, membership
status and visitation frequency did not significantly affect ratings.
Respondents’ comments indicated they gained a great deal of
knowledge and skills from their experience. Respondents who
participated in Public Programs mentioned enjoying their experience
more than respondents from any other department.
Participants in Summer Science Blast: Physics Phun
work together to build a compartment to protect their
egg from a high drop.
(Photo: Saint Louis Science Center)
Saint Louis Science Center
11
“I learned a lot of
science, and also about
wind instruments! And
making sound with
the glass cup was
awesome!”
– Child participant,
Science of Sound:
Instrument Making
Workshop
School Programs Department
Science & Galleries Department
The School Programs Department offers hands-on, inquiry-based science
workshops to area schools. These workshops take place both at the Science
Center and in school classrooms. The department also offers professional
development workshops for teachers and opportunities for parents to develop
skills in interacting with their children to facilitate science and mathematics
learning in the home. School Programs staff work directly with educators to
identify target areas and content focus and to design customized programs that
encourage both students and educators to take ownership of the experience. All
programs conform to Missouri and Illinois state standards. Programs delivered in
the 2010-11 year included: Earth Systems, Family Math in Your School, Science of
Sound and Our Solar System and Universe.
Programs offered through this department primarily occur within the Science
Center’s permanent galleries and are facilitated by the gallery staff. These
programs focus on the Science Center’s five main content areas: earth science,
emerging technologies, life science, physical science and aerospace science.
As appropriate for program content, some programs in this department may
be held at off-site locations. These programs are available for visiting school
groups as well as the general public. They range from daily, 10-minute Amazing
Science Demonstrations, such as “Cool, It’s Cryogenic” to annual events such
as NeuroDay. This department also offers early childhood programs through
the Discovery Room, such as A Sense of Me, and opportunities to engage in real
science experiments, such as DNA In-Depth, in the Life Science Lab Classroom.
Other programs within this department include: The Biology of The Giver, LEGO®
MINDSTORMS® and Family Med School.
Participants in Family Math in Your School explore math
in a hands-on way. (Photo: Saint Louis Science Center)
“I got to feel what
clouds were like and
it was one of the best
activities ever.”
– Child participant,
Earth Systems: Water
Cycle Investigation
“I wasn't crazy about
science before, [but] now
I am eager to teach it.”
– Adult participant,
Professional
Development Workshop:
Inquiry Workshop
12 Saint Louis Science Center
Offerings: 17 distinct programs
Reported interactions: 22,025
Total hours of engagement with programs: 23,054
Average length of engagement with programs: 1 hour and 5
minutes
Range of program engagement times: 10 minutes to 6 days
Overall ratings (1,032 cards from Sept. 2010 - Aug. 2011; 5%
return rate):
• Impact Score: 13.65 (out of 16)
• Knowledge: 3.36 (out of 4)
• Enjoyment: 3.61 (out of 4)
• Interest: 3.37 (out of 4)
• Attitude: 3.31 (out of 4)
Of all respondents, 71% completed child cards and 86% were local residents.
Approximately 90% of respondents were Non-members, which was the highest
of any department. Those who completed adult cards gave significantly higher
ratings than those who completed child cards for all categories, resulting in a
significantly higher Impact Score from adult cards (14.48) than from child cards
(13.31). Female respondents gave significantly higher ratings than males in
Knowledge, Enjoyment and Interest and had significantly higher Impact Scores:
13.95 for females and 13.27 for males. Ratings were not significantly affected by
respondents’ residence, membership status or visitation frequency. In general,
comments from participants were positive and indicated a high level of learning.
Offerings: 34 distinct programs
Reported interactions: 266,980
Total hours of engagement with programs: 173,098
Average length of engagement with programs: 40 minutes
Range of program engagement times: 10 minutes to 7 hours
Overall ratings (3,501 cards from Sept. 2010 - Aug. 2011; 1%
return rate):
• Impact Score: 14.32 (out of 16)
• Knowledge: 3.62 (out of 4)
• Enjoyment: 3.72 (out of 4)
• Interest: 3.50 (out of 4)
• Attitude: 3.49 (out of 4)
“I learned a lot about
brains that I never
thought was possible. I
can't wait to go to school
and tell my friends.”
– Child participant,
Family Med School
A participant in Algaepalooza looks at algae through a
microscope. (Photo: Saint Louis Science Center)
Overall, 58% of respondents completed adult cards and 25% were Members. A
higher percentage of respondents were female (68%) or tourists (28%) than was
reported for any other department. Those who completed adult cards gave higher
ratings in Knowledge, Enjoyment and Attitude than those who completed child
cards and had significantly higher Impact Scores: 14.46 from adult cards and 14.12
from child cards. Local residents gave significantly higher ratings for Knowledge
than tourists, and Members gave significantly higher ratings for Knowledge and
Enjoyment than Non-members. Frequent visitors had a significantly higher Impact
Score (14.58) than regular or infrequent visitors (14.23 and 14.25, respectively).
Respondents’ comments frequently noted content learned. A number also
mentioned enjoying the presenters or presentation methods.
“Great genetic start!
Awesome way to blend
science with literature!”
– Adult participant, The
Biology of the Giver
“I liked seeing first-hand
some of the processes
used to extract &
identify DNA”
– Adult participant,
Gene Shorts
Saint Louis Science Center
13
PROGRAM SPOTLIGHT
This section highlights three of the approximately 150 programs offered during
the 2010-11 program year. The selected programs offer participants prolonged
engagement, ranging from multiple days to multiple months, with science and
technology content and experiences. In 2010-11 we highlight: PNC: Grow Up
Great!, HomeSchool Days & HomeSchool Labs and Unplugged: Uphill Derby.
Program Spotlight: PNC: Grow Up Great! (Science & Galleries)
Background
Grow Up Great!, funded by PNC Bank, is a partnership between PNC and several
St. Louis institutions. It is a local adaptation of a national early childhood initiative
by PNC. The Science Center joins Grace Hill Settlement House, the Saint
Louis Art Museum, the Missouri Botanical Garden, the St. Louis Symphony and
Maryville University to “provide exploration in the arts and sciences that inspires
in young children inquiry and problem solving, communication and expression,
and self-awareness and self-confidence.” (Nelson, 2011) In a press release from
September 2010, Roderick Jones, executive director of the Grace Hill Settlement
House stated, “All too often, field trips are planned in isolation to the overall
learning experience in the classroom with little thought about the long-range
educational impact they can have on the student and their future academic growth
and success. PNC: Grow Up Great! provides a multi-dimensional experience.
Research shows a greater transfer of learning when the field trip is related to
classroom teaching and the broader instructional program.” The 2010-11 academic
year was the second year for the program in St. Louis. Two schools associated
with the Grace Hill Settlement House – Carondelet and Howard Branch Head
Start – participated in the program. During the 2010-11 school year, the Science
Center worked with 260 students and 13 teachers.
Program Structure
Two young scientists from Grace Hill Carondelet Head
Start use science tools to sort and match. (Photo: Saint
Louis Science Center)
14 Saint Louis Science Center
The program’s goal of helping preschool age children to “grow
up great,” allows for partner institutions to work not just with
the students, but also with parents and teachers. Maryville
University was involved with curriculum development, teacher
professional development, curriculum coordination and
program evaluation. Likewise, each partner institution used
its unique resources to facilitate inquiry with the children.
In particular, the Science Center held several professional
development workshops for teachers on science-related topics
such as “Color Mixing and the Scientific Method” and “Inquiry/
Open-Ended Questions”. The Science Center also provided
the classrooms with materials to better support science in the
curriculum. Students participated in programs about “Critters
and Simple Tools” and attended Discovery Room sessions at the Science Center.
Parents and guardians had the opportunity to join the students and teachers on
field trips. Families also received materials designed to facilitate exploration and
inquiry at home, including activity booklets.
Evaluation Methodology
Nadine Ball, Professor at Maryville University, was the Project Evaluator for PNC:
Grow Up Great! St. Louis. The evaluation of the program for the 2010-11 year
used a range of qualitative and quantitative methods to assess if the program
was meeting its objectives. Ball conducted surveys and interviews with teachers,
parents and partner institutions. Classrooms were observed in fall 2010 and
spring 2011 to assess teacher-student interaction and students’ participation with
and understanding of the content being explored. The observation protocol was
designed with Head Start Program Performance Goals, Missouri Pre-K Standards,
National Association for the Education of Young Children resources and PNC:
Grow Up Great! goals in mind.
The Science Center conducted a survey with teachers in spring 2011 to gather
feedback on the Center’s efforts during fall 2010. Questions were asked about
the impact of the workshops on teachers and the teachers’ perspectives of the
impact of the Science Center’s portion of the PNC: Grow Up Great! program on
their students.
Impact on Teachers
Building on program goals for teachers, the Science Center’s goal was to show
that science can be, and already is, an everyday part of the preschool classroom.
One teacher said, “After attending the workshops [offered by the Science
Center], I began to look outside of the box, with the materials we received.”
Teachers included the materials and the ideas for activities in their curriculum.
Another teacher stated, “That [incorporating science] was really simple, I think I
was over thinking science.”
As seen in the table below, teachers’ average ratings are relatively high (3.50 and
above). In particular, the Interest and Attitude ratings, which ask about increased
interest in science-related activities and increased positive attitude toward
science, are 3.75 and above. This indicates the workshops are sparking teachers'
interest in making science more relatable in their classrooms.
WORKSHOP
IMPACT SCORE KNOWLEDGE ENJOYMENT INTEREST ATTITUDE
“Color Mixing and Scientific Method”
14.63
3.50
3.63
3.75
3.75
“Magnets and Inquiry”
14.90
3.63
3.75
3.86
3.75
Saint Louis Science Center
15
* All phrases in italics
represent criteria
identified in Nadine
Ball’s external evaluation
report: Grow Up Great:
St. Louis¸ Evaluation
Processes & Results
(August 2011).
Classrooms at both Carondelet and Howard Branch were observed to assess
changes made in response to the professional development workshops. Ball
reported that Carondelet classrooms improved in responding to what children
do and say by building upon their language.* To assess if teachers were using
skills taught in the professional development workshops, the evaluation used a
three-point scale to measure any demonstrated change in the teacher’s practice.
The observer would note 1 if they “rarely” saw a particular action occurring (for
example, asking open-ended questions) and 3 if they “often” observed that action.
During the fall 2010 observations, Ball reported 43% of Carondelet teachers
were “often” observed responding to what children do and say by building upon
their language and 57% were “sometimes” observed (a 2 in the three-point
scale). In the spring 2011 observations, all Carondelet teachers were observed
performing that action “often”. Howard Branch teachers demonstrated growth in
several criteria, most notably in having materials available to foster independent
exploration; 67% of teachers originally observed to “sometimes” have materials
available increased to being “often” observed.
Ball reported that in spring 2011, 77% of teachers indicated the use of literacy
materials from cultural partners in dramatic play areas was a practice that they
learned about for the first time, or that they understood or practiced more deeply/
effectively because of the Grow Up Great! program. The majority of teachers
(67%) indicated that they learned to introduce new vocabulary and concepts
before going on special field trips and to debrief and discuss with children what
they have learned after a field trip or other special activity.
Impact on Students
Teachers provided SAMI feedback on behalf of their students. For the fall
Science Center sessions, the overall Impact Score was 14.99 out of 16. The overall
average ratings were: 3.87 for Knowledge, 3.87 for Enjoyment, 3.46 for Interest
and 3.79 for Attitude.
SESSION TITLE
IMPACT SCORE KNOWLEDGE ENJOYMENT INTEREST ATTITUDE
“Critters and Simple Tools”
14.87
3.87
3.87
3.38
3.75
Discovery Room Sessions
14.99
3.87
3.87
3.50
3.75
“Physical Knowledge”
15.12
3.87
3.87
3.50
3.88
Overall Fall 2010 Ratings
14.99
3.87
3.87
3.46
3.79
Head Start frames their curriculum around Creative Curriculum objectives,
which focus on helping children to develop process-oriented skills rather
than content knowledge. In spring 2011, the following actions increased from
“sometimes” to “often” observed in 77% of classes at Howard Branch: children
persisting in activities and children showing ability to solve problems. One
teacher articulated that the “Physical Knowledge” session, “Help[ed] them
to understand how to use magnets and microscopes. It also help[ed] them to
explore, to figure out how things worked on their own.” The classroom observer
gave children scores, measuring the effects of the program on the children’s use
of expanding expressive vocabulary, engaging in conversation, showing curiosity
and motivation and other possible effects. Children in both Head Start centers
showed an increase in scores between fall and spring classroom assessments.
Families
In the teachers’ survey distributed by Ball, some teachers related the impact of
the program on parents and families as a whole. “The program had a big impact
for my children and parents. Some of my families were surprised at what the
children could do, [for] example – talking and [the] manipulation of magnet[s]
and the outcomes of activities. The children would go home and talk about
their day, with excitement, not just saying [that they] played. They actually
talked about activities and what they did. It made me know, they were really
learning something.”
Conclusions
The PNC: Grow Up Great! program’s main goal is to help children of preschool
age to “grow up great.” Rather than focusing solely on the child’s development,
the program also provides professional development for teachers and shared
experiences for families. This allows for an increase in awareness of the need for
investing in their children’s experiences in and out of the classroom. Teachers
remarked on the benefits of adding new perspectives in science and being
able to see how science connects to everyday teaching. Additionally, teachers
made observable changes to their practice in response to skills learned in the
professional development workshops. Every partner institution focused on
getting children to explore, and getting families to see that inquiry is important
for children’s growth. As one teacher stated, children “learned that science is in
their daily lives and it is exciting to explore.” The Science Center’s contribution
to PNC: Grow Up Great! provided a new and rich opportunity for all participants.
Comments from teachers about their students focused not only on topics that
the students were learning in the sessions, but also acknowledged the comfort
level of children in exploring science. After a Discovery Room visit, one teacher
said, “Children enjoyed the Discovery Room. They learned various concepts
through play.” After attending the “Critters and Simple Tools” session, another
teacher noted, “[The] children were able to learn about bugs, and count and sort
at the same time. Incorporating Math and Science.”
16 Saint Louis Science Center
Saint Louis Science Center
17
Program Spotlight: HomeSchool Days & HomeSchool Labs
(Public Programs)
Background
HomeSchool Days (HSD) and HomeSchool Labs (HSL) are offered through the
Science Center’s Public Programs Department. Created for the homeschool
audience, HSD and HSL offer opportunities to expand curricula for students and
parents in math, science and technology. Since 2002, students in kindergarten
through 6th grade have participated in HSD. Led by program staff, students
explore a wide range of topics, such as biology and nanotechnology, through
hands-on activities. HSL began in January 2011 as a way to reach homeschool
children ages 12 and older. The program exposes students to the scientific process
through experiences with lab procedures and designing their own experiments.
Program Structure
HomeSchool Days sessions occurred on the third Tuesday of each
month. Students participated in hands-on activities in topics such
as astronomy, food science and zoology. Classes were offered for
three age ranges: Kindergarten-1st grade, 2nd-3rd grade and 4th6th grade.
Erin Nolan works with two participants in HomeSchool
Labs: Electricity as they build circuits.
(Photo: Saint Louis Science Center)
As an expansion of HomeSchool Days, HomeSchool Labs classes
were set up as a three-part series. Students’ learning built on skills
and knowledge gained in earlier classes. In 2011 there were three
series: “Electricity,” “Chemistry,” and “Anatomy.” Each series was
held over a six-week period, with one class every two weeks. The
first class in each series taught basic lab practices and introduced
new concepts. The next two classes reinforced and expanded on
the basic concepts.
Evaluation Methodology
HomeSchool Days
Twelve HSD sessions occurred between September 2010 and August 2011.
Monthly session participant attendance ranged from 15 to 51, with many students
participating in multiple sessions, resulting in 397 interactions. At the end of
five of the twelve sessions, child participants completed System for Assessing
Mission Impact (SAMI) cards. Children too young to write were assisted by
program staff. In those five sessions, there were 129 points of interaction and
a total of 81 SAMI cards collected, resulting in a 63% response rate. In March
2011, a parent survey was conducted on-site. Eight parents provided feedback.
In September 2011, a follow-up online survey for parents about their family’s
overall experience with HSD was sent to 24 parents who had provided email
addresses throughout the academic year. A total of 17 surveys were completed,
for a response rate of 71%.
18 Saint Louis Science Center
HomeSchool Labs
SAMI cards were also collected from HSL student participants. A total of nine
SAMI cards were collected from two of the three series. In the series in which
SAMI cards were collected, “Chemistry” and “Anatomy”, there were a total of 39
interactions, for a response rate of 23%. In September 2011, an online follow-up
survey was sent to parents who provided emails during the “Anatomy” series.
Two parents out of four responded, for a response rate of 50%.
Characteristics of the Samples
HomeSchool Days
“Amazing Astronomy” and “Nano-Tech” had the highest attendance
of the HomeSchool Days with 51 students each. The highest
percentage of respondents from the online parent survey, 65%,
reported attending “Amazing Astronomy”; 65% of respondents
also reported attending “CSI: Einstein Enigma.” Of respondents
to the online survey, 18% reported only participating in the last
session, which took place in August 2011. Many parents (44%
of respondents) reported attending sessions before the 201011 academic year. One parent reported attending sessions prior
to 2006. In total, the parents who responded had 25 children
participate during the 2010-11 school year. Parent respondents
had children from pre-kindergarten to 6th grade participate in
the program. Parents who had Science Center memberships
accounted for 60% of respondents. None of the families that A participant in HomeSchool Days: Amazing Astronomy
creates a constellation cup.
responded were from St. Louis City; slightly less than 50% were (Photo: Saint Louis Science Center)
from St. Louis County, with the rest of the respondents residing
in other counties in the St. Louis metropolitan area. Frequent
visitors to the Science Center represented 81% of SAMI card respondents. Of
child participants who reported their gender, 63% were male participants; 38%
were female participants.
HomeSchool Labs
Of the SAMI card respondents, 33% were female and 67% were male. Frequent
visitors represented 78% of respondents; 67% of respondents were Members.
Unlike HSD, HSL did have participants from St. Louis City (22%), although the
majority of participants (66%) came from either St. Louis County or other
counties within the St. Louis metropolitan area. From the online survey, students’
ages ranged from 6th grade to 8th grade.
Saint Louis Science Center
19
Impact of HomeSchool Days
Impact of HomeSchool Labs
Based on the data collected via the online survey for parents, the overall Impact
Score was 13.88 out of 16. The overall ratings were: 3.19 for Knowledge, 3.75 for
Enjoyment, 3.38 for Interest and 3.56 for Attitude. From the data collected from
the SAMI cards, HSD had an Impact Score of 13.86. The overall ratings were:
3.38 for Knowledge, 3.52 for Enjoyment, 3.62 for Interest and 3.35 for Attitude.
Children whose families had memberships had significantly higher ratings and
higher average Impact Score (15.00) than Non-members (11.65).
From the data collected from the parent survey, the overall Impact Score was
16.00. Knowledge, Enjoyment, Interest and Attitude categories all received an
average of 4.00 from parents. From the SAMI cards, HSL had an overall Impact
Score of 14.56. The students’ overall ratings were: 3.67 for Knowledge, 3.78 for
Enjoyment, 3.67 for Interest and 3.44 for Attitude.
SESSION TITLE
IMPACT SCORE KNOWLEDGE ENJOYMENT INTEREST ATTITUDE
“Design it. Build it.”
12.78
2.91
3.26
3.57
3.04
“Go Green”
14.12
3.59
3.47
3.59
3.47
“Reflex Remix”
14.18
3.36
3.73
3.73
3.36
“CSI: Einstein Enigma”
14.43
3.71
3.71
3.43
3.57
“Code Breakers”
14.67
3.38
3.52
3.62
3.35
13.86
3.38
3.52
3.62
3.35
13.88
3.19
3.75
3.38
3.56
OVERALL
(SAMI Card)
OVERALL
(Parent Online Survey)
Parents rated specific aspects of HSD on a scale from 1 (“poor”) to 4 (“excellent”).
The overall ratings were: 3.56 for program content, 3.63 for the activities, 3.50 for
appropriateness for grade level and 3.75 for the instructors. When asked what
they (as parents) liked about the program, many parents cited enjoying having
an opportunity for their children to interact with other homeschooled children
while learning about science through hands-on activities and knowledgeable
instructors. One parent said “The instructors showed the kids a fun side of
Science…I liked that all of my children could participate at the same time…”.
Parents regarded the fit of the program to their curriculum as 2.94 on the 4 point
scale. Many parents commented that the programs did not completely fit their
curriculum because each homeschool will cover a topic at different times within
the year, “The Science Center Homeschool Days touches on different aspects
than we might be studying at the time, but the classes are very interesting for my
kids and worth it.”
PARENTS' RATINGS OF HOMESCHOOL DAYS
Program Content
Activities
Grade Level
Appropriateness
Instructors
Curriculum Fit
3.56
3.63
3.50
3.75
2.94
Students’ comments on SAMI cards focused on specific examples rather than
general statements; 75% of their comments were coded as a gain in knowledge.
For example, comments from students who attended “Reflex Remix” focused
on neurons, whereas participants of “Design it. Build it.” commented on
building structures.
20 Saint Louis Science Center
SESSION TITLE
IMPACT SCORE KNOWLEDGE ENJOYMENT INTEREST ATTITUDE
“Chemistry”
14.00
3.80
3.60
3.40
3.20
“Anatomy”
15.25
3.50
4.00
4.00
3.75
14.56
3.67
3.78
3.67
3.44
16.00
4.00
4.00
4.00
4.00
OVERALL
(SAMI Card)
OVERALL
(Parent Online Survey)
Similar to HSD, HSL parents rated certain aspects of the program on a 4 point
scale. Overall ratings were: 4.00 for program content, 4.00 for activities, 4.00
for appropriateness of grade level and 4.00 for instructors. Comments revealed
that parents liked the hands-on aspect of the program as well as the opportunity
for group collaboration. One parent wrote, “The hands-on experiments and
dissection are so awesome for learning as well as being in a group setting where
the kids can discuss and learn from each other. Also the teachers were great and
very enthusiastic about science and were really ready to take it where the kids
were ready to go.” Students’ comments focused on the knowledge they gained.
In the “Chemistry” series, for example, students commented on the elements
and the periodic table.
PARENT RATINGS OF HOMESCHOOL LABS
Program Content
Activities
Grade Level
Appropriateness
Instructors
Curriculum Fit
4.00
4.00
4.00
4.00
3.50
Conclusions
From 2002 to 2011, the Science Center offered programming for the homeschool
audience that provided an engaging experience. The addition of the HomeSchool
Lab series was well received by parents new to the Science Center's home school
programs as well as parents whose children had participated in HomeSchool
Days for many years. A high percentage of student respondents mentioned
knowledge gained. Parents in both programs mentioned the great opportunity
to have their children had learn science hands-on with other children and quality
instructors. As one parent wrote, “Any opportunity to collaborate and learn with
others is always an excellent addition to homeschooling.”
Saint Louis Science Center
21
Program Spotlight: Unplugged: Uphill Derby (Public Programs)
Background
Unplugged: Uphill Derby is a summer day camp offered by the Science Center
via a grant-funded partnership with Missouri University of Science & Technology
and the Department of Energy. Offered for the first time in July 2011, participants
applied principles of simple machines and electricity to build a model car that
could race uphill. Part of a larger grant focused on communicating about energy
and electric vehicles to the public, Uphill Derby integrates an experience with
which many children are familiar—the Boy Scout Pinewood Derby—with science,
technology, engineering and math (STEM) concepts.
Program Structure
Participants in Unplugged: UpHill Derby prepare their
battery powered vehicles for the race.
(Photo: Saint Louis Science Center)
The Uphill Derby is part of the Science Center’s summer camp
program, Summer Science Blast. Campers entering 3rd and 4th
grade participated in a week-long, half-day camp. Each student
built two types of cars—a gear car and a pulley car, both battery
operated. On the last day of camp, students raced these cars
on an uphill course. Each day, students engaged with energy
concepts. Hands-on activities connected the larger concepts of
energy to more specific topics such as car design, motors and
pulleys, electrons and electricity and gear systems. Students
designed their car shape, taking into consideration the principles
of aerodynamics. They also used K’NEX building toys to learn
about gears and driving systems, and used tools to cut and build
car components.
Evaluation Questions and Methodology
In its pilot year, the evaluation focused on:
• Was the camp appropriate for students entering 3rd and 4th grades?
• Was the difficulty level of the activities appropriate for the students?
• What aspects of the camp stood out most to the students?
• What did the students learn about building a car?
• How can this camp be improved?
To address these questions, both qualitative and quantitative methods were
used. Observations were conducted during two days of camp. In order to gauge
their familiarity with the topics being presented, participants were informally
asked to describe what they were learning while working on their cars. Modified
System for Assessing Mission Impact (SAMI) cards were passed out to each
student after they completed at least one round of racing on the final day of
camp. In addition to collecting ratings and responses to the questions, “What
did you get out of this program?” and "How could we make this camp better?",
the cards contained questions specifically relating to the camp. These questions
included, “What did you learn about building a race car?” and “What was your
22 Saint Louis Science Center
favorite activity in the camp?”. Following the camp's conclusion, the instructor
was interviewed about her experience with the children and asked what went
well and what needed to be improved.
Characteristics of the Sample
A total of 15 cards were collected from 16 students, for a response rate of 94%.
Of those who reported their gender, 20% were girls and 80% were boys. Rising
4th graders represented 71% of the students and 20% of students were rising
3rd graders. Although the camp was intended for rising 3rd and 4th graders, 7%
of the students were rising 5th graders. Most of the children were infrequent
visitors (67%); 33% of the children who responded had family memberships.
Impact on Students
Based on the data collected via the SAMI cards, the overall Impact Score was
12.67. The overall ratings were 3.13 for Knowledge, 3.33 for Enjoyment, 3.07 for
Interest and 3.13 for Attitude. The Summer Science Blast average Impact Score
(14.13) was higher than the overall Uphill Derby Impact Score.
IMPACT SCORE KNOWLEDGE ENJOYMENT INTEREST ATTITUDE
Uphill Derby
12.67
3.13
3.33
3.07
3.13
Summer Science Blast OVERALL
14.13
3.59
3.70
3.41
3.43
Girls participating in Uphill Derby gave higher ratings than boys in Uphill
Derby and thus had a higher Impact Score: 14.67 for girls and 12.17 for boys.
Girls in Summer Science Blast also provided higher ratings than boys and had
a significantly higher Impact Score: 14.67 for girls and 13.97 for boys. Children
in Uphill Derby with family memberships had a higher Impact Score (13.75)
than children whose families did not have memberships (12.25). Participants in
Summer Science Blast who were Members had a significantly higher Impact
Score (14.32) than Non-members (13.44).
UPHILL DERBY
IMPACT SCORE KNOWLEDGE ENJOYMENT INTEREST ATTITUDE
Girls
14.67
3.67
4.00
3.33
3.67
Boys
12.17
3.00
3.17
3.00
3.00
Members
13.75
3.50
3.25
3.25
3.75
Non-Members
12.25
3.00
3.50
2.75
3.00
Campers' comments focused on enjoying the camp and the knowledge they
gained. One camper wrote that she “learned how to engineer and make a car.”
When describing what they learned about building their race cars, 50% of the
respondents commented on specific knowledge they gained, such as electrons,
circuits and motors on the cars. The race was the highlight for almost all of the
students. When asked what their favorite part of the camp was, 79% of the
Saint Louis Science Center
23
students described racing their cars. One student wrote, “My favorite thing was
when my car won the race.”
Based on observations of students, children had varying levels of prior
experience with building cars and using tools. Although some had worked with
parents on model cars prior to the camp, others had never put together a model.
Students were observed using terminology taught in the camp. When asked
about the purpose of the axles, a boy responded “they’re axles, they’re going to
make the wheels move.” Some concepts proved difficult to convey in the post
camp interview, the instructor recommended teaching the concepts in a more
qualitative way, instead of using mathematical reasoning. For example, rather
than focusing on ratios when discussing gear efficiency, next year’s camp will
experiment with different sizes of gears. This technique may prove effective;
when asked what makes a car go faster, one student replied, “Smaller gears [will
make my car go faster], if the gear is smaller, it will go around faster.”
Conclusions
After its pilot year, the Uphill Derby camp has the potential to actively engage
elementary students with energy and other related science topics. Overall
children enjoyed their time in the Uphill Derby camp; their favorite part was
designing and racing the cars they built. In its current configuration, the camp
would be more appropriate for rising 4th and 5th graders who have been
introduced to the topic of energy. However, the 3rd and 4th grade students
were able to describe what they learned about making their race cars. Some
mentioned concepts of electricity and circuits; others mentioned that they
learned about batteries and motors. The camp will be restructured for the 2012
Summer Science Blast, but the exploration of energy and engineering concepts
will still be at the heart of the Uphill Derby.
LOOKING TO THE FUTURE:
BECOMING THE CENTER FOR SCIENCE
In the 2009-10 edition of the Report to the Community, we described the Science
Center’s five-year strategic plan. At the core of the plan is a commitment to use
innovative methods to engage the public with science throughout their lives. As
the virtual world creates an overwhelming flow of information and contemporary
science becomes increasingly complex, people of all ages, backgrounds and
cultures need trusted, accessible and up-to-date science content.
They also need opportunities to interact with science in ways that are personally
relevant and meaningful. During the last program year, the Science Center
continued to refine our strategic plan, focusing on what it means to become the
Center for Science.
The idea of a Center for Science presents a vision for engaging the public with
science; we will be the place where science and the public meet. We will involve
our community with science in ways that are: vital and compelling, engaging and
approachable, relevant to people throughout their lives and participatory. The
Center for Science will connect the public with today's current science issues as
well as provide resources for individuals to pursue their own interests, supporting
their experience with science through lifelong learning.
In preparing to become the Center for Science, we have tested a number of
models. We have developed programs for adults, such as SciFest, Science Cafés
and travel programs, as well as offered programs aimed at multi-generational
audiences, such as Family Med School and Backyard Biofuels, a citizen science
project. Through NanoFutures Forums, we brought together local experts with
the public to discuss the impact of nanotechnology. We initiated and feature
the best of science from our own community a regular lecture series and will
continue to bring in leading scientists from around the country.
In these endeavors, collaborative, external partnerships have been key to our
success. An example is the Science Beyond the Boundaries Network which
connects more than 160 science centers and museums around the world. By
sharing educational materials and exhibitions, the network can potentially
reach over 67 million museum visitors annually with current scientific research.
Through this network, the Science Center plays an international leadership role
in facilitating the development of educational materials, sharing best practices,
evaluating impact and coordinating activities. This network provides us with new
programs and exhibits that enrich what we offer our visitors.
24 Saint Louis Science Center
Saint Louis Science Center
25
Our collaboration with the College of Education at the University of MissouriSt. Louis enhances the capacity of both institutions to reach area students and
teachers and improve the quality of STEM education. We have also formed
partnerships with scientists, convening advisory groups as content resources
and providing scientists with avenues to communicate their research to the
public. We will continue to develop these existing partnerships and cultivate
new collaborations which are key to increasing our reach and relevance.
NOTES
Becoming the Center for Science will also transform our ability to communicate.
We will use current technology to rapidly share information about current
events and bring programs to a wider audience. Ultimately, the Center for
Science will involve all aspects of the Science Center as we create a more
central presence in the daily lives of our public.
26 Saint Louis Science Center
Saint Louis Science Center
27
APPENDIX
Saint Louis Science Center Education, Exhibits & Programs Staff*
As of August 31, 2011
Alexis Abby*
Jasmine Billings*
Marguerite Choquette
Muhidin Abdimalik*
Jorden Blair*
Malik Chunn*
Derrick Adams Jr.*
Semilla Bland
Nia Chunn*
Adeola Adewale*
Alshon Blunt
Devin Clark*
Adeshola Adewale*
Nathan Bolden Jr. *
Stephanie Cole
Terrell Alexander*
Alan Bolden*
Javon Collard*
Dorsey Alford III*
Alex Bolden*
Justin Collard*
Ahmaad Ali*
Chevon Boyle*
Breonna Collins*
Marlow Allen Jr.*
A. Elaine Briscoe
Ra'Ner-Quant Collins*
Chris Allen
Bria Brown*
Isaiah Conner*
Joan Alter
Devonte Brown*
Kathryn Connor
Joel Anderson
Justin Burchfield*
Deion Cook*
Olamide Animashaun*
Lori Burns*
Jason Cook
William Anthony*
Tori Burns*
Nicole Cook
Authority Anue*
Christopher Burton*
Delamonte Cooper*
Tre'Sean Atkinson*
Korry Busch*
Kenneth Corcoran
Jamiah Austin*
Toni Butts*
Jermaine Cotton*
Jasmine Bailey*
Mariah Caine*
Jerricka Cotton*
Thomas Bailey*
Taylor Calicutt*
Todd Cowell
Audrianna Bain Ward*
David Callahan
Sydney Cowins*
Mariah Baker*
Paul Calloway*
Devorion Crawford*
Jon Baker
Robert Campbell*
Monikiah Cross*
Marvin Banks*
Christina Carlson
Marcus Daily*
Erin Barbee*
Monzera Carrillo*
Melissa Dalton
Dionne Barge*
Sara Carter
Autumn Davis*
Bryana Barnes*
Fredricka Caruthers*
Lans Davis*
Christina Bates*
Shawntella Caruthers*
Tiara Davis*
Thomas Becker
Jessica Castiglioni
Lacey Dean
Nyjah Bell*
Christopher Cella
Crystal Derring*
Ralph Bellamy Jr. *
Marlynn Chambers
Jasia Dickerson*
Emily Bermes
Christine Cheatham*
Tasha Dickerson*
Hal Bierman
Eldridge Cherry*
James Dixon IV*
Hilary Biggar
Jardin Cherry*
Kumar Diyali*
28 Saint Louis Science Center
Raven Dodds*
Lynette Gayden
Karlyn Henry*
Reva Dodds*
Shawnicee Gentry-Pruitt*
Lucia Herleth
Pili Dressel
Lilian Getachew*
Cameron Herron*
Nadja Durham*
Heather Gibbons
Javier Herron*
Calloyd Edmondson*
Tiara Gibson*
Charles Heuvelman
Christa Edwards
Ron Giesler
Christopher Hicks*
Darius Ellerson*
Eugene Gilliam Jr. *
Courtney Hilliard*
Hannah Ellis
Timothy Glanvill*
Jalen Hinton*
Daphne Emrick*
Kat Golden
David Hoffelmeyer
Cindy Encarnacion
Ron Goldfeder
Cortez Hollman*
Toney Estes*
Khamrin Graham*
Rodney Holmes*
Yancy Evans II*
Tamika Graham*
Nona Holmstrom
Jasmine Evans*
Aijah Hagens*
Dylan Houston*
Tina Fanetti
Ramauda Green*
Jacora Houston*
Brandon Farbush*
Mosiah Greene*
Tyron Hubbard*
Andrew Farrar*
Shakur Gridiron*
Steven Hurst Jr.*
Rashaud Fenderson*
Kevin Griffin
Layne Ibel
Rashaun Fenderson*
Terris Grimes
Adna Ismajilefendic*
Queshontis Fields*
Eric Gustafson
Elisa Israel
Demetrice Fisher*
Irnes Hajruloski*
Jamar Jackson*
Jamaal Fisher*
Tiana Hall*
Taylor Jackson*
Jason Fivecoat
Tyrie Hall*
Delle Jackson
Cory Flanagin
Rudy Hamilton*
Steven Jamerson III*
Nehemiah Ford*
Demetrius Harper*
Breanna Jarrett*
Will Fort Jr.*
Andrea Harper
Janiece Johns*
Dorian Foster*
Alexandria Harris*
Damonte Johnson*
David Francis
DeVonte Harris*
D'Angelo Johnson*
Ligaya Franklin*
Eric Harrison*
Jalyn Johnson*
Jillian Franks*
Mia Harsley
Justin Johnson*
Shaniqua Frazier*
Sydney Hart*
Alexander Johnson
Paul Freiling
Natalie Hartmann
Lauren Johnson
Melinda Frillman
Fartun Hassan*
Benny Jones III*
Lee Fuqua II
Diontay Hatch*
Airea Jones*
Johann Galikin
Andreaunna Hawkins*
Brandon Deandre Jones*
Heather Gallagher
Andreielle Hawkins*
Danielle Jones*
Lawrence Galvin*
Jennifer Heim
Jovan Jones*
Gabrielle Gant*
Lea Heintz
Laron Jones*
Romiyus Gause Jr.*
Daunte Henderson
Michaela Jones*
Saint Louis Science Center
29
Myesha Jones*
Charles McGill III*
Richard Osborn
Evin Russell
Breyonna Thomas*
Ben Williams Jr.*
Randy Jones*
Morgan McNair*
Tyesha Outlaw*
Oluwatomisin Salami*
Mara Thomas*
Melvin Williams Jr.*
Shaveal Jones*
Janet Medina*
Michelle Payne*
Brittani Savage*
Melissa Thomas
Dajae Williams*
Sarah Jordan*
Tavis Merriman*
Michael Peebles*
Dominic Schaeffer
Candace Thompson*
DeNeshia Williams*
William Kazban*
Elizabeth Merriman
Jamie Perkins*
Emily Scherer
Marwin Thompson
Gerald Williams*
Sherrisse Keeper
Marquise Middleton*
Brittany Perryman*
John Schmitt
Rebecca Thorn
Isaiah Williams*
Bill Kelly
Shawntice Midgett*
Christopher Peterein
Michael Schoenewies
Amanda Tinnin
Jazell Williams*
LeeAnna Kern
LaDaisha Miller*
Ronnesha Phillips*
Sarah Schoenlaub
Amanda Topping
Jeremy Williams*
Betsy King
Lamar Miller*
Charity Pikes*
Mary Schriewer
Tevin Tourville*
Jerrica Williams*
Maya Kirk*
Taylor Miller*
Justin Polacek
Doreysha Scott*
Torrniece Triplett*
Jerrick Williams*
Orville Kirk
Diane Miller
Brianna Porter*
Erin Scott*
Nautica Turner*
Kendra Williams*
Nicholas Klotz
Karalynn Miller
Beth Prakash
Brock Seals*
Nephreteri Tutwiler*
Lauren Williams*
Rodney Knight*
Lucas Miller
William Pratt III*
Jaysia Seals-Nelson*
Carol Valenta
Leslie Williams*
Morgan Koller*
Hilla Akbar*
Jessica Preston*
Joseph Seidler
Marcella Vamboi*
Reeana Williams*
John Lakey
Gywanna Montague
Billy Preston
Alik Shelton*
Latrina Vance*
Sharelle Williams*
Marcus Lamb*
Carl Moore Jr. *
Daevion Prewitt*
Sarah Shin*
Najwa Wakil*
Stephen Williams*
Kris Lane*
Devin Moore Pitts*
Som Pyakurel*
Vontel Silinzy*
Courtney Walker*
Ayinde Williams
Payton Lee Jr. *
Anthony Moore*
NeBria Ragland*
Lonnie Smith Jr. *
Romekia Wallace*
Aliyah Wilson*
Josh Linn
Ashley Moore*
Ieasha Randolph*
Alea Smith*
Stephvin Wallace*
Britney Wilson*
Kenny Loggins*
Jalen Moore*
Shannon Rapp
Arielle Smith*
Alexander Walters*
JayLynn Wilson*
Ronald London Jr. *
Jessica Moore*
Mehtab Rashidi*
Dennis Smith
Suzanne Walton
Nicola Wilson*
Viridiana Lopez*
Kaelan Moorehead*
Wesley Rayford*
Frieda Smith
DeVon Washington*
Tierra Wilson*
Robinique Love*
Jeremy Morgan*
Jamyia Reason*
Ian Smith
Antoine Watkins*
Colin Wilson
Christopher Lucas
Susan Morris
James Redelsheimer*
Philip Sortino
Tyra Watkins*
Al Wiman
Cimani Lumzy*
Raja-Niah Morrison*
Octavia Redmond
Briana Sowell*
Nathaniel Watlington II*
Scott Winstead
Tan Luu*
Sara Morrison
Tiara Redrick*
MyDestiny States*
Ar'Reon Watson*
Jared Witherspoon*
Frank Mack
Oluwatosin Mosuro*
Ashley Reekie
Steve Steadman
John Watson*
Alexandrya Wright*
Nicholas Mackey*
Koran Muhammad*
Janice Richard*
Aadaisie Stevens*
Ruth Watt
Blaine Wright*
Suman Magar*
Shaquil Muhammad*
Charles Richardson*
Matthew Stevens
Jasmine Welsh*
Diamond Wright*
Mike Malolepszy
Tim Mulhall
Siinya Riley-Dulaney
Kerry Stevison
Anna Werner
Bradley Wynn*
Aliyha March*
Julian Munson*
David Ritchey
Danielle Stewart
Hannah Wetzel
Darius Young*
Sara Martinez
Kathryn Nelson*
Riana Roberts*
Charlie Stockman
Alexis Wheeler*
Jeannie Young
Gregg Maryniak
Demisha Nettles*
Eboni Robinson*
Toni Stovall*
Da'Zaria White*
Fudail McCain*
Bre'Yanna Nicholson*
Jevone Robinson*
Taryn-Leigh Surtees
Khadijah White*
Ted McCorvey III*
Jasmine Noble*
Taylor Robinson*
Adtronique Swopes*
Rajae White*
Andrew McGarrahan
Erin Nolan
Christine Roman
Lal Tamang*
Rakelle Whitfield*
Olivia McGauly
Enrico Nolen Jr. *
Randy Ruffin*
Kurly Taylor Jr.*
Rashonda Whitfield*
Anniece McGhee*
Betsy O'Brien
Rodney Ruffin*
Michael Terry*
Jill Willhite
26
Louis Science Center
30 Saint
Saint Louis Science Center
*Youth Exploring Science (YES) Teen
Saint Louis Science Center
31
SOURCES
Ball, Nadine. “Grow Up Great: St. Louis¸ Evaluation Processes & Results.” Project evaluation report.
St. Louis, Missouri, August 2011.
Falk, J. and Dierking, L. 2000. Learning from Museums: Visitor Experiences and the Making of Meaning.
Walnut Creek, CA: Altamira Press.
Nelson, Louise. “Grow Up Great in St. Louis, 2010-11 Goals.” Outline of project goals. St. Louis, Missouri,
September 2010.
PNC Bank. “PNC Grow Up Great and St. Louis Organizations To Help Underserved Preschoolers.”
September 16, 2010. http://pnc.mediaroom.com/index.php?s=43&item=731.
32 Saint Louis Science Center
Printed with soy-based ink on
30% post-consumer recycled content.
Saint Louis Science Center, 5050 Oakland Avenue, St. Louis, MO 63110