RESEARCH & EVALUATION
Just as our strategies have been informed by research across fields, we believe in evaluating the effectiveness of our program so that we
can continue to evolve and improve. We achieve our evaluation goals in the two phases described below.
We take careful steps to ensure that our content, marketing strategies, and delivery mechanisms are effective and responsibly informed.
At key intervals, we present our strategies, content, and design to interdisciplinary committees for feedback. These presentations are led by a team member and facilitated. The feedback is recorded and processed, and meaningful themes are addressed in the next iteration of the program.
Once our deliverables are ready for review, we partner with organizations and schools who are willing to test them and provide feedback on their ease-of-use, clarity, impact, and general fun or engagement level. These tests are not actively facilitated so that we are able to assess realistic implementation with minimal interference. Our partners complete a combination of surveys and informational interviews following testing, which we can these use to inform our design.
Once the program is delivered to sites, we request that they assist in data collection so that we can continue to monitor effectiveness and measure impact.
All teachers and students are invited to submit reviews of each month's materials online. In addition, general feedback is requested at the end of each school year. All feedback is anonymous (unless teachers opt-in to identify themselves) and is collected online.
pre & post survey data
Select sites are asked to distribute more comprehensive skill and attitude surveys prior to beginning the program and after the program's completion. Targeted measures are given to teachers and students to evaluate such factors as: perceptions of science, interest in pursuing STEM careers, nature of science skills and knowledge, and self-reported STEM aptitude. All surveys are anonymous and completed online.
As a nonprofit organization, we are limited in the types and extent of research we can conduct. We partner with research labs interested in better understanding issues of science engagement, diversity, youth empowerment, stereotype threat, and media messaging to conduct more in-depth evaluations of select sites. These partnerships allow formal Internal Review Board approval, research grant funding, and formal dissemination of results.
REPORTING OUR FINDINGS
We will publish our results in annual reports made available freely and publicly online. Additionally, any new evidence that we believe may be
valuable to others in the field will be published in peer-reviewed journals in collaboration with a partnering research lab.
If you have any questions or are interested in becoming a research partner or research site, please email us at firstname.lastname@example.org.