Outline model Impact Evaluation toolkit

The results of Key Task 1 Desk Research have now been synthesised and the preparation of an open online toolkit for impact evaluation across different delivery methods of science literacies is in the process of being compiled.

Download the report for Outline model Impact Evaluation toolkit or view on SlideShare.

Also available for Download is the report on The impact of Science Literacy delivery methods - what works? or view on SlideShare.

Items of potential interest will continue to be added to this page as they become known to us. We encourage your participation in the process of making the toolkit as comprehensive and current as possible.

If you have content which you would like to be considered for the toolkit please contact Carol Usher

	Mechanism Group/Mechanism	Author(s)	Year	Toolkit	Type of Resource
Group 1: Events, Meetings, Performances
1.	Exhibitions	Tucker, Bricker, and Huerta	2017	An Approach to Measuring Impact and Effectiveness of Educational Science Exhibits	Evaluation tool
		Barriault and Pearson	2010	Assessing Exhibits for Learning in Science Centers: A Practical Tool	Assessment tool
		Association of Children's Museums	2010	Children’s Museums and Nutrition	Best practices
		Ecsite-uk	2008	The Impact of Science & Discovery Centres: A Review of Worldwide Studies (SEE APPENDIX - pages 12-15) (Direct download)	Follow-up material (on learning outcomes
2.	Expo			No toolkit found during the research process
3.	Festivals	Fogg-Rogers	2017	UK Science Festival Network Pilot Evaluation 2017 SEE APPENDIX - page 20	Evaluation resources
		Grand and Sardo	2016	What Works in the Field? Evaluating informal science events	Evaluation tools
		Sardo	2016	Evaluation of the Bristol Bright Night 2015 (BBN15)SEE APPENDIX - pages 25-34	Questionnaires Fieldwork materials
		Science Festival Alliance	2014-	Science Festival Alliance	Evaluation tools
		UK Research and Innovation's (UKRI)	2011-	Evaluation: Practical Guidelines. A guide for evaluating public engagement activities	Guidelines
		National Co-ordinating Centre for Public Engagement	Various years	Evaluating public engagementAlso seewww.publicengagement.ac.uk/do-engagement/evaluating-public-engagement/evaluation-resources	Evaluation resources
		Audience London	2011	Researching audiences at outdoor events and festivals	ToolkitGuidelines
		Ecsite Places Impact assessment toolkit	2011	PLACES Impact Assessment Toolkit	Toolkit
		Involve - Andersson, Fennell, and Shahrokh	2011	Making the case for public engagement: How to demonstrate the value of consumer impact	Toolkit
		Informal Science	2010	Informal Science. Evaluation & Evaluation Toolkitsand www.informalscience.org/evaluation/evaluation-tools-instruments	GuidelinesEvaluation toolsFollow-up materials
		NSF EvaluATE	2010	The 2010 User-Friendly Handbook for Project Evaluation	Handbook
		National Evaluation of Children's Fund (necf)	2005	The Evaluators Cookbook: Participatory Evaluation Exercises. A Resource for work with Children and Young People	HandbookEvaluation tool
		Arts Council England		Arts Council England: The Generic Learning Outcomes	Follow-up material
		Wellcome Trust		Wellcome Trust. Engaging with Impact: How do we know if we have made a difference?	Guide
4.	Movies			No toolkit found during the research process
5.	Picnics			No toolkit found during the research process
6.	Science Fairs	Jet Propulsion Laboratory (NASA)		How to Do a Science Fair Project	Video guide
		Science World British Columbia		Science Fair Guide	Guide
7.	Seminars	Spruijt et al.	2015	Factors Influencing Seminar Learning and Academic Achievement (SEE APPENDIX - Pages 10-11)	Questionnaire
8.	Talks			No toolkit found during the research process
9.	TED Talks			No toolkit found during the research process
10.	Theatre			No toolkit found during the research process
11.	Workshops	Stamp and Pagano	2002	Evaluation of a Workshop Series in University Science Education	Workshop Evaluaton
Group 2: Education and training - including online
12.	Colloquia			No toolkit found during the research process
13.	Courses			No toolkit found during the research process
14.	Curricula	Buck Institute for Education (PBL Works)	2021	Project Based Learning Handbooks for elementary school and for middle school & high school	Handbook
		Wolf, Evers, and Hill	2006	Handbook for curriculum assessment	Handbook
15.	E-learning	Ruggeri, Farrington, and Brayne	2013	A Global Model for Effective Use and Evaluation of e-Learning in Health	Evaluation model
		Vaughan, Cleveland-Innes, and Garrison	2013	E-Learning in the 21st century: A framework for research and practice, Second editionSee chapter 5	Guide
		NHS Health Scotland	2008	Health Impact Assessment in Practice e-Learning Course Workbook	Workbook
		Mateo et al	2006	Guide to the self-evaluation of e-learning degree programmes Guide to institutional evaluation	Guide
		Karran	2004	On-Line Assessment for E-Learning: Options and Opportunities	Assessment modes
		Olds	2002	Effective Strategies to Assess the Impact of e-Learning	Assessment matrix
16.	Webinars			No toolkit found during the research process
Group 3: Traditional publishing and journalism - print and broadcast
17.	Animations			No toolkit found during the research process
18.	Books			No toolkit found during the research process
19.	Brochures	Haute Autorité de santé	2008	How to produce an information brochure for patients and users of the healthcare system	Guide
20.	Cartoons	Joyce	2016	Using concept cartoons for assessment	Guide
21.	Comics	Tribull	2017	Sequential Science: A Guide to Communication Through Comics	Guide
22.	Games	Morrsund	2007	Introduction to Using Games in Education: A Guide for Teachers and Parents	Guide
23.	Graphics			No toolkit found during the research process
24.	Posters	Menke	2014	Implementation of Online Poster Sessions in Online and Face-to-Face Classrooms as a Unique Assessment Tool	Assessment tool
		O’Neill and Jennings	2012	The Use of Posters for Assessment: A Guide for Staff	Guide
		Hess, Tosney, and Liegel	2009	Creating effective poster presentations: AMEE Guide no. 40	Guide
		Summers	2005	Student assessment using poster presentations	Guide
25.	Publications			No toolkit found during the research process
26.	Radio	Skuse et al.	2004	Radio Broadcasting for Health: A decision Maker's guide	Guide
27.	Reports			No toolkit found during the research process
28.	Television			No toolkit found during the research process
29.	Videos			No toolkit found during the research process
Group 4: Activities and services
30.	Competitions			No toolkit found during the research process
31.	Experiments			No toolkit found during the research process
32.	Makerspaces	Branigan-Pipe	2017	Making a Makerspace: The Tools, The Spaces and the Theories A Holistic Approach Design Project	Guide
		Crichton and Wachira	2017	Taking Making Into Classrooms in Challenging Contexts: A Toolkit Fostering Curiosity, Imagination and Active Learning	Toolkit
		Innovative Learning Centre	2017	Taking Making into the classroom - A toolkit for fostering curiosity and imagination	Toolkit
		Parks	2016	Learning in Middle School Library Makerspaces: A Makerspace Collaboration Guide for School Librarians	Guide
		Lawson and Atcheson	2015	Hands-On Science and Technology. An Inquiry Approach	Guide
		YALSA STEM Resources Task Force	2012-13	STEAM Programming Toolkit	Toolkit
33.	Mobile Classrooms			No toolkit found during the research process
34.	Mobile Laboratories			No toolkit found during the research process
Group 5: Online interactions
35.	Blogs			No toolkit found during the research process
36.	e-Books			No toolkit found during the research process
37.	e-Zines			No toolkit found during the research process
38.	Mobile apps	Skiba	2017	Evaluation Tools to Appraise Social Media and Mobile Applications	Evaluation tools
		Stoyanov et al.	2015	Mobile App Rating Scale: A New Tool for Assessing the Quality of Health Mobile Apps	Assessment tool
39.	Podcasts	Williams	2015	How could an effective podcast about alcohol use be designed and evaluated? A review of the literatureSEE APPENDIX: ‘Quick guide to designing and evaluating an effective Podcast about alcohol use’ - pages 63-64	Guide
		Austria	2007	Developing Evaluation Criteria for PodcastsSEE APPENDIX 1 ‘Developing Evaluation Criteria forScience Podcasts’ - pages 194-199	Evaluation critera
40.	Social Media			No toolkit found during the research process
41.	Websites	Welborn and Kanar	2000	Building Websites for Science Literacy	Guide
42.	Wikis	Palomo-Duarte et al.	2014	AssessMediaWiki (AMW) WikEval	Assessment tools
		Sanden and Darragh	2011	Wiki Use in the 21st-Century Literacy Classroom: A Framework for Evaluation	Evaluation framewrok
Group 6: Multiliteracies/Multimodalities
43.	Multiliteracy			No toolkit found during the research process
44.	Multimodality			No toolkit found during the research process
Group 7: Citizen science
45.	Citizen Science	The Cornell Lab of Ornithology	2010	Cornell Citizen Science Toolkit	Toolkit
		CitizenScience.gov		Federal Crowdsourcing and Citizen Science Toolkit	Toolkit
		California Academy of Sciences		Citizen Science Toolkit	Toolkit
		NSW Government, Office of Environment & Heritage		Citizen Science Hub Project Guide	Toolkit

Back to The impact of Science Literacy delivery methods - what works? (2017 -2020)