| |
is a selection of recently completed projects at Goodman Research Group, Inc:
-
GRG conducted both process and summative evaluation of the National Infrastructure of Support for Extended Explorations in Science and Engineering in After-School Programs. This NSF-funded program is designed to train and support educators at community based organizations to conduct more effective hands-on science and engineering projects with children. GRG examined the extent to which the proposed train-the-trainer model supported community based organizations and informal educators in promoting children’s science inquiry skills. (2006 - 2009)
-
GRG conducted formative and summative evaluation of Community Ambassadors in Science Exploration (CASE), a three-year NSF-funded project designed to develop and establish a model museum-community partnership that provides hands-on science experiences for underserved families in the Philadelphia/Camden area. (2006 - 2009)
-
The Friends of Laurel Hill Cemetery’s Urban Mourning Project (UMP) seeks to address youth violence in Philadelphia. Specifically, the UMP combines “art, education and psychological support to help youth: 1) better understand their personal grief and loss so that they might channel this pain into productive, creative and healing outlets of self and community expression; 2) raise awareness of the mourning process as a conscious demonstration of cultural, historical and humanistic necessity.” For this project, GRG conducted an evaluation that focused on both processes and outcomes and provided feedback to the program developers to enable adjustments to be made and to help them refine the program for future years. (2008 - 2009)
-
GRG conducted formative, process, and summative evaluation of the Dan River Information Technology Academy (DRITA). A major goal of DRITA is to implement a youth program that will “provide opportunities for promising students of color to: 1) develop solid Information Technology skills; and 2) acquire the background and encouragement needed to enable them to pursue higher education in STEM fields.” The academy courses include basic IT skills and a range of topics including programming, converged wireless technologies, and robotics. Our evaluation collected data over the three project years from youth participants and their families, DRITA instructors, and key staff members at participating organizations and externship sites. (2007 -2009)
-
GRG conducted an evaluation of the outcomes for students who received a grant from the Jack Kent Cooke Undergraduate Transfer (JKC-UT) program or were highly competitive nominees for the grant. The Jack Kent Cooke Undergraduate Transfer program annually awards grants designed to help high-achieving students transfer from community colleges to selective four-year schools. Our study examined the outcomes for students who received the grant as well as those who did not by tracing their paths and achievements in order to identify the factors that facilitated or hindered their academic and professional success. (2008 - 2009)
-
GRG conducted a national summative evaluation for KCET of their children’s science program, Sid the Science Kid. The daily series and associated national outreach aimed to engage children ages 3 to 6 years old and their caregivers. For children, goals included supporting and extending their natural science-related curiosity by increasing science process skills they can use to seek answers as they explore the world around them. For caregivers, goals included increased interest, comfort, and confidence to support their children’s curiosity. Primary goals of GRG’s evaluation included: 1) Examine the effectiveness of the series and website through a viewer study to compare the science-related interests, attitudes, and activities among those who are or not exposed the series and website, and 2) Assess implementation and effectiveness of the community outreach including reach, use, and satisfaction with the outreach trainings and materials. (2008 - 2009)
-
The Massachusetts Housing Investment Corporation (MHIC) is a community development entity in Boston, Massachusetts. In February 2009, the MHIC contracted GRG to conduct an analysis of the impacts that four of MHIC’s projects are having on the City of Boston through semi-structured interviews of project stakeholders. These interviews were used to write a report about the MHIC projects’ impact and to revise the data collection instruments that the MHIC uses to monitor the successes of each project. (2009)
-
GRG collaborated with research partner Mills Consulting Group to conduct a market rate study for Michigan Family Independence Agency of the Michigan child care work force. The survey of child care centers, group day care homes, family day care homes, day care aides, and relative care providers was designed to gather information about rates charged for care for children ages zero to 2½ and children 2½ to 13; hours for each age group; market rate at the 75th percentile by county, by age break out and by provider type; and establish a county rate, a state rate, and a shelter area rate. (2009)
-
GRG worked with the National Association of Charter School Authorizers to evaluate their School Portfolio Network program, a partnership whereby authorizing agencies partner with NACSA to receive comprehensive and sustained support for up to three years, in an effort to improve authoring practices. We provided a comprehensive analysis of current policies and practices, including an internal audit and a survey of stakeholders. The data gathered through this survey was used in conjunction with other data gathered by the NACSA team to determine the authorizing practices that will be addressed as part of the partnership. A similar survey was also used at the end of the partnership to determine whether stakeholders noticed changes in key areas. (2007 - 2009)
-
GRG conducted an evaluation of RESOLVE educational modules on embryo donation/adoption for potential embryo donors and those interested in embryo adoption. In this project, RESOLVE sought to increase awareness of embryo donation and/or adoption as well as to increase knowledge about the medical, legal, mental health, and practical aspects of embryo donation and adoption. GRG evaluated whether the educational modules were successful in increasing awareness and knowledge of embryo donation and adoption. Data collection methods incorporated both qualitative and quantitative data. RESOLVE will use data from the evaluation of conference presentations as a basis for adjustments and revisions to the educational modules as well as development of subsequent materials. (2008-2009)
-
S
GRG recently completed the fifth and final year of a longitudinal outcome evaluation for SAE International of A World In Motion (AWIM). With over 18 years of distribution to elementary and middle school (and now high school) teachers, the interdisciplinary curriculum supplemental materials are designed to promote science, engineering, and mathematics literacy among students by engaging them in challenging engineering and design activities. (2004 - 2010)
-
GRG recently completed the three-year evaluation of iCODE, an NSF ITEST-funded project that used intensive, hands-on IT activities in a collaborative on-line environment. The primary aim of iCODE was to increase the likelihood that participating middle and high school students from racially diverse and economically disadvantaged communities in Boston and Lowell would pursue IT and STEM careers. The summative evaluation assessed the influence of the program on participating students' IT attitudes, career aspirations, and skills over the three years. Data collection each year included pre and post surveys, focus groups, and content quizzes for students, interviews and surveys of educators, and site observations conducted by GRG researchers. Evaluation results indicated that the iCODE program was highly successful and can serve as a model for other ITEST initiatives that feature programmatic efforts to make hands-on, inquiry-based engineering and programming experiences available to underrepresented groups in the middle and high schools. (2007 - 2010)
-
In 2009, GRG completed a study of Early Care and Education in Vermont that had as its goal exploring Vermont’s distinct needs and the best practices in other parts of the U.S. An informal affiliation of charitable foundations in Vermont, led by the A.D. Henderson Foundation and the Permanent Fund for the Well-being of Vermont’s Children, commissioned GRG to conduct this first-of-its-kind study of early care and education in Vermont. Through stakeholder interviews, literature review, and secondary data analysis, the study provides comprehensive, up-to-date information on the most important aspects of Vermont’s early care and education landscape, including supply and demand, early childhood spending, universal and targeted approaches to healthy child development, quality in early care and education, and education and professional development of providers. (2009)
-
GRG has been conducting summative evaluation of Reading Rockets, a national multimedia project that disseminates resources and information focused on helping children learn to read for 8 years. In year 7, GRG evaluated four web sites, professional development opportunities and a yearly PBS television program. (2008 - 2009)
-
In 2008, with funding from the Defense and Veterans Brain Injury Center, GRG conducted an external evaluation of the website, BrainLine.org. The BrainLine website is part of a national multimedia project to disseminate authoritative information about preventing, treating, and living with traumatic brain injury (TBI). BrainLine’s target audiences includes people living with TBI, family members and friends of people living with TBI, healthcare professionals, active duty service members, reservists, veterans, and anyone else with an interest in TBI. As such, the purpose of this evaluation was to assess these population’s opinions regarding quality, ease of use, effectiveness of graphics/interactive features, and perceived usefulness of this new website. The client (WETA) sought feedback about the strengths of the site, what needed to be improved, and areas for potential growth. To answer these questions, GRG conducted a two-part evaluation comprised of both a web-based survey for site visitors and a paper-and-pencil comparative survey in which survey participants (from BrainLine’s target audience; recruited by GRG) compared aspects of BrainLine.org to those of two other websites about TBI. (2008 - 2009)
-
GRG conducted an evaluation of NOVA scienceNOW, the PBS series that explores cutting-edge scientific and technological innovation in real time, as the science unfolds. The evaluation of the TV series, outreach, and website was designed to assess NOVA’s effectiveness in meeting its overall goal of engaging a variety of audiences more deeply with scientific research in both formal and informal settings. (2008 - 2009)
-
FETCH, a children’s television series produced by WGBH since 2005, is a competition-based game/reality show for 6-10 year-old children that includes both animation and live action footage. GRG served as the external evaluator for Seasons 1 and 2, and recently completed our summative evaluation of Season 3. GRG’s evaluation of the Third season of FETCH included the evaluation of the series as well as WGBH’s outreach efforts. An overall goal for this evaluation included assessing the extent to which FETCH television shows excite students about STEM in general, and STEM related careers, in particular. Additionally, we surveyed librarians that use the FETCH outreach Guide to conduct activities with children from the target age-group. (2008 - 2009)
-
GRG served as the external evaluator for PEEP, a childhood science education initiative consisting of a television series, website, and outreach initiatives. GRG conducted both formative and summative evaluation of PEEP. The early formative evaluation assessed the effectiveness of the different PEEP components in inspiring children ages 3-5 years and their educators to engage in science exploration and play. During its fourth season, PEEP launched its “Anywhere Math” initiative, adding numbers, shapes & patterns, and measuring to the curriculum. GRG conducted group viewing and discussions with preschool-aged children about existing PEEP episodes; findings helped to inform production for future seasons. GRG also consulted with the project team and conducted a pilot test of the outreach curriculum at two Native American Head Start sites in New Mexico, and two non-Native sites in Boston, MA. (2009)
-
WGBH created a national outreach initiative for We Shall Remain, a five-part documentary series on Native American history produced for American Experience and, in partnership with the American Library Association, developed an event kit with ideas and resources to help libraries organize events related to the series. GRG’s evaluation described how the We Shall Remain community coalition and library outreach activities unfolded and assessed their reach and impact. Outcomes included the perceived benefits of coalition outreach activities to coalition members, the organizations they represent, and the local community. For the library event kits, outcomes included librarian perceptions of the impact of the We Shall Remain event kit materials and activities on library patrons. (2008 - 2009)
-
GRG conducted a formative evaluation of The Music Instinct – an NSF-funded 2-hour PBS television program that aimed to convey the strong evidence of the connections between music and science as well as a deeper understanding of these two fields. The overall project consisted of the PBS program, a web site, and ancillary educational materials. The formative evaluation obtained timely information to support and guide producers as they make decisions regarding the design, content, and format of project components. Pre-production evaluation activities included an online survey of PBS viewers and music aficionados that explores the likelihood of watching such a show. Production evaluation activities included four focus groups of target audience members, an online survey of formal and informal educators and PBS viewers about the website, and a written survey of educators (middle school, after-school, and museum) about the ancillary materials, which included a tool kit and a museum guide. (2008 - 2009)
|
