header
header
 
  • Association For Interactive Media Education, St. Louis, MO
    GRG is conducting formative and summative evaluation for the Association for Interactive Media Education’s (AIME) ATETV.org project. ATETV aims to broaden the reach and impact of the existing Advanced Technology Education (ATE) community by producing interactive web-based video to promote awareness and expand dissemination of ATE efforts. Project goals are to reach, recruit, and retain more ATE students, educate policy-makers, and encourage industry involvement in ATE programs. GRG’s evaluation goals include monitoring the link between program activities and intended outcomes during video development and production, and determining effectiveness of the project in meeting its goals once the website is accessible by the public.

  • Blue Cross Blue Shield of Massachusetts, Boston, MA
    Trustee Advantage is a grant program designed and sponsored by Blue Cross Blue Shield of Massachusetts to help the Boards of Trustees at five Massachusetts hospitals advance the governance of quality and safety improvement at their institutions. This one-year program provides funding for three components: a coaching engagement, an in-depth experiential practicum, and participation in a peer learning community with other grant recipients. As part of our process evaluation, GRG is collecting data from Board members, coaches, and learning community facilitators to understand how the program is unfolding. GRG’s outcome evaluation will focus on intermediate outcomes such as Board members’ commitment to improved quality and safety and understanding of their role in quality and safety governance, the extent to which Boards implement or plan to implement changes in service of these goals, and the facilitators of and barriers to such efforts going forward.                                                                                                                                    
  • Brown University, Providence, RI                                                                                                                    GRG is serving as the external evaluator of the IGERT, An Integrated Program on Development and Inequality in the Global South, for the Watson Institute for International Studies at Brown University.  The evaluation includes formative, process, and summative components. The evaluation focuses on the implementation of the project as well as the success of the project in meeting its goal of having IGERT trainees incorporate inter-disciplinary and innovative techniques in their doctoral work and beyond.  Evaluation activities will include the following: an annual survey with students each year, including those who have completed their traineeships; survey with faculty during years one, three, and five; site visits to the program and to talk with groups of students during selected years; and interviews with program staff.  Data collected in the first couple years will be used formatively to help the program make improvements, while ongoing data collected over the five years will be used to assess program effectiveness.                                                                                                                                                                                                                               
  • Education Development Center (EDC), Newton, MA                                                              GRG is conducting a process and summative evaluation of Taking NPASS to Scale (NPASS2): Creating State-based Professional Development Networks for Out-of-School-Time Science, a program developed by the Center for Science Education (CSE) at the Educational Development Center, Inc. (EDC). This three-year NSF-funded program is designed to provide professional development training to science trainers so as to increase Out-of-School Time (OST) science programming for children. The program focuses on under served populations in eight geographically and demographically diverse U.S. states. The summative evaluation will examine how the project builds the states’ infrastructure and capacity to support this work into the future.                                                                                                                                                                                                                                                                                                                                                            
  • Education Development Center (EDC), Newton, MA                                                                                  GRG is conducting summative evaluation for Education Development Center, Inc. (EDC) of their NSDL Youth Resources (NYR) project. The evaluation will be guided by questions about the implementation and the scope and impact of the NYR study. GRG evaluation will asses also the extent to which the NYR study upholds commonly accepted research standards, principles, and ethics. GRG will serve as the external evaluator to track the project’s effective and timely progress in meeting its overall goals. GRG's consultation activities will include reviewing research designs, methodologies and instruments, as well as participating in phone/web conference calls with the research team and advisors. GRG researchers will provide expertise in finalizing the data collection instruments, data analyses and activities for dissemination of the findings.

  • Harvard-Smithsonian Center for Astrophysics, Cambridge, MA
    GRG is conducting an evaluation of the Education and Public Outreach (EPO) activities associated with Chandra X-ray Observatory, launched by NASA in 1999 as its flagship mission for X-ray astronomy. The Chandra EPO is based at the Smithsonian Astrophysical Observatory at Harvard University. Chandra EPO activities include several program components designed to increase public awareness and interest in astronomy and in the data being collected and sent back to the science community by Chandra: web and print materials; workshops developed for teachers on using EPO-developed materials in the classroom; and programs for high school students held at MIT and Rutgers University using Chandra-collected data. Through survey data collection from the audiences for these programs and materials, the evaluation is gathering information on public awareness of the Chandra mission and X-ray astronomy as well as the efficacy of current EPO programming in fostering awareness and engagement with X-ray astronomy and space science research. 
                    
  • Harvard-Smithsonian Center for Astrophysics, Cambridge, MA
    GRG is conducting summative evaluation of The Black Hole Experiment Gallery, a traveling exhibit and accompanying materials to be produced by the Smithsonian Astrophysical Observatory (SAO) of the Harvard-Smithsonian Center for Astrophysics. GRG is assessing two innovations of this project: 1) the inclusion of significant input from youth collaborators in the design and development phase, and 2) the use of networked exhibit technologies to personalize and enhance the visitor experience of science inquiry. The youth collaborator study was completed in April 2009. The first venue for the travelling exhibit was the Boston Museum of Science, from June-August, 2009; the second location was the Christa McAuliffe Planetarium in Concord, New Hampshire; and the third location was at the Springfield Science Museum in Springfield, Massachusetts. GRG collected exit interviews, attendee surveys, and systematic observations at each of the three venues.                                                                                                                           
  • The Kenneth B. Schwartz Center, Boston, MA
    After completing an evaluation of their signature Schwartz Center Rounds® program in 2008, GRG is conducting process and outcomes evaluation of a new Schwartz Center pilot project. Funded by the patient safety and medical malpractice company CRICO/RMF, the Schwartz Center Connections pilot program is designed to build communication across healthcare professionals to mitigate adverse outcomes and malpractice risk. GRG’s outcomes evaluation is a pre-post study of program participants with a comparison group of providers who do not attend the program.                                                                                                                                                                                                                               
  • Massachusetts Linking Experiences and Pathways, Cambridge, MA                                                          In March 2010, GRG received its own grant from the National Science Foundation, Division of Gender in Science and Engineering. Our research project, the Massachusetts Linking Experiences and Pathways (M-LEAP) study, is designed to answer the question: How do students’ in-school and out-of-school experiences shape their choices related to their future careers? M-LEAP is a longitudinal study of 3rd, 4th, 5th, and 6th grade elementary school students who will be followed for three years. Their parents, teachers, district subject matter specialists, and community program representatives will also provide data. We have selected a diverse sample of 10 school districts in Massachusetts to participate in the study.  These schools are a mix of urban, suburban, and rural in different parts of the state, and the sample provides diversity in terms of socioeconomic status and of race/ethnicity.                                                                                                                                                                                                                                                                             The research team consists of GRG staff members Irene F. Goodman, Ed.D., Principal Investigator; Karen Gareis, Ph.D., co-PI and Project Director; Elizabeth Bachrach, Ph.D., co-PI, and Helena Pylvainen, B.A., Research Assistant. The two other co-PIs are Jacque Eccles, Ph.D., University of Michigan, and Robert T. Brennan, Ed.D., independent consultant. Dr. Eccles is the creator of the Eccles et al. Expectancy Value Model of Achievement-Related Choices.  Dr. Brennan is a statistical methodologist who specializes in the complex statistical modeling techniques that will be necessary to analyze the data from the M-LEAP study.                                                                                                                                                                                                                                                                                                                                                          
    • Metropolitan Opera, New York, NY

      GRG is conducting an evaluation of HD Live in Schools, the Metropolitan Opera’s initiative to bring the Met’s live HD performances to high school students in 18 cities. GRG’s evaluation activities include an online survey for all teachers in the 18 cities who have been trained and are using the curriculum materials, and surveys with a sample of students at six of the sites after their attendance at each of the two operas and their participation in the follow-up activities.       

    • MIT Terrascope Youth Radio, Cambridge, MA
      GRG is in the second year of a four-year process and outcome evaluation of Terrascope Youth Radio, an NSF-funded project in which urban teens develop, report, write, produce, and host a regularly broadcast radio program on environmental and Earth-system science. Participating teens report on science topics that are engaging and relevant to their lives at the same time as they learn radio production skills. In addition to providing interactive learning experiences for local teens, the initiative aims to serve as an impetus to increase coverage of environmental science, and other STEM topics, in youth radio programming nationally. Finally, the program proposes to establish a model for university researchers and students to engage and work with youth in their communities.                                                                                                
    • Museum of Science, Boston, MA

      GRG is conducting an evaluation of The Amazing Nano Brothers Show, created and produced at Boston's Museum of Science to introduce nanoscience and nanotechnology to museum visitors of all ages.  The evaluation activities include  surveys being taken by audience members either before or after they view the performances.  We will also interview teachers who have attended the program on their class field trip to the Museum.

    • National Academy of Engineers, Washington, DC
      GRG is in the fourth year of a five-year evaluation of the Engineering Equity Extension Services (EEES), a new comprehensive research-based consultative and peer mentoring infrastructure that will support enhanced gender equity in engineering education in the U.S. The evaluation began with activities and is currently focusing summatively on outcomes for participants.                                                                                                                                                                                                
    • New Jersey Academy for Aquatic Sciences, Camden, NJ
      In the Communities of Learning for Urban Environments and Science (CLUES) project, funded by NSF’s Informal Science Education (ISE) program, four museums are collaborating to build community capacity for STEM education and increase STEM learning opportunities for underserved families. CLUES provides apprentices from the community with intensive professional development in informal science education; in turn, apprentices train and mentor presenters in providing accessible family education programs on neighborhood environmental issues. GRG’s process evaluation focuses on the implementation of the apprentice and presenter professional development activities and the family STEM education programs. GRG will also evaluate outcomes, including community STEM education capacity; apprentices’ and presenters’ knowledge, skill, confidence, and interest in informal science education; and families’ knowledge of and connections to their urban environments.                                                                                                                         
    • National Safety Council, Itasca, IL
      GRG is conducting a comprehensive, multi-pronged evaluation of the National Safety Council Standard First Aid, CPR, and AED training program — a U.S. Department of Labor, OSHA-mandated program used in business, industry, school, and community setting across the U.S. and internationally.  The evaluation team is employing diverse techniques for collecting and analyzing data, including both quantitative and qualitative methods.  These include a web-based survey of instructors, in-class observations of instructors and course participants, CPR skill assessments of course participants immediately following training, end-of-class written survey of course participants, and a web-based follow up survey of course participants. The information gained from the evaluation will serve to inform the development of priorities and strategies for the revision of the course and course materials, as well as development and refinement of education and evaluation methodologies.         
                                                    
    • Ohio State University, Lima, OH

      It’s About Discovery is a STEM curriculum for students in grades 8–10 developed by OSU Lima and funded by NSF’s ITEST program. The program, founded on new science modules from the Ford Partnership for Advanced Studies (PAS) curriculum, aims to extend student readiness to engage in STEM careers and equip teachers to use a challenging curriculum that brings STEM careers and content to life; technology is integrated throughout the program. GRG’s external summative evaluation is focusing on changes in student knowledge of and attitudes about STEM subjects, skills, and careers and teacher knowledge of how to educate students on these topics; we also examine student and teacher attitudes toward technology.

                                                                                           

    • Purdue University, West Lafayette, IN
      GRG's evaluation of the Louis Stokes Alliance for Minority Participation (LSAMP) program in Indiana is in its third year of a five-year grant. The LSAMP Indiana program was established in 2003, uniting Purdue West Lafayette, Purdue Calumet, IUPUI, Ball State, and Indiana University Bloomington in their goals to increase the number of underrepresented minority students earning baccalaureate degrees in STEM. Funded by the National Science Foundation, the program recently entered Phase II of its implementation. The current Phase II goal is to triple the number of baccalaureate degrees earned by program participants within the next five years. GRG’s evaluation is gathering process and feedback data to assess the successes of the program.                                                                                       
    • Shelburne Museum, Shelburne, VT.

      GRG is conducting an evaluation of Passport to Learning program created and implemented at the Shelburne Museum. The program intends to introduce and engage K-8 students in art, language arts, math, science, and social studies through exploration of the Shelburne Museum. The evaluation activities include an educator survey implemented in the Spring and Fall of 2010 and the Spring of 2011. GRG will also visit the Museum to observe program implementation.

    • Triangle Coalition for Science and Technology Education, Arlington, VA

      The Albert Einstein Distinguished Educator Fellowship Program, administered by the Triangle Coalition and the Department of Energy–Office of Science, offers outstanding K–12 mathematics, technology, and science teachers the opportunity to serve in the public policy arena. Fellows bring their expertise to Congress and appropriate branches of federal government and gain insights into national educational issues that can then be brought back to the classroom. GRG’s evaluation is examining the impact of the program not only on the Einstein Fellows themselves, but on the federal branches in which the Fellows serve and the schools to which the Fellows return. These outcomes include the Fellows’ familiarity with national STEM policy, legislation, and funding opportunities; the value added to the host branch of having a Fellow; and the benefits to the school and district to which the Fellow returns.


    • University of California, Los Angeles, CA
      A Systems Response to Improving Education on Aging in California (SAGE), a gerontology core curricula, is being developed by UCLA for gerontology, social work, and nursing programs in both two- and four-year colleges. This U.S. Department of Education FIPSE-funded project aims to address the need to prepare a skilled and representative workforce to provide quality services and care to older Californians. GRG is in the third and final year of evaluation. Many aspects of the project are being evaluated, including the management structure developed for the project, the Manual of Procedures, and the faculty development program.                                                                                                                     
    • University of California, Los Angeles, CA

      At the same time we are finishing up an evaluation for the UCLA Multicampus Program in Geriatric Medicine & Gerontology's FIPSE-funded Systems Approach to Gerontology Education (SAGE), we are starting up an evaluation of their new FIPSE-funded project, the Evidence-based Health Promotion (EBHP) Educator Certificate Program. Our evaluation questions are focused on the job market preparation and outcomes for community college students who complete the CTE and the professional development outcomes for faculty who complete the faculty development program and teach the new certificate courses.

    • University of California, Jacobs School of Engineering, San Diego, CA
      GRG has conducted both formative and summative evaluation of an NSF ITEST project (Information Technology – Engineering and Environmental Education Tools -- IT-E3) that features the use of environmental sensors, and includes: 1) a teacher training program with ongoing support; and 2) a curriculum that will be developed by teacher participants. Formative evaluation gathered feedback to improve the professional development and curriculum lessons. Summative data has been used to help determine the influence the program is having on teachers and students, including student interest in and knowledge of STEM.

    • University of California, Biobridge, San Diego, CA
      The BioBridge professional development model, developed by educators and scientists at the University of California, San Diego, consists of a four-phase training model for high school science teachers. The four-phase model was developed over three years by using an iterative process. In 2008 the BioBridge team and GRG were awarded a research grant form the United States Department of Education to conduct a study of the BioBridge model. The purpose of the study is to gather data that can be used to systematize and strengthen the existing BioBridge training. Evaluation activities include surveys, observations, and a secondary analysis of student test scores. The final deliverable for the project is an Implementation Manual that can be used to replicate the BioBridge model and GRG’s evaluation in other sites.                                                                                                                                                                                                                                                     
    •  University of California, National Science Festival Network, San Diego, CA
      GRG is conducting a multi-method process and summative evaluation to demonstrate the success of the National Science Festival Network project. Science Festivals are currently held annually at San Diego, CA and Cambridge, MA. Two new sites will be added to this network in the upcoming year – Bay area, CA and Philadelphia, PA. GRG will contribute to all of the coalition conference meetings planned for the project, as well as the NSFN Web site. GRG’s process evaluation will focus on Planning and Implementation Variables, Festival and Year-Round Event Variables, Audience Variables (by Festival site), and Network variables. During the three years of the evaluation, GRG will carry out summative evaluation activities that explore the success of the four Festivals and hands-on science experiences that participating K-12 children have with local scientists. In addition, GRG will conduct online focus groups each year with key staff, key partners, and key collaborators from each Festival site. During the third year, GRG will carry out the evaluation of the Networking/Collaboration Support Services offered by the NSFN.                                                                                                                                  
    • WGBH-TV, Boston, MA

      Since 1992, GRG has conducted numerous evaluations of public TV programs, web sites, educational print materials, and outreach initiatives developed by WGBH. Currently, GRG is evaluating NOVA ScienceNOW season 5 (having previously evaluated the first four seasons), and the children's series PEEP.  Following is a partial list of current and past projects that GRG evaluated for various WGBH departments (e.g., Educational Print and Outreach, Children’s Programming): Africans in America, Arthur, Between the Lions, Building Big, Design Squad, Einstein’s Big Idea, Fetch, Lives in Science, NOVA ScienceNOW, Oliver Twist, Peep and the Big Wide World, Saved by the Sun, and ZOOM.



      Return to Top
     
     
     
     
     
     
     
     
    footer
    © 2010 Goodman Research Group, Inc. All Rights Reserved.
    site design:www.reddoormedia.com