Technological Tools Used to Implement an Empowerment Evaluation Remotely and Build Community in the Process

• In Event: Marriott Roundtable Session 32
  In Roundtable Session: Empowerment Evaluation and Technology: Building a Virtual Computer Science/STEM+C Evaluation Learning Community

Abstract

Members of the group had to participate remotely because they were distributed throughout the country. Technological tools were instrumental in providing a structure and mechanism (scaffolding) for the above work. In addition to the tools listed below we used Video Conferencing tools (Google Hangouts and Zoom) and recordings of key meetings on Youtube.

Google Forms

The first tool used gather insights from the group and prepare for the empowerment evaluation was Google Forms. This included an online “agenda survey” to poll the members of their concerns, needs, and what could offer to the group.

We also used a “meta-repository” review form to rate and discuss existing resource collections for features, with the results available for analysis and comments in spreadsheet form (Sheets).

Google Sheets

A Google Sheets template (tinyurl.com/blankeetemplate) was the central piece of the empowerment process, with tabs for brainstorming the mission, listing key activities, prioritizing, ranking, planning and monitoring next steps. Google Sheets helped participants see each other’s individual ratings (using initials) and aggregate ratings at the same time. This tool has also been used with evaluators from Computer Science Outcomes Networked Improvement Community and in an AERA Workshop in 2016 last year (see image below). Google Sheets will also be used to create empowerment evaluation dashboards. They will consist of the subgroups goals, milestones, and actual performance.

Awesome Table

Awesome Table is being used to build a CS evaluation repository. This will enable evaluators to search tools and measures in a timely manner.

Google Docs

Google Docs was instrumental in recording the group’s input throughout the empowerment evaluation exercises. Participants were able to type in their thoughts and ideas throughout the evaluation. Google Docs was also used to record any notes about the group’s meetings and discussions. This created an institutional memory and allowed others to “catch up” with the group’s discussions and decisions in case they missed a session. Here is the repository meta-repository Doc with an explanation of the process and an evolving lists of sites to review.

Hub Web Page

Finally, a web page is being collaboratively constructed web page is being created (in part as a result of this empowerment evaluation). The web page will be a hub or center to link evaluators to measures, mentoring opportunities, and various educational materials. It will be the interface that facilitates evaluation capacity building which is at the heart of both the Evaluation Wrecking Crew initiative and empowerment evaluation principles itself.

In conclusion, technology has been an invaluable tool to implement an empowerment evaluation and build a community of learners.

Google Forms (to complete surveys and collect feedback)
Google Sheets (to facilitate online version of empowerment evaluation)
Awesome Table (to make spreadsheet data searchable)
Google Hangout and Zoom (used to facilitate real-time discussions )
Google Docs (to dynamically set agenda, record notes and share resources)
YouTube (to record and/or summarize some meetings and discussions)

Our demonstration will show attendees how they can use these tools too.

Authors

• Jason Ravitz, Google Inc

• David M. Fetterman, Fetterman and Associates