The Report Reader Scorecard: A New Resource for Research Literacy

Concurrent Session 1
Streamed Session

Brief Abstract

The Oregon State University Ecampus Research Unit has created a new free resource called the Report Reader's Scorecard, which offers a guide for assessing the quality and rigor of online teaching and learning study reports. In this session, participants will have the opportunity to try out the Scorecard by applying it to to a recent report from the field, see a tour of the Scorecard's supplemental website, ask questions about the Scorecard categories, and offer feedback on how the resource worked for them.

Presenters

Dr. Katie Linder is an avid writer and researcher with a passion for process and peeking behind the scenes at what it takes to be a successful academic. Currently, Katie directs the Oregon State University Ecampus Research Unit and serves as an associate editor for the International Journal for Academic Development. She is also the creator of the Radical Self-Trust Podcast Channel and the host of a weekly interview-based podcast called Research in Action. She writes a weekly essay series called The Academic Creative. Her most recent book is Managing Your Professional Identity Online: A Guide for Faculty, Staff, and Administrators.

Extended Abstract

As the online education community continues to grow, the research literature is also expanding. This scholarship is helping a range of stakeholders to make data-driven decisions about how to best help online students learn, how to grow online programs using best practices of distance education administration, how to support faculty in delivering quality courses, and much more.

Researchers from the Oregon State University Ecampus Research Unit have created a free resource called The Report Reader Scorecard to assist members of field in consuming all of the data that is being generated to help us do our work better.

The Report Reader Scorecard is a comprehensive set of criteria that offers readers a guide to evaluate the quality and rigor of online education study reports they may encounter in their work.

The scorecard is divided into six main areas:

  1. Context
  2. Methodology
  3. Sample
  4. Reporting Results
  5. Transparency
  6. Reader Experience

The session will begin with the presenter sharing briefly about the origins of the Scorecard and offering a tour of the Scorecard's supplemental website. Participants will then be broken into small groups and asked to try out the Scorecard on a recent online education study report by looking for the different components discussed in the Scorecard. This interactive report "scavenger hunt" will be followed by a large-group discussion where participants can (1) ask questions about the Scorecard categories, and (2) offer feedback on how the resource worked for them.

Throughout this session, the presenter will also offer suggestions for reading study reports efficiently while also effectively digesting important information for data-driven decision making.

Participants will leave the session with:

  1. an increased awareness of criteria that indicates quality and rigor in study reports
  2. a new tool to help them digest study reports in the field of online teaching and learning
  3. suggestions for how to read study reports efficiently