Rethinking Peer Review

Concurrent Session 1

Brief Abstract

During this session, staff from the Purdue University will discuss the pilot of the recently created peer review product, Circuit. Circuit is a peer review application that is easy for students to use and for instructors to manage.  It allows students to upload a variety of file types including: rich text (including LaTeX math formulas), URLs, Video and several more. It then provides a mechanism for students (an instructors) to provide anonymous feedback scores, rubrics, calibrations or a combination.

Sponsored By

Presenters

Anthony Newman is the Senior Manager of Business Development for the Office of Vice President of Information Technology at Purdue University. In this role, Anthony is responsible for commercializing and scaling cutting edge technologies created by Purdue's IT Organization.   Formerly, Anthony led the Purdue Studio team where he was responsible for leading a creative team of developers and designers and students in the identification, development and delivery of digital applications based on customer needs, strategic vision and market research. The work of his group was featured in the New York Times, Campus Technology, CIO Magazine, CNET, and The Chronicle of Higher Education.   Anthony offers a diverse perspective compared to many in the education field. After obtaining computer science and business degrees, Newman spent the next 13 years, in consulting and government where he spent 6 years in senior management. His experience in a variety of roles inside and outside of education allows him to look at education transformation in a unique way.

Extended Abstract

What if assignment feedback could be given in a way that provided enough detail, clarity, and specificity to where it was actually beneficial to students? The Purdue Studio team set out to answer just that with the creation and pilot of a new calibrated peer review product, Circuit. Traditionally, peer review has lacked all of these items which has resulted in students feeling apathetic toward yet another feedback. Circuit was created to not only make feedback easy but make it informational, satisfying and most importantly effective. Using some of the same principles in paper-based and LMS-based review systems, we created a tool that allows students to submit work in a way they are already familiar and gain quick actionable feedback.

Circuit, a web and mobile application, was created by Purdue Studio to bring the movement of peer review back into higher education. Circuit allows students to upload a variety of file types including: rich text (including LaTeX math formulas), URLs, Video and several more. It then provides a mechanism for students (an instructors) to provide anonymous feedback scores, rubrics, calibrations or a combination.

During this session, Purdue staff will discuss the release of a newly developed teaching and learning tool Circuit as well as share the results of the first pilot of the tool. Details will be shared about a shift in learning as students were able to quickly learn from their peers and become better creators of learning material. Development of the application, implementation, and outcomes of an institutional pilot of this unique feedback application will frame the conversation. 

By the end of this session, participants should be able to:

  • List and understand the pros/cons of peer review within a higher education setting
  • Discuss the advantages and limitations of using a tool such as Circuit in a calibrated peer review setting
  • Identify how instructional tools such as Circuit balance student and instructor needs
  • Plan and carry out a robust pilot across institutions