Efficacy and Accuracy of Peer Assessment Across Pedagogies

Concurrent Session 8

Brief Abstract

When given a chance to evaluate and write feedback on each others' work, students immerse themselves in an asynchronous learning opportunity that exposes them to diverse perspectives and strengthens their grasp on the topic. The 360-degree peer evaluation tool on Kritik enables students to give feedback only based on the rubrics provided by their instructor. As an AI-driven platform, Kritik calibrates students grading power with the instructor's grading standard making the peer assessment scores accurate for any type of assignment.

Extended Abstract

In this session, we will be demonstrating how Kritik works as a peer assessment tool. Instructors across class sizes and disciplines rely on Kritik
for the primary evaluative function because of the impact it has on student engagement and learning.

We will be presenting 3 case studies where we will talk through the type of assignments the instructor sets up on Kritik and how students progress through each of the three stages of the peer assessment process.

As peer assessment on Kritik is anonymous, students only focus on the rubrics to give feedback to their peers. Each student evaluates at least 3 of their peers' work qualitatively and quantitatively. The final grade that a student receives is made up of how the quality of feedback(s) received compares to the instructor's standard.

The further the student’s grade is from the teacher, the lower the grading power will be. Likewise, the closer the student’s grade is to the teacher’s grade, the higher the grading power will be. This system is put in place to ensure that ratings are compared across three creations selected and rated by the instructor. Then, when students grade each other, the accuracy will be higher as the grading power will play an important role to reduce unfair grading and empower great peer evaluators to lead the groups of evaluators in the same classroom.

Students will also have the opportunity to raise a dispute for any grades they received, as long as they provide a written explanation as to why they think they were misgraded.

With Kritik, students are more at ease to embrace diversity and openness to their peers because they have the time to think and reply at their own pace. Kritik helps students to debate in a peaceful manner and gives a voice to all students: the shy and the outspoken.