Is it Scalable?: A comprehensive pilot process to evaluate new technology
Concurrent Session 4
Teaching and Learning Technologies at Purdue University has developed a comprehensive pilot process to evaluate new learning technologies. The pilot planning process, establishing a diverse teaching and learning support team, faculty recruitment, implementation, and assessment strategies will be shared with the participants.
Exploration and implementation of new educational technologies at large public research universities can present many challenges. To be “enterprise ready,” a new technology must be scalable across multiple dimensions, including the institutional need, course enrollment size, accessibility, LMS interoperability, and level of required support effort. This presentation will highlight the application of our process on a recent pilot of Gradescope, an online grading tool.
To explore the effectiveness of Gradescope for large-scale implementations, Purdue University launched a pilot project to evaluate the institutional need, LMS interoperability, accessibility, support effort scalability, and teaching and learning impact of the tool. Ten pilot courses had a total of 46 teaching assistants and approximately 1800 students. The effort was led by a diverse team with a goal of providing tailored support to the faculty. This team includes educational technologists who identify faculty’s technology needs and manage the piloting of potential solutions, two educational technology consultants who provide technical training and support, and one instructional designer who assists faculty implementing instructional strategies in their courses. The pilot has demonstrated that having a team with a variety of talents/expertise is helpful to obtain faculty adoption of the tool but also to capture more comprehensive assessment of the tool.