Forward Thinking about Backward Design: Making Data-Driven Decisions to Support Programming

Concurrent Session 7

Session Materials

Brief Abstract

This interactive presentation will focus on using backward design principles to understand instructor and student needs and to implement programmatic and departmental changes regarding tech-enhanced, blended, and online learning. We will discuss results from past projects and ways these data have driven decision-making at two University of Wisconsin System institutions.

Presenters

Nicole is currently the Director of Learning Technology at the University of Wisconsin-Whitewater where she is responsible for providing vision, leadership, guidance and support in the delivery of innovative, high-quality, pedagogically-sound and technology-enhanced instruction. She has extensive experience in leading student success initiatives, facilitating online and blended faculty development, creating communities of practice around online and blended teaching, and evaluating the effectiveness of emerging learning technologies in higher education environments. Additionally, Nicole has taught face-to-face, blended, and online courses around research methods, community problems, and educational psychology at various universities since 2009. Her research interests lie in emerging technology, social processes, faculty development, course design, and the impact of current higher education practices on first-generation college students, with her work having been published in several books and journals, as well as presented nationally.
Dylan Barth is a Teaching, Learning, and Technology Consultant in UW-Milwaukee’s Center for Excellence in Teaching and Learning (CETL), where he coordinates the Online and Blended Teaching Program. Dylan’s areas of focus include online and blended pedagogy, asynchronous discussions, active learning classroom strategies, gamification, and learning analytics. Dylan also serves as the Online Programs Coordinator through the Office of the Provost and teaches courses in Women’s and Gender Studies and the Honors College.

Extended Abstract

How can data be gathered from key audiences and be used to make decisions at the programmatic and departmental levels? McTighe and Wiggins’ Backward Design framework has been a popular method for guiding curriculum, assessment, and instruction in K12 and higher education since the late 1990s. In this interactive session, the presenters will share their experiences at two University of Wisconsin System institutions utilizing this framework as a guide to making data-driven decisions about programming, as well as how it may be used to enhance the vision, mission, goals, and activities of departments and centers that support tech-enhanced, blended, and online learning.     

Specifically, this session will focus on providing participants with a Backward Design Framework to data-driven decision-making that features the following three phases:

  • Identifying desired results (i.e., What do you want to be able to do?)

  • Determining acceptable evidence (i.e., What do you need to know to be able to do what you want to do?)

  • Designing activities (i.e., How do you collect data in a way that allows you to provide acceptable evidence--who has the information you need and how/when is the best way to get that information? How do you analyze collected data and report results in a way that makes a case for change? After you have your cases, what do you do with them? How does this speak to the literature and trends in higher education?)   

These three phases will be further described and the presenters will provide two concrete examples of how these phases were utilized at each of their institutions. The first example will focus on how data were collected from instructors and facilitators to inform programmatic decisions around an online and blended faculty development program. The second example will feature how an instructor support survey and student focus groups were used in data-driven decision making around evaluating and enhancing a Learning Technology Center's vision, mission, goals, and supporting activities to ensure audience needs are being met. Both examples will provide concrete examples of defining this process; collecting and analyzing data; reporting results; creating cases; and applying what is learned to make decisions at the programmatic and departmental levels.

The session will conclude with a discussion of rewards and challenges regarding the use of this framework, leaving time for participants to share their experience using data to inform decision-making at their institutions and ask questions.

Presenters intend to engage the audience at various points in this interactive session through the utilization of the online polling system, Kahoot. Kahoot has found a great use in conference presentations as a way for presenters to actively engage participants through competitive gaming. Throughout the session participants will be asked to engage in answering questions about the process and the data that were collected (e.g., What was the topic related to emerging technology and pedagogy that instructors were most interested in learning more about? What did instructors cite as their biggest barrier to participating in faculty development?) in the two examples provided, with participants earning the most points for quick and correct answers.

By the conclusion of this session, participants will be able to:

  • Describe the Backward Design Framework to data driven decision-making;  

  • Apply the Backward Design Framework to planning programs or departmental vision, mission, goals, and activities at their own institution;

  • Determine different types of data that could provide answers to key questions, further supporting and enabling decision-making; and

  • Discuss rewards and challenges of data-driven decision making.