Building Confidence in Learning Analytics Solutions: Two Complementary Pilot Studies
Résumé
Many higher education institutions face the problem of a significant rate of students who drop out and propose interventions to tackle this problem. Learning analytics is an emerging solution to design, implement, and evaluate such interventions. This chapter presents two preliminary studies conducted in two higher education institutions, respectively, in Germany and France, designed to gain insights about students who drop out and with the purpose of supporting students’ achievement. These studies focus on different data: historical academic data from the information system of the university in one study and activity data from the learning management system in the other and on different stakeholders. To build confidence, these studies (1) follow an iterative and incremental approach, (2) involve all stakeholders, (3) and are in accordance with the European General Data Protection Regulation (GDPR) as far as privacy issues are concerned. First findings highlight that dropout does not occur only during the first semester, although mainly, and confirm that the reasons for dropout are complex. In addition, we found out that students are in favor of dashboards that inform them about their activity and have consistent expectations: being informed about their progress, peer comparison, and have control over the dashboard. Although evaluating the impact of dashboards on dropout is complex, the first findings highlight the usability of the proposed dashboard. The ultimate goal is that institutions adopt both solutions once lessons have been learned.