Skip to content

Quick Start

Jump to bottom
Linda edited this page Jul 27, 2023 · 26 revisions

This Quick-Start Guide will show you how to conduct your own audit of one of Moodle's AI-based Learning Analytics models using the plugin "Let's audit Learning Analytics" (LaLA).

⚠️ While LaLA is still in the beta phase, it is not recommended to run the plugin on production servers, since collecting the evidence while creating a model version could temporarily lead to heavy load on the servers, impacting the experience for other users.

To use LaLA to conduct an audit, you can follow these auditing steps, which are each explained in detail later:

  1. Make sure your audit environment fulfills all prerequisites.

Prerequisites

  • Set up or have admin access to a Moodle server. You could, for example, use this Docker configuration to quickly set up a local Moodle server.
  • Install LaLA as described in the README.
  • Have some data in your database that can be used for auditing.

💡 Which data you need depends on the model you want to audit, and the claims you want to verify. For example, for the student dropout prediction model, you need a finished course that has several sections and a start and end date, with these dates being less than a year apart1. Additionally, students need to be enrolled in that course, with the enrollment start and end date being set and approximately matching those of the course, and not being further than a year apart1. Between the start and the end of a course, there needs to be student activity registered as events in the log store2. The amount of events required is at least 10 times the number of students2. You could obtain this kind of data by exporting a backup of a suitable finished course (including student activity) from a Moodle server in production, and importing it on your development server.

⚠️ Please note that data protection laws apply.

🛠️ With the next version of LaLA, anonymized audit datasets will be provided, and auditors will be able to use their own dataset for the audit.

1. Moodle (2023) Students at risk of dropping out. Available at: https://docs.moodle.org/402/en/Students_at_risk_of_dropping_out. ↩
2. Moodle (2021) Analytics FAQ. Available at: https://docs.moodle.org/402/en/Analytics_FAQ ↩

This work is funded by the Federal Ministry of Education and Research of Germany as part of the project Fair Enough? (project nr: 16DHB4002) at the University of Applied Sciences (HTW) Berlin.

Clone this wiki locally