Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Offline analysis tool fails to match questions for diagnostic mode exams #1112

Open
Lycanic opened this issue Sep 18, 2024 · 1 comment
Open

Comments

@Lycanic
Copy link
Contributor

Lycanic commented Sep 18, 2024

When using an encrypted file from a diagnostic mode exam, the offline analysis tool will consider it invalid as the ordering of the questions/groups are not as expected.

Extra context: The student's file stores questions in the order visited with blank entries for the remaining questions, whilst the exam definition stores all questions in a set order - it seems sequential exams respect that set order in their question storage, which was relied on in the table generation.

@Lycanic
Copy link
Contributor Author

Lycanic commented Sep 19, 2024

Follow-up:

It was expected that the question_group_order in the Scorm data would indicate the order of the shown question groups, however, in the case of diagnostic mode, both question_group_order and questionSubsets appear to be uncustomised and simply list the defined groups and subsets without respect to what was shown to the student.

I'm unsure if this is an issue with the saved data (that is, whether question_group_order should show the order that the student saw and it's a bug in the scorm data that it doesn't) or an impossible task (if the definition/generation of question_group_order doesn't allow the nebulous existence of any given question) - if the latter, then I need to adapt the attempt_grouped_questions function to support this difference/check for its presence, if the former, then it is a separate issue to be fixed but any data made before it is fixed will not work and may need a different method/external check anyway.

In essence, I think I need to update attempt_grouped_questions to double-check that the question groups line up (and re-do itself if not!) but there may also be an extra bug within the SCORM data for diagnostic tests.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant