The exit survey contained 10 SUS-style questions, which are presented separately from the rest of the survey, for ease of reading.
Each question asked the participant to select one of the following: Strongly Disagree
, Disagree
, Neither Agree or Disagree
, Agree
, or Strongly Agree
. These questions were used to compute a SUS score
- If I need to write a provenance policy in the future, I would like to use this tool.
- I found the tool unnecessarily complex.
- I thought policies were easy to specify using this tool.
- I would need the support of an expert to be able to use the tool regularly.
- I found the various functions in this tool were well integrated.
- I thought there was too much inconsistency in this tool.
- Most people would learn to use this tool quickly.
- The tool is cumbersome to use.
- I felt confident in my ability to specify policies correctly using this tool.
- I needed to learn a lot to use this tool.
Each question asked the participant to select one of the following: Strongly Disagree
, Disagree
, Neither Agree or Disagree
, Agree
, or Strongly Agree
. These questions were NOT used to compute a SUS score
- I took a long time to discover problems in policies using this tool.
- I could quickly identify errors in the policies using this tool.
- The provenance training adequately prepared me for the assessment.
- The ProProv training adequately prepared me for the assessment.
- The Rego training adequately prepared me for the assessment.
- After completing the provenance training, I was not prepared to create policies.
- After completing the ProProv training, I was not prepared to create policies.
- After completing the Rego training, I was not prepared to create policies.
Participants were given a textbox to answer the following questions.
- Do you have any recommendations for improving the ProProv tool?
- Do you have any recommendations for improving Rego?
- Do you have any issues, comments, or other remarks on the provenance training?
- Do you have any issues, comments, or other remarks on the ProProv training?
- Do you have any issues, comments, or other remarks on the Rego training?
- Do you have any recommendations for improving the training on provenance?
- Do you have any recommendations for improving the ProProv training?
- Do you have any recommendations for improving the Rego training?