OBJECTIVES
The University of Birmingham wanted to improve assessment and feedback in various areas. They defined success by the following metrics that, when put together, make a meaningful impact on assessment and feedback:
- Meaningful speed up of the grading process
- Increase in consistency of feedback
- Increase or maintenance of quality/quantity of feedback
- Improvements or maintenance of ability to receive and attend to their feedback
- A useable platform that is easy to learn
METHODOLOGY
User surveys were conducted comparing Graide to other marking systems they have used (e.g., on paper or Canvas SpeedGrader) and the usability of Graide as a platform.
In addition to user surveys, we have analysed data from Graide's usage. This includes:
- An estimate of the amount of time to grade work
- The amount of feedback given to each submission
- The amount of handwriting repetition we were able to remove
RESULTS
Speed up of the grading process
51% of users found Graide significantly faster, and 39% found it slightly faster.
Easier to give consistent feedback
51% of users found it significantly easier to give consistent feedback in Graide; 29% found it slightly easier.
A useable platform that is easy to use
45% of users strongly agree, and 39% of users agreed, with the usability questions.
Reduction in grading times
The median reduction in grading times was 53% from 11.2 minutes to 5.3 minutes.
More feedback utilisation
Even though 255,000 words of feedback were given, only 20,000 words were typed.
Effective grading times distribution
45% of questions were graded within 14 seconds, and 30% within 6 seconds.
