Automated & Peer Assessment
Get the students & computer do marking
By Marcus Green
1
Why automated?
○ Easier on teachers
○ Less embarrassing to make mistakes
○ Immediate feedback/confirmation
2
Why Peer?
○ Why facebook?
○ Marking requires thought
○ Insights the teacher may not have
3
Topics
● Automatic grading of essay questions
● Automatic generation of quiz hints
● Peer marking quiz questions
● Peer marking in forums
4
The automark fantasy
● AI will mark as well as teachers
● Could alexa mark essays?
● Pattern match question type
5
ESSAY AUTOGRADE
● Gordon Bateson, Moodling since 2003
● Available from Github
● Easier to use than Pmatch
https://github.com/gbateson/moodle-qtype_essayautograde
6
ESSAY AUTOGRADE
● Presence of one or more target phrases
● Number of words/characters
● Lexical analysis
7
EXAMPLE
8
EXAMPLE
9
What is the moodle philosophy?
10
PMatch for Power...
11
Limitations
● Students WILL think of other correct responses
● It is no substitute for a human marking
● But it is still rather useful
12
Auto hinting made possible by
● Sojo University Japan
● Elton LaClare
● A modest cost
13
Quiz question hints
● A great feature of the interactive behaviour
● Who here adds hints to quiz questions?
● What if hints could be added automatically?
14
Auto Letter hints
15
Auto Letter Hints
16
Auto Letter Hints
17
Gapfill Auto Hints
18
Studentquiz: Peer quizzing
● Available from the plugins database
● Well documented
● Uses core and 3rd party question types
19
STUDENTQUIZ (3RD PARTY)
● Take questions
● Create questions
● Grade quality of other questions
20
Features
● Question type restrictions
○ E.g. limit to easy to use types
● Students names can be shown or hidden
● Built in question feedback
○ No additional plugins required
21
STUDENTQUIZ GRADING
22
In summary
● Students
○ Practice, Contribute,Score
● Teachers
○ Moderate, Evaluate, Reuse
23
With thanks to Frank Koch
24
PEER ASSESSMENT IN CORE FORUM
● Forum is not just about announcements
● A great tool for collaboration
● Students can rate each others posts
25
Forum and Permission Setup
● Course Admin/Users/Permissions
26
27
IN SUMMARY
● Let the students do more of the work
● They will learn more
● The tools are available
28
QUESTIONS?
marcus.green@tituslearning.com
https://twitter.com/marcusavgreen
https://examulator.com/marcus
www.tituslearning.com
Twitter: @tituslearning
29

Automated and peer assessment Mootieuk18

Editor's Notes

  • #6 https://www.heacademy.ac.uk/system/files/gen_060_0.pdf https://moodle.org/plugins/qtype_pmatch
  • #7 Gordon Bateson, core contributor and maintainer of 6 plugins https://moodle.org/user/profile.php?id=8277
  • #13 https://studentquiz.hsr.ch/docs/
  • #16 A feature of the gapfill question type, but it could be added to other question types with a small amount of development
  • #17 With thanks to Elton LaClaire of Sojo University Japan
  • #18 With thanks to Elton LaClaire of Sojo University Japan
  • #20 https://moodle.org/plugins/mod_studentquiz https://studentquiz.hsr.ch/docs/
  • #21 https://moodle.org/plugins/mod_studentquiz
  • #22 https://moodle.org/plugins/mod_studentquiz https://studentquiz.hsr.ch/docs/
  • #24 https://moodle.org/plugins/mod_studentquiz https://studentquiz.hsr.ch/docs/