Ticking all the Boxes: Assessment,
Technology and Institutional Processes
Rachel Forsyth
r.m.forsyth@mmu.ac.uk
@rmforsyth
https://www.slideshare.net/rmforsyth
Image credit: © Copyright Neil Theasby and licensed for reuse
Barrier to implementing technology in assessment: pink card
Example of good practice in changing assessment: green card
2:001:591:581:571:561:551:541:531:521:511:501:491:481:471:461:451:441:431:421:411:401:391:381:371:361:351:341:331:321:311:301:291:281:271:261:251:241:231:221:211:201:191:181:171:161:151:141:131:121:111:101:091:081:071:061:051:041:031:021:011:000:590:580:570:560:550:540:530:520:510:500:490:480:470:460:450:440:430:420:410:400:390:380:370:360:350:340:330:320:310:300:290:280:270:260:250:240:230:220:210:200:190:180:170:160:150:140:130:120:110:100:090:080:070:060:050:040:030:020:01End2:00
Photo by ‘Anne’ on Flickr, CC licensed
Higher Education Funding Council for England (2014). UK review of the provision of
information about higher education: National Student Survey results and trends
analysis 2005-2013. Bristol (p25)
Typewriter Learning and Teaching Strategy
Learning, Teaching and Assessment Strategy
World Class University
Learning and Teaching Strategy
World Class University
Learning, Teaching
and Assessment Strategy
Ticking all the boxes rm forsyth_12_04_17
Professor Mark Stubbs @the_stubbs Dr Rod Cullen @rodcullen
TRAFFIC: Transforming Assessment and
Feedback for Institutional Change
Dr Neil Ringan @NRManc
Photo by ‘George’ on Flickr, CC licensed
0%
5%
10%
15%
20%
25%
Frequencyofassignmenttype
MMU Most common assignment types
2013/14
level 4 - total number
1077, 65 types
level 5 - total number
1333, 71 types
level 6 - total number
1606, 74 types
Ticking all the boxes rm forsyth_12_04_17
1. Assessment affects (almost) everything
2. Assessment was a series of black boxes
3. More joining up was needed
Image by Judy & Ed on Flickr, CC licensed
Ticking all the boxes rm forsyth_12_04_17
Image by Khrawlings on Flickr, CC licensed
Assignment briefs
Verification procedures
Moderation procedures
Standard marking descriptors
Feedback plans
Defining assessment
types & weightings
in student records
Recording
deadlines / return
dates in student
records
Publishing
deadlines /
return dates in
coursework
receipting
system/ Moodle
and assignment
briefs in Moodle
Downloading
coursework
receipting system
coversheets for
paper submissions
+
Submitting onlineMarking &
annotating work
online
Allocating
work to
assessors
Entering marks
manually into SRS
+
transferring marks
electronically from
Moodle into
student records
Publishing
provisional marks
in Moodle
+
Calculating &
publishing exam
board outcomes
Presenting
assessment
analytics
tomonitoring
dashboards
Image by Tal Atlas on Flickr, CC licensed
Staff view
Student view
New marking criteria linked to
employability and to GradeMark
rubrics
Is the feedback used?
What for?
How can we make use of it?
What about
non-paper
submissions?
How much feedback is
needed?
In what format?
How do students get it?
Are marks and feedback
returned together?
Reliable
information
Better design
support
3
3.2
3.4
3.6
3.8
4
4.2
Assessment
and feedback
overall
5. The criteria
used in
marking have
been clear in
advance.
6. Assessment
arrangements
and marking
have been fair.
7. Feedback on
my work has
been prompt.
8. I have
received
detailed
comments on
my work.
9. Feedback on
my work has
helped me
clarify things
I did not
understand.
NSSSatisfaction
NSS Questions
MMU Assessment and Feedback outcomes in NSS 2010-2015
2010
2011
2012
2013
2014
2015
3.4
3.5
3.6
3.7
3.8
3.9
4
2008 2009 2010 2011 2012 2013 2014 2015
NSSsatisfactionscoreforAssessmentand
Feedback
Overall NSS satisfaction outcomes for assessment and
feedback
UK average
MMU
Image credit: © Copyright Neil Theasby and licensed for reuse
Try to add a solution to the reverse of the pink card
Suggest how you might implement good practice on reverse of
green card
Picture credits
Images from MMU, except
Dunce picture by by ‘Anne’ on Flickr, CC licensed
Detail from "Les Lavandières de la nuit" ("The Washerwomen of
the Night"), by Jean-Édouard Dargent c.1861
Washing Image credit: © Copyright Neil Theasby and licensed
for reuse
Headphones by Tal Atlas on Flickr, CC licensed Piles of paper by
Khrawlings on Flickr, CC licensed
Stacks of boxes by Judy and Ed on Flickr, CC licensed
Free timer from A6Training.co.uk

More Related Content

PPTX
Social Media Survey Results Impactof Social Media And Recruitment
PPTX
Seda 2016
PPTX
Seminar at Mary Immaculate College, University of Limerick, Jan 2016
PPTX
HEIR conference 8-9 September 2014: Forsyth and Stubbs
PPTX
Transforming assessment and feedback through technology at Manchester Metropo...
PPTX
Using GradeMark to engage students in the feedback process
PDF
Can electronic marking help to engage students with assessment and feedback?
PPTX
Learning analytics for assessment and feedback
Social Media Survey Results Impactof Social Media And Recruitment
Seda 2016
Seminar at Mary Immaculate College, University of Limerick, Jan 2016
HEIR conference 8-9 September 2014: Forsyth and Stubbs
Transforming assessment and feedback through technology at Manchester Metropo...
Using GradeMark to engage students in the feedback process
Can electronic marking help to engage students with assessment and feedback?
Learning analytics for assessment and feedback

Similar to Ticking all the boxes rm forsyth_12_04_17 (20)

PPTX
HE Course and Module Evaluation Conference - Peter Bird & Rachel Forsyth
PPTX
Can electronic marking help engage students with assessment and feedback
PPTX
Developing a system function future state for online management of assessment
PPTX
Measuring the impact of instant high quality feedback.
PPTX
Pollyana Magne "Inclusive Assessment"
PPTX
Forward thinking feedback at UEA
PPTX
Designing assessment and assessment-criteria
PPTX
Rob Howe - The honest journey to full e-submission and feedback using blackboard
PPT
Assessment in HE: Beginning teach in HE
PPTX
Approaches to changing assessment and feedback practice
PDF
Educational Research
PPTX
Designing Authentic, Quality Assessments
PPT
Framing Feedback for Formative Assessment, Denise Whitelock
PPTX
Rob howe - assessment strategies in a digital age
PPTX
Using GradeMark to improve feedback and engage students in the marking process
PPTX
Client Insights - Sheffield Hallam University: Assessment Journey
PDF
Using GradeMark to improve feedback and engage students in the marking process
PPTX
TLC2016 - Assessment Journey: a programme to enhance the educational experien...
PPT
CDE Conference 09/02/2009. D Whitelock (second presentation)
DOCX
1 Assessment Brief Module Code Module .docx
HE Course and Module Evaluation Conference - Peter Bird & Rachel Forsyth
Can electronic marking help engage students with assessment and feedback
Developing a system function future state for online management of assessment
Measuring the impact of instant high quality feedback.
Pollyana Magne "Inclusive Assessment"
Forward thinking feedback at UEA
Designing assessment and assessment-criteria
Rob Howe - The honest journey to full e-submission and feedback using blackboard
Assessment in HE: Beginning teach in HE
Approaches to changing assessment and feedback practice
Educational Research
Designing Authentic, Quality Assessments
Framing Feedback for Formative Assessment, Denise Whitelock
Rob howe - assessment strategies in a digital age
Using GradeMark to improve feedback and engage students in the marking process
Client Insights - Sheffield Hallam University: Assessment Journey
Using GradeMark to improve feedback and engage students in the marking process
TLC2016 - Assessment Journey: a programme to enhance the educational experien...
CDE Conference 09/02/2009. D Whitelock (second presentation)
1 Assessment Brief Module Code Module .docx
Ad

More from Rachel Forsyth (14)

PPTX
Paul Orsmond and Rachel Forsyth SEDA Summer 2017 Capturing learning final
PPTX
Programme development
PPTX
Introduction to unit leadership 2015
PPTX
Formative Feedback Harper Adams LT Forum
PPT
Assessment in he_online_webinar1
PPTX
Programme leadership Webinar 03 2015
PPTX
Webinar 02 2015
PPTX
#proglead15 Webinar 01
PPTX
CELT Intro for MMU Cheshire Lecturers 2014
PPTX
Assessment in HE webinar 6 #aheo2014
PPT
Assessment in he 2014 webinar 5
PPT
Assessment in he 2014 webinar 4
PPTX
Assessment in HE webinar 2
PPTX
Assessment in he 2014 online introduction
Paul Orsmond and Rachel Forsyth SEDA Summer 2017 Capturing learning final
Programme development
Introduction to unit leadership 2015
Formative Feedback Harper Adams LT Forum
Assessment in he_online_webinar1
Programme leadership Webinar 03 2015
Webinar 02 2015
#proglead15 Webinar 01
CELT Intro for MMU Cheshire Lecturers 2014
Assessment in HE webinar 6 #aheo2014
Assessment in he 2014 webinar 5
Assessment in he 2014 webinar 4
Assessment in HE webinar 2
Assessment in he 2014 online introduction
Ad

Recently uploaded (20)

PPTX
DRUGS USED FOR HORMONAL DISORDER, SUPPLIMENTATION, CONTRACEPTION, & MEDICAL T...
PDF
BP 505 T. PHARMACEUTICAL JURISPRUDENCE (UNIT 2).pdf
PDF
1.3 FINAL REVISED K-10 PE and Health CG 2023 Grades 4-10 (1).pdf
PPTX
Climate Change and Its Global Impact.pptx
PDF
semiconductor packaging in vlsi design fab
PDF
Vision Prelims GS PYQ Analysis 2011-2022 www.upscpdf.com.pdf
PDF
Journal of Dental Science - UDMY (2021).pdf
PDF
Skin Care and Cosmetic Ingredients Dictionary ( PDFDrive ).pdf
PPTX
Share_Module_2_Power_conflict_and_negotiation.pptx
PDF
LIFE & LIVING TRILOGY- PART (1) WHO ARE WE.pdf
PDF
My India Quiz Book_20210205121199924.pdf
PDF
Hazard Identification & Risk Assessment .pdf
PDF
LEARNERS WITH ADDITIONAL NEEDS ProfEd Topic
PPTX
Introduction to pro and eukaryotes and differences.pptx
PDF
HVAC Specification 2024 according to central public works department
PDF
Race Reva University – Shaping Future Leaders in Artificial Intelligence
PDF
English Textual Question & Ans (12th Class).pdf
PPTX
ELIAS-SEZIURE AND EPilepsy semmioan session.pptx
PDF
AI-driven educational solutions for real-life interventions in the Philippine...
PPTX
A powerpoint presentation on the Revised K-10 Science Shaping Paper
DRUGS USED FOR HORMONAL DISORDER, SUPPLIMENTATION, CONTRACEPTION, & MEDICAL T...
BP 505 T. PHARMACEUTICAL JURISPRUDENCE (UNIT 2).pdf
1.3 FINAL REVISED K-10 PE and Health CG 2023 Grades 4-10 (1).pdf
Climate Change and Its Global Impact.pptx
semiconductor packaging in vlsi design fab
Vision Prelims GS PYQ Analysis 2011-2022 www.upscpdf.com.pdf
Journal of Dental Science - UDMY (2021).pdf
Skin Care and Cosmetic Ingredients Dictionary ( PDFDrive ).pdf
Share_Module_2_Power_conflict_and_negotiation.pptx
LIFE & LIVING TRILOGY- PART (1) WHO ARE WE.pdf
My India Quiz Book_20210205121199924.pdf
Hazard Identification & Risk Assessment .pdf
LEARNERS WITH ADDITIONAL NEEDS ProfEd Topic
Introduction to pro and eukaryotes and differences.pptx
HVAC Specification 2024 according to central public works department
Race Reva University – Shaping Future Leaders in Artificial Intelligence
English Textual Question & Ans (12th Class).pdf
ELIAS-SEZIURE AND EPilepsy semmioan session.pptx
AI-driven educational solutions for real-life interventions in the Philippine...
A powerpoint presentation on the Revised K-10 Science Shaping Paper

Ticking all the boxes rm forsyth_12_04_17

  • 1. Ticking all the Boxes: Assessment, Technology and Institutional Processes Rachel Forsyth [email protected] @rmforsyth https://www.slideshare.net/rmforsyth
  • 2. Image credit: © Copyright Neil Theasby and licensed for reuse Barrier to implementing technology in assessment: pink card Example of good practice in changing assessment: green card 2:001:591:581:571:561:551:541:531:521:511:501:491:481:471:461:451:441:431:421:411:401:391:381:371:361:351:341:331:321:311:301:291:281:271:261:251:241:231:221:211:201:191:181:171:161:151:141:131:121:111:101:091:081:071:061:051:041:031:021:011:000:590:580:570:560:550:540:530:520:510:500:490:480:470:460:450:440:430:420:410:400:390:380:370:360:350:340:330:320:310:300:290:280:270:260:250:240:230:220:210:200:190:180:170:160:150:140:130:120:110:100:090:080:070:060:050:040:030:020:01End2:00
  • 3. Photo by ‘Anne’ on Flickr, CC licensed
  • 4. Higher Education Funding Council for England (2014). UK review of the provision of information about higher education: National Student Survey results and trends analysis 2005-2013. Bristol (p25)
  • 5. Typewriter Learning and Teaching Strategy Learning, Teaching and Assessment Strategy World Class University Learning and Teaching Strategy World Class University Learning, Teaching and Assessment Strategy
  • 7. Professor Mark Stubbs @the_stubbs Dr Rod Cullen @rodcullen TRAFFIC: Transforming Assessment and Feedback for Institutional Change Dr Neil Ringan @NRManc
  • 8. Photo by ‘George’ on Flickr, CC licensed
  • 9. 0% 5% 10% 15% 20% 25% Frequencyofassignmenttype MMU Most common assignment types 2013/14 level 4 - total number 1077, 65 types level 5 - total number 1333, 71 types level 6 - total number 1606, 74 types
  • 11. 1. Assessment affects (almost) everything 2. Assessment was a series of black boxes 3. More joining up was needed Image by Judy & Ed on Flickr, CC licensed
  • 13. Image by Khrawlings on Flickr, CC licensed Assignment briefs Verification procedures Moderation procedures Standard marking descriptors Feedback plans
  • 14. Defining assessment types & weightings in student records Recording deadlines / return dates in student records Publishing deadlines / return dates in coursework receipting system/ Moodle and assignment briefs in Moodle Downloading coursework receipting system coversheets for paper submissions + Submitting onlineMarking & annotating work online Allocating work to assessors Entering marks manually into SRS + transferring marks electronically from Moodle into student records Publishing provisional marks in Moodle + Calculating & publishing exam board outcomes Presenting assessment analytics tomonitoring dashboards
  • 15. Image by Tal Atlas on Flickr, CC licensed
  • 16. Staff view Student view New marking criteria linked to employability and to GradeMark rubrics Is the feedback used? What for? How can we make use of it? What about non-paper submissions? How much feedback is needed? In what format? How do students get it? Are marks and feedback returned together? Reliable information Better design support
  • 17. 3 3.2 3.4 3.6 3.8 4 4.2 Assessment and feedback overall 5. The criteria used in marking have been clear in advance. 6. Assessment arrangements and marking have been fair. 7. Feedback on my work has been prompt. 8. I have received detailed comments on my work. 9. Feedback on my work has helped me clarify things I did not understand. NSSSatisfaction NSS Questions MMU Assessment and Feedback outcomes in NSS 2010-2015 2010 2011 2012 2013 2014 2015
  • 18. 3.4 3.5 3.6 3.7 3.8 3.9 4 2008 2009 2010 2011 2012 2013 2014 2015 NSSsatisfactionscoreforAssessmentand Feedback Overall NSS satisfaction outcomes for assessment and feedback UK average MMU
  • 19. Image credit: © Copyright Neil Theasby and licensed for reuse Try to add a solution to the reverse of the pink card Suggest how you might implement good practice on reverse of green card
  • 20. Picture credits Images from MMU, except Dunce picture by by ‘Anne’ on Flickr, CC licensed Detail from "Les Lavandières de la nuit" ("The Washerwomen of the Night"), by Jean-Édouard Dargent c.1861 Washing Image credit: © Copyright Neil Theasby and licensed for reuse Headphones by Tal Atlas on Flickr, CC licensed Piles of paper by Khrawlings on Flickr, CC licensed Stacks of boxes by Judy and Ed on Flickr, CC licensed Free timer from A6Training.co.uk