Psychometrics 201: Putting assessment data into action

Psychometrics 201: Putting assessment data into action

• 1.
  1 Psychometrics 201: Putting assessmentdata into action Dan Thompson, M.Ed. Sr. Manager of Education and Assessment ExamSoft #AssessChat @DanThompsonIDTS @ExamSoft
• 2.
  2 Before we begin… •Let’s be social! Tell us about yourself • Include: name, role (faculty/staff/administration), institution, favorite dessert • Assessment Real Talk #AssessChat @DanThompsonIDTS @ExamSoft
• 3.
  3 Session Objectives • Atthe conclusion of this presentation, participants will be able to: 1. Provide meaningful feedback to students for self-assessment 2. Evaluate effectiveness of teaching methods 3. Apply use of exam data for student remediation #AssessChat @DanThompsonIDTS @ExamSoft
• 4.
  4 101 Refresher • P-value(Diff) • Percent correct • Point bi-serial • Indicates whether getting the question correct correlates positively or negatively with performing well on the exam as a whole. • Discrimination Index • Top 27% - Lower 27% • Category Stats • Proactively tag your items #AssessChat @DanThompsonIDTS @ExamSoft
• 5.
  5 Student Feedback • Makeit meaningful! • Timely • Quality • Tag items to licensure exam content areas • Share exam data results with students! • Strength and Opportunity Reports (S&O) • Help students self-assess and make the most of their study time • Students take ownership of their performance #AssessChat @DanThompsonIDTS @ExamSoft
• 6.
  6 Instructional Methods • Whydo we teach? • It all starts with improving student outcomes • “What’s next” • Tag your items by teaching methods • Ex. Flipped classroom, lecture, team-based learning, self-paced modules • Identify which teaching method leads to the best student outcomes • Evaluate use of: • Formative assessments • Educational technology #AssessChat @DanThompsonIDTS @ExamSoft
• 7.
  7 #AssessChat @DanThompsonIDTS @ExamSoft
• 8.
  8 Student Remediation • Takea data driven approach! • Create student specific remediation plans with faculty and/or their academic advisor #AssessChat @DanThompsonIDTS @ExamSoft
• 9.
  9 Exam Construction • Beaware of your exam make-up • Create your exams with a purpose • Select items for exams by: • Category • Previous performance • Exam blueprinting #AssessChat @DanThompsonIDTS @ExamSoft
• 10.
  10 Recommended Order ofOperations 1. Write your questions with your learning objectives in mind 2. Tag your items to the appropriate categories 3. Create your exam – be mindful of the exam blueprint 4. Deliver the exam! 5. Review exam stats to make adjustments 6. Review category reports and distribute S&O reports to students 7. Address areas in which students struggled 8. Create targeted remediation plans for individual students when needed 9. Use exam data to evaluate your course, teaching methods, use of ed tech, etc. after the semester. #AssessChat @DanThompsonIDTS @ExamSoft
• 11.
  11 Take Homes Use psychometricsto improve student outcomes by: 1. Providing meaningful feedback to students 2. Improving classroom instruction 3. Creating targeted student remediation 4. Construct exams that are fair and appropriately challenging for your students #AssessChat @DanThompsonIDTS @ExamSoft
• 12.
  12 Thank you!! • Questions? •Comments? • [email protected] • @DanThompsonIDTS
• 13.
  13 P H ON E + 1 . 9 5 4 . 4 2 9 . 8 8 8 9 E M A I L i n f o @ e x a m s o f t . c o m W E B S I T E l e a r n . e x a m s o f t . c o m THANK YOU! Questions?