Student Engagement Survey
SARAH GRETTON
DEREK RAINE
Student Engagement Survey
1. BACKGROUND – AUSSE, HEA
2. OUR SURVEY: ADMINISTRATION
3. OUR SURVEY: OVERALL RESULTS AND

COMPARISON WITH AUSSE
4. OUR SURVEY: SELECTED RESULTS FROM
DEPARTMENTS
5. WHERE NEXT?
Why student engagement?
Student engagement v/s satisfaction based on e.g.
Arthur W. Chickering and Zelda F. Gamson "Seven
Principles for Good Practice in Undergraduate Education“
STUDENT -- FACULTY CONTACT
COOPERATION AMONG STUDENTS
ACTIVE LEARNING
PROMPT FEEDBACK
EMPHASIZE TIME ON TASK
COMMUNICATES HIGH EXPECTATIONS
RESPECTS DIVERSE TALENTS AND WAYS OF LEARNING

Student engagement -> learning gains
The scales of engagement
Academic Challenge - the extent to which expectations
and assessments challenge students
to learn (Questions 1s, 2b, 2c, 2d, 3a, 3b, 8b, 10a)
Active Learning- students’ efforts to actively construct
knowledge (Questions 1b, 1m, 1n, 1p, 1x, 1aa)
Staff Student interaction - the level and nature of
students’ contact and interaction with teaching staff
(Questions 1w, 1y, 1u, 1v, 1z, 6e)
Enriching Educational Experience- students’
participation in broadening educational activities (Questions
1ab, 1ac, 6a, 6b, 6c, 6d, 6f, 6g, 6h, 8e, 10c)
Supportive Learning Environment - students’ feelings
of support within the university
community (Questions 7a, 7c, 7e, 7g, 10b, 10d, 10e)
Work Integrated Learning- integration of employmentfocused work experiences with
study (Questions 1j, 5d, 5f, 6b, 11b)
.

And other things…

Higher Order Thinking - level of participation in higher-order forms of
thinking. (Questions 2b, 2c, 2d, 2e)
General Learning Outcomes - development of general competencies
(Questions 11 a – 11h)
General Development Outcomes- level of development of general forms of
individual and social growth. (Questions 11i – 11o)
Career Readiness - students’ engagement with their future career, and their
involvement in activities such as writing resumes and career planning. (5i – 5m)
Departure Intention - the intentions of non-graduating students to leave their
institution before completing their qualification. (Question 12)
Overall Satisfaction - a student’s overall satisfaction with their education
experience at their institution (Questions 14a, 14b, 15)
The HEA UK Pilot
The HEA UK pilot
14 survey questions from NSSE were used by nine institutions in Spring/Summer
2013, and over 8500 student responses were collected and analysed.

University of Bath
Canterbury Christ Church
University
Cardiff Metropolitan University
King's College London

Kingston University
University of Oxford
University of South Wales
University of Warwick
York St John University

Objectives of the project
1. To evaluate the validity and reliability of adapted elements of the NSSE in the UK.
2. To improve our understanding of the levels of student engagement in the UK.
3. To support the participating institutions in using engagement data for
enhancement.
4. To raise awareness of the use of engagement surveys for enhancement

Response rate: 17% (13%-40%) (includes postgrads 10%)
Scales of Engagement
Critical thinking
Four questions asked students about the emphasis their coursework has
placed on a range of mental activities: analysing, synthesising, evaluating and
applying information.
Course challenge
Three questions focused on how hard students have worked and how
challenged they have been.
Collaborative learning
Three questions asked students how often they have interacted with other
students in a range of ways.
Academic integration
Five questions (one of which also appears in the Collaborative Learning
group) explored students‟ interaction with academic staff, participation in
class and discussions with others outside class.
Selected findings

There were marked differences between disciplines, likely to be due to
different pedagogies and expectations. E.g. application versus synthesis and
evaluation
UK students who participated in the UK pilot discussed their career plans with
staff much less often than students in the US
UK students may have talked to academic staff about ideas from the course
more often than students in Australasia.
The UK pilot had the lowest proportion of students stating that they had never
discussed their academic performance with staff.
The Leicester Pilot Survey
The Leicester Pilot
• Departments of Computer
Science, Physics, English, Sociology, Mathematics and School of
Biological Sciences
• Slightly modified version of the AUSSE student engagement
survey
“time and effort students devote to educationally purposeful
activities and on students' perceptions of the quality of other
aspects of their university experience”
(widely used in Australasia, similar to measure student
engagement, similar to NSSE)
• Deployed electronically for 6 weeks at the start of the summer
term 2013
• 248 replies were obtained from approximately 3000
questionnaires.
Scales of Engagement
UoL and AUSSE compared
Departmental Results
Leicester on-line
Work Ethic
Support
Overall experience
Some comments
In my course, the teaching staff are the most depressing, unenthusiastic and
morale sucking people I have ever met.
Actually try? As it stands there are possibly two/three lecturers who even
come close. It is extremely obvious that they are academics who give little to
no thought to lecturing.
Some of the teaching staff can be a bit rude and unhelpful to students
Get rid of some of the awful lecturers
Excellent levels of teaching and really great teachers.
The lecturers in our department are very charismatic and interact with
students outside of lectures, encouraging a passion for the subject
My department are supportive, friendly and have made my time at university
amazing
High expectations and lots of support. They aim for high standards and
excellence with each student.
How help is available if needed but they also leave us to work if that's how we
want to do it. They don't let you suffer in silence.
Where Next

?

Student Engagment Survey pilot University of Leicester

  • 1.
  • 2.
    Student Engagement Survey 1.BACKGROUND – AUSSE, HEA 2. OUR SURVEY: ADMINISTRATION 3. OUR SURVEY: OVERALL RESULTS AND COMPARISON WITH AUSSE 4. OUR SURVEY: SELECTED RESULTS FROM DEPARTMENTS 5. WHERE NEXT?
  • 3.
    Why student engagement? Studentengagement v/s satisfaction based on e.g. Arthur W. Chickering and Zelda F. Gamson "Seven Principles for Good Practice in Undergraduate Education“ STUDENT -- FACULTY CONTACT COOPERATION AMONG STUDENTS ACTIVE LEARNING PROMPT FEEDBACK EMPHASIZE TIME ON TASK COMMUNICATES HIGH EXPECTATIONS RESPECTS DIVERSE TALENTS AND WAYS OF LEARNING Student engagement -> learning gains
  • 4.
    The scales ofengagement Academic Challenge - the extent to which expectations and assessments challenge students to learn (Questions 1s, 2b, 2c, 2d, 3a, 3b, 8b, 10a) Active Learning- students’ efforts to actively construct knowledge (Questions 1b, 1m, 1n, 1p, 1x, 1aa) Staff Student interaction - the level and nature of students’ contact and interaction with teaching staff (Questions 1w, 1y, 1u, 1v, 1z, 6e) Enriching Educational Experience- students’ participation in broadening educational activities (Questions 1ab, 1ac, 6a, 6b, 6c, 6d, 6f, 6g, 6h, 8e, 10c) Supportive Learning Environment - students’ feelings of support within the university community (Questions 7a, 7c, 7e, 7g, 10b, 10d, 10e) Work Integrated Learning- integration of employmentfocused work experiences with study (Questions 1j, 5d, 5f, 6b, 11b)
  • 5.
    . And other things… HigherOrder Thinking - level of participation in higher-order forms of thinking. (Questions 2b, 2c, 2d, 2e) General Learning Outcomes - development of general competencies (Questions 11 a – 11h) General Development Outcomes- level of development of general forms of individual and social growth. (Questions 11i – 11o) Career Readiness - students’ engagement with their future career, and their involvement in activities such as writing resumes and career planning. (5i – 5m) Departure Intention - the intentions of non-graduating students to leave their institution before completing their qualification. (Question 12) Overall Satisfaction - a student’s overall satisfaction with their education experience at their institution (Questions 14a, 14b, 15)
  • 6.
  • 7.
    The HEA UKpilot 14 survey questions from NSSE were used by nine institutions in Spring/Summer 2013, and over 8500 student responses were collected and analysed. University of Bath Canterbury Christ Church University Cardiff Metropolitan University King's College London Kingston University University of Oxford University of South Wales University of Warwick York St John University Objectives of the project 1. To evaluate the validity and reliability of adapted elements of the NSSE in the UK. 2. To improve our understanding of the levels of student engagement in the UK. 3. To support the participating institutions in using engagement data for enhancement. 4. To raise awareness of the use of engagement surveys for enhancement Response rate: 17% (13%-40%) (includes postgrads 10%)
  • 8.
    Scales of Engagement Criticalthinking Four questions asked students about the emphasis their coursework has placed on a range of mental activities: analysing, synthesising, evaluating and applying information. Course challenge Three questions focused on how hard students have worked and how challenged they have been. Collaborative learning Three questions asked students how often they have interacted with other students in a range of ways. Academic integration Five questions (one of which also appears in the Collaborative Learning group) explored students‟ interaction with academic staff, participation in class and discussions with others outside class.
  • 9.
    Selected findings There weremarked differences between disciplines, likely to be due to different pedagogies and expectations. E.g. application versus synthesis and evaluation UK students who participated in the UK pilot discussed their career plans with staff much less often than students in the US UK students may have talked to academic staff about ideas from the course more often than students in Australasia. The UK pilot had the lowest proportion of students stating that they had never discussed their academic performance with staff.
  • 10.
  • 11.
    The Leicester Pilot •Departments of Computer Science, Physics, English, Sociology, Mathematics and School of Biological Sciences • Slightly modified version of the AUSSE student engagement survey “time and effort students devote to educationally purposeful activities and on students' perceptions of the quality of other aspects of their university experience” (widely used in Australasia, similar to measure student engagement, similar to NSSE) • Deployed electronically for 6 weeks at the start of the summer term 2013 • 248 replies were obtained from approximately 3000 questionnaires.
  • 12.
  • 13.
    UoL and AUSSEcompared
  • 14.
  • 15.
  • 16.
  • 17.
  • 18.
  • 19.
    Some comments In mycourse, the teaching staff are the most depressing, unenthusiastic and morale sucking people I have ever met. Actually try? As it stands there are possibly two/three lecturers who even come close. It is extremely obvious that they are academics who give little to no thought to lecturing. Some of the teaching staff can be a bit rude and unhelpful to students Get rid of some of the awful lecturers Excellent levels of teaching and really great teachers. The lecturers in our department are very charismatic and interact with students outside of lectures, encouraging a passion for the subject My department are supportive, friendly and have made my time at university amazing High expectations and lots of support. They aim for high standards and excellence with each student. How help is available if needed but they also leave us to work if that's how we want to do it. They don't let you suffer in silence.
  • 20.