DESIGN-BASED RESEARCH
Research Unit at University of Trento, PRIN 09

Nan Yang
nan.yang@unitn.it
Doctoral School of Psychological Sciences and Education
University of Trento
Outline
What is design-based research (DBR)?
When do we use DBR
How do we use DBR?
Why do we use DBR
Discussion
DBR in PRIN 09
!
!

10/23/13

Research Unit at University of Trento, PRIN 09, Nan Yang

!2
What is DBR
Definition
DBR is also known as “design experiments” (Brown, 1992), “design
research”(Cobb, 2001), “development research”(van den Akker, 1999). It is
research on how theory and innovative learning environments converge to support
human learning and performance.

Elements (Edelson, 2002)
Research driven: yield useful results; informed by prior research and guided by
research goals
Systematic documentation: to support retrospective analysis
Formative evaluation: integrated process of design, evaluation and revision
Generalization: Expend focus from current design context to others
10/23/13

Research Unit at University of Trento, PRIN 09, Nan Yang

!3
What is DBR (cont.)
Crosscutting Features (Cobb, etc, 2003)
The purpose is to develop a class of theories about both the process of learning and the
means that are designed to support that learning
Highly interventionist nature of the methodology: to investigate the possibilities for
educational improvement by bring about new forms of learning in order to study them
Two faces: prospective and reflective. On the prospective side, foster the emergence of
other potential pathways for learning and development; on the reflective side, DBR is
conjecture-driven tests
Iterative design: the result is an iterative design process featuring cycles of invention
and revision
Pragmatic roots: “the theory must do real work”
10/23/13

Research Unit at University of Trento, PRIN 09, Nan Yang

!4
When do we use DBR
The need to address theoretical questions about the nature of
learning in context
The need for approaches to the study of learning phenomena in
the real world rather than the laboratory
The need to go beyond narrows measures of learning
The need to derive research findings from formative evaluation
(Collins, etc, 2004)

10/23/13

Research Unit at University of Trento, PRIN 09, Nan Yang

!5
How do we use DBR
Settings for conducting DBR (Cobb, etc, 2003)
One on one(teacher-experimenter and student): conducts a series of teaching session
with a small number of students
classroom: collaborate with a teacher to assume responsibility for instruction
preservice teacher development: help organize and study the education of
prospective teachers
In-service teacher development: collaborate with teachers to support the
development of a professional community
school and school district reconstructing: collaborate with teachers, school
administrators, and other stakeholders to support organizational change (PRIN 09’s
position).
10/23/13

Research Unit at University of Trento, PRIN 09, Nan Yang

!6
How do we use DBR(cont.)
Multiple ways of analysis (Collins, etc, 2004)
Cognitive level: researchers ask learners to expose their thinking
Interpersonal level: researchers use ethnographic techniques to observe the
interactions between students and teacher or among students
Group or class level: address issue of participant structure, group identity and
authority relationship
Resource level: if resources are easy to understand and use, the access, how they are
integrated into the activities
Institutional or school level: communications with outside parties and support from
the entire institution
10/23/13

Research Unit at University of Trento, PRIN 09, Nan Yang

!7
How do we use DBR(cont.)
Preparing for DBR (e.g. classroom design experiment)
Clarify the theoretical intent of the experiment
Specify the significant disciplinary ideas and forms of reasoning that constitute the
prospective goals or endpoints for student learning
Specify the assumptions about the intellectual and social starting points for the
envisioned forms of learning
formulate a design that embodies testable conjectures about both significant shifts in
student reasoning and the specific means of supporting those shifts
Generate multiple forms of data to adequately document the learning ecology (Cobb,
etc, 2003)

10/23/13

Research Unit at University of Trento, PRIN 09, Nan Yang

!8
How do we use DBR(cont.)
Conducting a DBR
A clear view of the anticipated learning pathways and the potential means of support
must be maintained
The extended nature of most DBR calls for the cultivation of ongoing relationships
with practitioners
To develop a deep understanding of the ecology of learning
Regular debriefing sessions are the forum in which past events are interpreted and
prospective events are planned for
Conduct retrospective analysis is a way to be explicit about the criteria and types of
evidence used when making particular types of inferences, so that other researchers
can understand, monitor, and critique the analysis (Cobb, etc, 2003)
10/23/13

Research Unit at University of Trento, PRIN 09, Nan Yang

!9
Why do we use DBR (Cobb, etc, 2003)
It provides a productive perspective for theory development
The practical demands of design require that a theory be fully specified
The process of design reveals inconsistencies more effectively than analytical
processes
The goal-directed nature of design provides a natural focus for theory development

The usefulness of its results
If the ultimate goal of educational research is the improvement of the education
system, then results that speak directly to the design of activities, materials and
systems will be the most useful results.

It directly involves researchers in the improvement of education
Researchers has freedom to explore innovative design and create true innovation
10/23/13

Research Unit at University of Trento, PRIN 09, Nan Yang

!10
Discussion
Compare DBR with empirical research (Edelson, 2002)
the objective: DBR is to generate new theories; empirical research is theory-testing
tradition
their source of strength: explanatory power and their grounding in specific
experiences (DBR); statistical sampling (empirical research)

My viewpoint on DBR: case study+action research+formative
evaluation
DBR offers opportunities to learn unique lessons (case study)
DBR yields practical lessons that can directly applied (action research)
DBR facilitates direct improvement of education (formative evaluation)
10/23/13

Research Unit at University of Trento, PRIN 09, Nan Yang

!11
DBR in PRIN 09
PRIN 09 is a national research on innovative evaluation in the
educational setting
Research Unit at University of Trento is focus on the evaluation on the eLearning
quality in the higher education
Why we don’t build a new evaluation process instead of redesigning the eLearning
course for innovative evaluation? Firstly, the objective of innovative evaluation is to
have strong impact on educational practice while course redesign have a direct
impact on the practice. Secondly, DBR we adopt in our research is also a formative
evaluation.

10/23/13

Research Unit at University of Trento, PRIN 09, Nan Yang

!12
Important References
Brown, A. L. (1992). Design experiments: Theoretical and methodological challenges in creating complex
interventions in classroom settings. The journal of the learning sciences, 2(2), 141-178.
Cobb, P., Confrey, J., Lehrer, R., & Schauble, L. (2003). Design experiments in educational research.
Educational researcher, 32(1), 9-13.
Collins, A., Joseph, D., & Bielaczyc, K. (2004). Design research: Theoretical and methodological issues. The
Journal of the learning sciences, 13(1), 15-42.
Cobb, P. (2001). Supporting the improvement of learning and teaching in social and institutional context. In
Cognition and instruction: Twenty-five years of progress (pp. 455-478). Lawrence Erlbaum Associates.
Edelson, D. C. (2002). "Design research: What we learn when we engage in design." The Journal of the
Learning Sciences 11(1): 105-121.
Van den Akker, J. (1999). Principles and methods of development research.Design methodology and
developmental research in education and training, 1-14.

10/23/13

Research Unit at University of Trento, PRIN 09, Nan Yang

!13
Thank you

10/23/13

Research Unit at University of Trento, PRIN 09, Nan Yang

!14

More Related Content

PDF
Design based research
PPT
Design based research
PDF
DBR6juin2008 Final
PPTX
Information Systems design science writing articles
PDF
Barab design based research
PPT
The overlaps between Action Research and Design Research
PPT
Practice based research
Design based research
Design based research
DBR6juin2008 Final
Information Systems design science writing articles
Barab design based research
The overlaps between Action Research and Design Research
Practice based research

What's hot (18)

PPTX
Intuitive Interaction in Children
PDF
The Nature of Design Practice and Implications for Interaction Design Researc...
PDF
Quali lecture 1: Understanding the research process
PPT
EUROCALL Teacher Education SIG Workshop 2010 Presentation Nathalie Gettliffe
PPTX
Design Science in Information Systems
PDF
4 pennington presentation
PPTX
Practice-based research methods: Challenges and potentials
PDF
DBR (Design-Based Research) in mobile learning-Mlearn2013 Doha A_Palalas C_G...
PPTX
DBR in the m-learning context (A. Palalas), March 2013
KEY
Conole ld
PDF
Practice Research
PPT
33 using dual mapping learning approach
PPTX
Design thinking for science communication
PDF
Hcic muller guha davis geyer shami 2015 06-29
PDF
Design Science Framework
PDF
Research trough design and transdisciplinarity
Intuitive Interaction in Children
The Nature of Design Practice and Implications for Interaction Design Researc...
Quali lecture 1: Understanding the research process
EUROCALL Teacher Education SIG Workshop 2010 Presentation Nathalie Gettliffe
Design Science in Information Systems
4 pennington presentation
Practice-based research methods: Challenges and potentials
DBR (Design-Based Research) in mobile learning-Mlearn2013 Doha A_Palalas C_G...
DBR in the m-learning context (A. Palalas), March 2013
Conole ld
Practice Research
33 using dual mapping learning approach
Design thinking for science communication
Hcic muller guha davis geyer shami 2015 06-29
Design Science Framework
Research trough design and transdisciplinarity
Ad

Viewers also liked (7)

PPTX
Understand Case Study
PPTX
Understand Qualitative Research
PDF
Teachers' Voice on eLearning as an approach to quality in higher education
PPTX
Quality, Educational Quality, eLearning Quality
PDF
Quality Qualitative Research
PPTX
Understand Participatory Action Research
PPTX
New Technologies for the 21st Century Secretary
Understand Case Study
Understand Qualitative Research
Teachers' Voice on eLearning as an approach to quality in higher education
Quality, Educational Quality, eLearning Quality
Quality Qualitative Research
Understand Participatory Action Research
New Technologies for the 21st Century Secretary
Ad

Similar to Understand Designed Based Research (20)

PDF
DBR_Presentation_SPKarunanayaka_08.05.2024.pdf
PPTX
Epistemological Foundations of Design-Based Research
PPTX
Design-based research: an introduction
PPTX
Designing for TEL - Design-based research.pptx
PPTX
Northwestern DBIR brown bag
PPTX
Development and use of mobile technologies that foster students' evaluative j...
PPT
Trends and methods of educational research in the uk
PPTX
Design-Based Research: A method for achieving impact in the real world
PDF
A Critical Comparison Of Design-Based Research And Action Research
PPT
Design-based Research
PDF
Strong TEL concepts (EC-TEL 2017)
PPTX
References and Sources on Educational Design Research
PPT
Designing learning
PPT
Research Panel Wcet Oct 2009
PPTX
Challenge Based Learning in a Communication Degree: an Innovative Experience ...
PPT
Design- Based Research: New Research Paradigm
PDF
32 ried creative coding and intercultural projects
PPT
CODE_Assessment for Flexible Learning
PPTX
Making Connections in Distance Education: Research-based Reflections on Hybri...
PPT
Research for Effective Online Learning
DBR_Presentation_SPKarunanayaka_08.05.2024.pdf
Epistemological Foundations of Design-Based Research
Design-based research: an introduction
Designing for TEL - Design-based research.pptx
Northwestern DBIR brown bag
Development and use of mobile technologies that foster students' evaluative j...
Trends and methods of educational research in the uk
Design-Based Research: A method for achieving impact in the real world
A Critical Comparison Of Design-Based Research And Action Research
Design-based Research
Strong TEL concepts (EC-TEL 2017)
References and Sources on Educational Design Research
Designing learning
Research Panel Wcet Oct 2009
Challenge Based Learning in a Communication Degree: an Innovative Experience ...
Design- Based Research: New Research Paradigm
32 ried creative coding and intercultural projects
CODE_Assessment for Flexible Learning
Making Connections in Distance Education: Research-based Reflections on Hybri...
Research for Effective Online Learning

Recently uploaded (20)

PPTX
Thinking Routines and Learning Engagements.pptx
PDF
Laparoscopic Imaging Systems at World Laparoscopy Hospital
PDF
Kalaari-SaaS-Founder-Playbook-2024-Edition-.pdf
PDF
Disorder of Endocrine system (1).pdfyyhyyyy
PPTX
Diploma pharmaceutics notes..helps diploma students
PPTX
Copy of ARAL Program Primer_071725(1).pptx
PPTX
4. Diagnosis and treatment planning in RPD.pptx
PDF
POM_Unit1_Notes.pdf Introduction to Management #mba #bba #bcom #bballb #class...
PDF
Review of Related Literature & Studies.pdf
PDF
LATAM’s Top EdTech Innovators Transforming Learning in 2025.pdf
PDF
Horaris_Grups_25-26_Definitiu_15_07_25.pdf
PPTX
2025 High Blood Pressure Guideline Slide Set.pptx
DOCX
THEORY AND PRACTICE ASSIGNMENT SEMESTER MAY 2025.docx
PPTX
Cite It Right: A Compact Illustration of APA 7th Edition.pptx
PDF
African Communication Research: A review
PPTX
Approach to a child with acute kidney injury
PDF
WHAT NURSES SAY_ COMMUNICATION BEHAVIORS ASSOCIATED WITH THE COMP.pdf
PPTX
IT infrastructure and emerging technologies
PDF
FAMILY PLANNING (preventative and social medicine pdf)
PPTX
MMW-CHAPTER-1-final.pptx major Elementary Education
Thinking Routines and Learning Engagements.pptx
Laparoscopic Imaging Systems at World Laparoscopy Hospital
Kalaari-SaaS-Founder-Playbook-2024-Edition-.pdf
Disorder of Endocrine system (1).pdfyyhyyyy
Diploma pharmaceutics notes..helps diploma students
Copy of ARAL Program Primer_071725(1).pptx
4. Diagnosis and treatment planning in RPD.pptx
POM_Unit1_Notes.pdf Introduction to Management #mba #bba #bcom #bballb #class...
Review of Related Literature & Studies.pdf
LATAM’s Top EdTech Innovators Transforming Learning in 2025.pdf
Horaris_Grups_25-26_Definitiu_15_07_25.pdf
2025 High Blood Pressure Guideline Slide Set.pptx
THEORY AND PRACTICE ASSIGNMENT SEMESTER MAY 2025.docx
Cite It Right: A Compact Illustration of APA 7th Edition.pptx
African Communication Research: A review
Approach to a child with acute kidney injury
WHAT NURSES SAY_ COMMUNICATION BEHAVIORS ASSOCIATED WITH THE COMP.pdf
IT infrastructure and emerging technologies
FAMILY PLANNING (preventative and social medicine pdf)
MMW-CHAPTER-1-final.pptx major Elementary Education

Understand Designed Based Research

  • 1. DESIGN-BASED RESEARCH Research Unit at University of Trento, PRIN 09 Nan Yang [email protected] Doctoral School of Psychological Sciences and Education University of Trento
  • 2. Outline What is design-based research (DBR)? When do we use DBR How do we use DBR? Why do we use DBR Discussion DBR in PRIN 09 ! ! 10/23/13 Research Unit at University of Trento, PRIN 09, Nan Yang !2
  • 3. What is DBR Definition DBR is also known as “design experiments” (Brown, 1992), “design research”(Cobb, 2001), “development research”(van den Akker, 1999). It is research on how theory and innovative learning environments converge to support human learning and performance. Elements (Edelson, 2002) Research driven: yield useful results; informed by prior research and guided by research goals Systematic documentation: to support retrospective analysis Formative evaluation: integrated process of design, evaluation and revision Generalization: Expend focus from current design context to others 10/23/13 Research Unit at University of Trento, PRIN 09, Nan Yang !3
  • 4. What is DBR (cont.) Crosscutting Features (Cobb, etc, 2003) The purpose is to develop a class of theories about both the process of learning and the means that are designed to support that learning Highly interventionist nature of the methodology: to investigate the possibilities for educational improvement by bring about new forms of learning in order to study them Two faces: prospective and reflective. On the prospective side, foster the emergence of other potential pathways for learning and development; on the reflective side, DBR is conjecture-driven tests Iterative design: the result is an iterative design process featuring cycles of invention and revision Pragmatic roots: “the theory must do real work” 10/23/13 Research Unit at University of Trento, PRIN 09, Nan Yang !4
  • 5. When do we use DBR The need to address theoretical questions about the nature of learning in context The need for approaches to the study of learning phenomena in the real world rather than the laboratory The need to go beyond narrows measures of learning The need to derive research findings from formative evaluation (Collins, etc, 2004) 10/23/13 Research Unit at University of Trento, PRIN 09, Nan Yang !5
  • 6. How do we use DBR Settings for conducting DBR (Cobb, etc, 2003) One on one(teacher-experimenter and student): conducts a series of teaching session with a small number of students classroom: collaborate with a teacher to assume responsibility for instruction preservice teacher development: help organize and study the education of prospective teachers In-service teacher development: collaborate with teachers to support the development of a professional community school and school district reconstructing: collaborate with teachers, school administrators, and other stakeholders to support organizational change (PRIN 09’s position). 10/23/13 Research Unit at University of Trento, PRIN 09, Nan Yang !6
  • 7. How do we use DBR(cont.) Multiple ways of analysis (Collins, etc, 2004) Cognitive level: researchers ask learners to expose their thinking Interpersonal level: researchers use ethnographic techniques to observe the interactions between students and teacher or among students Group or class level: address issue of participant structure, group identity and authority relationship Resource level: if resources are easy to understand and use, the access, how they are integrated into the activities Institutional or school level: communications with outside parties and support from the entire institution 10/23/13 Research Unit at University of Trento, PRIN 09, Nan Yang !7
  • 8. How do we use DBR(cont.) Preparing for DBR (e.g. classroom design experiment) Clarify the theoretical intent of the experiment Specify the significant disciplinary ideas and forms of reasoning that constitute the prospective goals or endpoints for student learning Specify the assumptions about the intellectual and social starting points for the envisioned forms of learning formulate a design that embodies testable conjectures about both significant shifts in student reasoning and the specific means of supporting those shifts Generate multiple forms of data to adequately document the learning ecology (Cobb, etc, 2003) 10/23/13 Research Unit at University of Trento, PRIN 09, Nan Yang !8
  • 9. How do we use DBR(cont.) Conducting a DBR A clear view of the anticipated learning pathways and the potential means of support must be maintained The extended nature of most DBR calls for the cultivation of ongoing relationships with practitioners To develop a deep understanding of the ecology of learning Regular debriefing sessions are the forum in which past events are interpreted and prospective events are planned for Conduct retrospective analysis is a way to be explicit about the criteria and types of evidence used when making particular types of inferences, so that other researchers can understand, monitor, and critique the analysis (Cobb, etc, 2003) 10/23/13 Research Unit at University of Trento, PRIN 09, Nan Yang !9
  • 10. Why do we use DBR (Cobb, etc, 2003) It provides a productive perspective for theory development The practical demands of design require that a theory be fully specified The process of design reveals inconsistencies more effectively than analytical processes The goal-directed nature of design provides a natural focus for theory development The usefulness of its results If the ultimate goal of educational research is the improvement of the education system, then results that speak directly to the design of activities, materials and systems will be the most useful results. It directly involves researchers in the improvement of education Researchers has freedom to explore innovative design and create true innovation 10/23/13 Research Unit at University of Trento, PRIN 09, Nan Yang !10
  • 11. Discussion Compare DBR with empirical research (Edelson, 2002) the objective: DBR is to generate new theories; empirical research is theory-testing tradition their source of strength: explanatory power and their grounding in specific experiences (DBR); statistical sampling (empirical research) My viewpoint on DBR: case study+action research+formative evaluation DBR offers opportunities to learn unique lessons (case study) DBR yields practical lessons that can directly applied (action research) DBR facilitates direct improvement of education (formative evaluation) 10/23/13 Research Unit at University of Trento, PRIN 09, Nan Yang !11
  • 12. DBR in PRIN 09 PRIN 09 is a national research on innovative evaluation in the educational setting Research Unit at University of Trento is focus on the evaluation on the eLearning quality in the higher education Why we don’t build a new evaluation process instead of redesigning the eLearning course for innovative evaluation? Firstly, the objective of innovative evaluation is to have strong impact on educational practice while course redesign have a direct impact on the practice. Secondly, DBR we adopt in our research is also a formative evaluation. 10/23/13 Research Unit at University of Trento, PRIN 09, Nan Yang !12
  • 13. Important References Brown, A. L. (1992). Design experiments: Theoretical and methodological challenges in creating complex interventions in classroom settings. The journal of the learning sciences, 2(2), 141-178. Cobb, P., Confrey, J., Lehrer, R., & Schauble, L. (2003). Design experiments in educational research. Educational researcher, 32(1), 9-13. Collins, A., Joseph, D., & Bielaczyc, K. (2004). Design research: Theoretical and methodological issues. The Journal of the learning sciences, 13(1), 15-42. Cobb, P. (2001). Supporting the improvement of learning and teaching in social and institutional context. In Cognition and instruction: Twenty-five years of progress (pp. 455-478). Lawrence Erlbaum Associates. Edelson, D. C. (2002). "Design research: What we learn when we engage in design." The Journal of the Learning Sciences 11(1): 105-121. Van den Akker, J. (1999). Principles and methods of development research.Design methodology and developmental research in education and training, 1-14. 10/23/13 Research Unit at University of Trento, PRIN 09, Nan Yang !13
  • 14. Thank you 10/23/13 Research Unit at University of Trento, PRIN 09, Nan Yang !14

Editor's Notes