Seeing your education system in the mirror of OECD systemsCanberra, 13-14 May 2010
Is the sky the limit?1.There is nowhere to hideThe yardstick for educational success is no longer improvement by national standards but the best performing systems internationally2.Where we are – and where we can be Where Australia and other countries stand What the best performing countries show can be achieved3.How we can get thereSome policy levers that emerge from international comparisons
Domain 1Individual learnerLevelALevelBInstructional settingsLevelCSchools, other institutionsCountry or systemLevelDDimensions for international benchmarkingDomain 3Domain 2Antecedentscontextualise or constrain ed policyPolicy Leversshape educational outcomesOutputs and Outcomesimpact of learningQuality and distribution of knowledge & skillsIndivid attitudes, engagement and behaviourSocio-economic background of learnersStudent learning, teacher working conditionsQuality of instructional deliveryTeaching, learning practices and classroom climateThe learning environment at schoolCommunity and school characteristicsOutput and performance of institutionsNational educ, social and economic contextSocial & economic outcomes of educationStructures, resource alloc and policies
There is nowhere to hideThe yardstick for success is no longer improvement by national standards but the best practice internationally
A world of change – highereducationExpenditure per student at tertiary level (USD)Cost per studentGraduate supplyTertiary-type A graduation rate
A world of change – highereducationExpenditure per student at tertiary level (USD)United StatesCost per studentFinlandJapanGraduate supplyTertiary-type A graduation rate
A world of change – highereducationExpenditure per student at tertiary level (USD)AustraliaFinlandUnited KingdomTertiary-type A graduation rate
A world of change – highereducationExpenditure per student at tertiary level (USD)Tertiary-type A graduation rate
A world of change – highereducationExpenditure per student at tertiary level (USD)Tertiary-type A graduation rate
A world of change – highereducationExpenditure per student at tertiary level (USD)Tertiary-type A graduation rate
A world of change – highereducationExpenditure per student at tertiary level (USD)Tertiary-type A graduation rate
A world of change – highereducationExpenditure per student at tertiary level (USD)Tertiary-type A graduation rate
A world of change – highereducationWhat about international students?Expenditure per student at tertiary level (USD)United StatesAustraliaAAUnited KingdomFinlandATertiary-type A graduation rate
Moving targetsFuture supply of college graduates
Components of the private net present value for a male with higher education27K$56K$170K$105K$35K$26K$367K$Net present value in USD equivalent
Public cost and benefits for a male obtaining post-secondary educationPublic costsPublic benefitsNet present value, USD equivalent(numbers in orange shownegative values)USD equivalent
How the demand for skills has changedEconomy-wide measures of routine and non-routine task input (US)Mean task input as percentiles of  the 1960 task distributionThe dilemma of schools:The skills that are easiest to teach and test are also the ones that are easiest to digitise, automate and outsource (Levy and Murnane)
OECD’s PISA assessment of the knowledge and skills of 15-year-oldsCoverage of world economy83%77%81%85%86%87%
Strengths and weaknesses in mathThe real worldThe mathematical WorldMaking the problem amenable to mathematical treatmentA mathematical model A model of realityUnderstanding, structuring and simplifying the situationUsing relevant mathematical content to solve the problemA real situationValidating the resultsMathematical resultsReal resultsInterpreting the mathematical results
High science performanceAverage performanceof 15-year-olds in science – extrapolate and apply… 18 countries perform below this lineLow science performance
Modelling the impactProgrammes to improve cognitive skills through schools take time to implement and to have their impact on students.Assume that it will take 20 years to implement reformThe impact of improved skills will not be realised until the students with greater skills move into the labour forceAssume that improved PISA performance will result in improved skill-based of 2.5% of the labour-force each yearThe economy will respond over time as new technologies are developed and implemented, making use of the new higher skillsEstimate the total gains over the lifetime of the generation born this year .
Relationship between test performance and economic outcomesAnnual improved GDP from raising performance by 25 PISA pointsPercent addition to GDP
Increase average performance by 25 PISA points (Total 115 trillion $)bn$
Catching up with Finland (total 260 trillion $)bn$
Catching up with Finland(in percent of GDP)% currrent GDP
Increased likelihood of postsec. particip. at age 19/21 associated with PISA reading proficiency at age 15 (Canada)after accounting for school engagement, gender, mother tongue, place of residence, parental, education and family income (reference group PISA Level 1)Odds ratioCollege entrySchool marks at age 15PISA performance at age 15
Interest scienceIndicate curiosity in science and science-related issues and endeavoursDemonstrate willingness to acquire additional scientific knowledge and skills, using variety of resources and methodsDemonstrate willingness to seek information and have an interest in science, including consideration of science-related careers Support for scienceAcknowledge the importance of considering different scientific perspectives and argumentsSupport the use of factual information and rational explanationLogical and careful processes in drawing conclusions Knowledge of sciencePhysical systems (structure of matter, properties of matter, chemical changes of matter, motions and forces, energy and its transformations, energy and matter)Living systems (cells, humans, populations, ecosystems, biosphere)Earth and space (structures of the earth system, energy in the earth system, change in the earth system, earth’s history, space)Technology systems (Concepts and principles, science and technology)Knowledge about scienceScientific enquiry (purpose, experiments, data, measurement, characteristics of results)Scientific explanations (types, rules, outcomes)IdentifyingRecognising issues that can be investigated scientificallyIdentifying keywords in a scientific investigationRecognising the key features of a scientific investigationExplainingApplying knowledge of science in a situationDescribing or interpreting phenomena scientifically or predicting changeUsing evidenceInterpreting scientific evidence and drawing conclusionsIdentifying the assumptions, evidence and reasoning behind conclusionsContext- PersonalSocial/public
GlobalCompetenciesIdentify scientific issues
Explain phenomena scientifically
Use scientific evidenceKnowledgeKnowledge of science
Knowledge about scienceAttitudes-Interest in science-Support for scientific enquiry-Responsibility
Strengths and weaknesses of countries in science relative to their overall performanceFranceScience competenciesScience knowledgeOECD (2007), PISA 2006 – Science Competencies for Tomorrow’s World, Figure 2.13
Strengths and weaknesses of countries in science relative to their overall performanceCzech RepublicScientific competenciesScientific knowledgeOECD (2007), PISA 2006 – Science Competencies for Tomorrow’s World, Figure 2.13
Strengths and weaknesses of countries in science relative to their overall performanceAustraliaScientific competenciesScientific knowledgeOECD (2007), PISA 2006 – Science Competencies for Tomorrow’s World, Figure 2.13
High science performanceAverage performanceof 15-year-olds in science – extrapolate and applyHigh average performanceLarge socio-economic disparitiesHigh average performanceHigh social equityStrong socio-economic impact on student performanceSocially equitable distribution of learning opportunitiesLow average performanceLarge socio-economic disparitiesLow average performanceHigh social equityLow science performance
High science performanceDurchschnittliche Schülerleistungen im Bereich MathematikHigh average performanceLarge socio-economic disparitiesHigh average performanceHigh social equityStrong socio-economic impact on student performanceSocially equitable distribution of learning opportunitiesLow average performanceLarge socio-economic disparitiesLow average performanceHigh social equityLow science performance
Student performancePISA Index of socio-economic backgroundAdvantageDisadvantageSchool performance and socio-economic background GermanyStudent performance and students’ socio-economic background withinschoolsSchool performance and schools’ socio-economic backgroundSchools proportional to size
Student performancePISA Index of socio-economic backgroundAdvantageDisadvantageSchool performance and socio-economic background GermanyStudent performance and students’ socio-economic background withinschoolsSchool performance and schools’ socio-economic backgroundSchools proportional to sizeUniversal policiesIncreasing educational performance of all children through reforms applied equally across the school system, e.g.
Altering content or pace of curriculum
Improving instructional techniques
Changing the learning environment in schools and classrooms
Standards and accountability

Australia's education system in the mirror of other OECD systems

  • 1.
    Seeing your educationsystem in the mirror of OECD systemsCanberra, 13-14 May 2010
  • 2.
    Is the skythe limit?1.There is nowhere to hideThe yardstick for educational success is no longer improvement by national standards but the best performing systems internationally2.Where we are – and where we can be Where Australia and other countries stand What the best performing countries show can be achieved3.How we can get thereSome policy levers that emerge from international comparisons
  • 3.
    Domain 1Individual learnerLevelALevelBInstructionalsettingsLevelCSchools, other institutionsCountry or systemLevelDDimensions for international benchmarkingDomain 3Domain 2Antecedentscontextualise or constrain ed policyPolicy Leversshape educational outcomesOutputs and Outcomesimpact of learningQuality and distribution of knowledge & skillsIndivid attitudes, engagement and behaviourSocio-economic background of learnersStudent learning, teacher working conditionsQuality of instructional deliveryTeaching, learning practices and classroom climateThe learning environment at schoolCommunity and school characteristicsOutput and performance of institutionsNational educ, social and economic contextSocial & economic outcomes of educationStructures, resource alloc and policies
  • 4.
    There is nowhereto hideThe yardstick for success is no longer improvement by national standards but the best practice internationally
  • 5.
    A world ofchange – highereducationExpenditure per student at tertiary level (USD)Cost per studentGraduate supplyTertiary-type A graduation rate
  • 6.
    A world ofchange – highereducationExpenditure per student at tertiary level (USD)United StatesCost per studentFinlandJapanGraduate supplyTertiary-type A graduation rate
  • 7.
    A world ofchange – highereducationExpenditure per student at tertiary level (USD)AustraliaFinlandUnited KingdomTertiary-type A graduation rate
  • 8.
    A world ofchange – highereducationExpenditure per student at tertiary level (USD)Tertiary-type A graduation rate
  • 9.
    A world ofchange – highereducationExpenditure per student at tertiary level (USD)Tertiary-type A graduation rate
  • 10.
    A world ofchange – highereducationExpenditure per student at tertiary level (USD)Tertiary-type A graduation rate
  • 11.
    A world ofchange – highereducationExpenditure per student at tertiary level (USD)Tertiary-type A graduation rate
  • 12.
    A world ofchange – highereducationExpenditure per student at tertiary level (USD)Tertiary-type A graduation rate
  • 13.
    A world ofchange – highereducationWhat about international students?Expenditure per student at tertiary level (USD)United StatesAustraliaAAUnited KingdomFinlandATertiary-type A graduation rate
  • 14.
    Moving targetsFuture supplyof college graduates
  • 15.
    Components of theprivate net present value for a male with higher education27K$56K$170K$105K$35K$26K$367K$Net present value in USD equivalent
  • 16.
    Public cost andbenefits for a male obtaining post-secondary educationPublic costsPublic benefitsNet present value, USD equivalent(numbers in orange shownegative values)USD equivalent
  • 17.
    How the demandfor skills has changedEconomy-wide measures of routine and non-routine task input (US)Mean task input as percentiles of the 1960 task distributionThe dilemma of schools:The skills that are easiest to teach and test are also the ones that are easiest to digitise, automate and outsource (Levy and Murnane)
  • 18.
    OECD’s PISA assessmentof the knowledge and skills of 15-year-oldsCoverage of world economy83%77%81%85%86%87%
  • 19.
    Strengths and weaknessesin mathThe real worldThe mathematical WorldMaking the problem amenable to mathematical treatmentA mathematical model A model of realityUnderstanding, structuring and simplifying the situationUsing relevant mathematical content to solve the problemA real situationValidating the resultsMathematical resultsReal resultsInterpreting the mathematical results
  • 20.
    High science performanceAverageperformanceof 15-year-olds in science – extrapolate and apply… 18 countries perform below this lineLow science performance
  • 21.
    Modelling the impactProgrammesto improve cognitive skills through schools take time to implement and to have their impact on students.Assume that it will take 20 years to implement reformThe impact of improved skills will not be realised until the students with greater skills move into the labour forceAssume that improved PISA performance will result in improved skill-based of 2.5% of the labour-force each yearThe economy will respond over time as new technologies are developed and implemented, making use of the new higher skillsEstimate the total gains over the lifetime of the generation born this year .
  • 22.
    Relationship between testperformance and economic outcomesAnnual improved GDP from raising performance by 25 PISA pointsPercent addition to GDP
  • 23.
    Increase average performanceby 25 PISA points (Total 115 trillion $)bn$
  • 24.
    Catching up withFinland (total 260 trillion $)bn$
  • 25.
    Catching up withFinland(in percent of GDP)% currrent GDP
  • 26.
    Increased likelihood ofpostsec. particip. at age 19/21 associated with PISA reading proficiency at age 15 (Canada)after accounting for school engagement, gender, mother tongue, place of residence, parental, education and family income (reference group PISA Level 1)Odds ratioCollege entrySchool marks at age 15PISA performance at age 15
  • 27.
    Interest scienceIndicate curiosityin science and science-related issues and endeavoursDemonstrate willingness to acquire additional scientific knowledge and skills, using variety of resources and methodsDemonstrate willingness to seek information and have an interest in science, including consideration of science-related careers Support for scienceAcknowledge the importance of considering different scientific perspectives and argumentsSupport the use of factual information and rational explanationLogical and careful processes in drawing conclusions Knowledge of sciencePhysical systems (structure of matter, properties of matter, chemical changes of matter, motions and forces, energy and its transformations, energy and matter)Living systems (cells, humans, populations, ecosystems, biosphere)Earth and space (structures of the earth system, energy in the earth system, change in the earth system, earth’s history, space)Technology systems (Concepts and principles, science and technology)Knowledge about scienceScientific enquiry (purpose, experiments, data, measurement, characteristics of results)Scientific explanations (types, rules, outcomes)IdentifyingRecognising issues that can be investigated scientificallyIdentifying keywords in a scientific investigationRecognising the key features of a scientific investigationExplainingApplying knowledge of science in a situationDescribing or interpreting phenomena scientifically or predicting changeUsing evidenceInterpreting scientific evidence and drawing conclusionsIdentifying the assumptions, evidence and reasoning behind conclusionsContext- PersonalSocial/public
  • 28.
  • 29.
  • 30.
  • 31.
    Knowledge about scienceAttitudes-Interestin science-Support for scientific enquiry-Responsibility
  • 32.
    Strengths and weaknessesof countries in science relative to their overall performanceFranceScience competenciesScience knowledgeOECD (2007), PISA 2006 – Science Competencies for Tomorrow’s World, Figure 2.13
  • 33.
    Strengths and weaknessesof countries in science relative to their overall performanceCzech RepublicScientific competenciesScientific knowledgeOECD (2007), PISA 2006 – Science Competencies for Tomorrow’s World, Figure 2.13
  • 34.
    Strengths and weaknessesof countries in science relative to their overall performanceAustraliaScientific competenciesScientific knowledgeOECD (2007), PISA 2006 – Science Competencies for Tomorrow’s World, Figure 2.13
  • 35.
    High science performanceAverageperformanceof 15-year-olds in science – extrapolate and applyHigh average performanceLarge socio-economic disparitiesHigh average performanceHigh social equityStrong socio-economic impact on student performanceSocially equitable distribution of learning opportunitiesLow average performanceLarge socio-economic disparitiesLow average performanceHigh social equityLow science performance
  • 36.
    High science performanceDurchschnittlicheSchülerleistungen im Bereich MathematikHigh average performanceLarge socio-economic disparitiesHigh average performanceHigh social equityStrong socio-economic impact on student performanceSocially equitable distribution of learning opportunitiesLow average performanceLarge socio-economic disparitiesLow average performanceHigh social equityLow science performance
  • 37.
    Student performancePISA Indexof socio-economic backgroundAdvantageDisadvantageSchool performance and socio-economic background GermanyStudent performance and students’ socio-economic background withinschoolsSchool performance and schools’ socio-economic backgroundSchools proportional to size
  • 38.
    Student performancePISA Indexof socio-economic backgroundAdvantageDisadvantageSchool performance and socio-economic background GermanyStudent performance and students’ socio-economic background withinschoolsSchool performance and schools’ socio-economic backgroundSchools proportional to sizeUniversal policiesIncreasing educational performance of all children through reforms applied equally across the school system, e.g.
  • 39.
    Altering content orpace of curriculum
  • 40.
  • 41.
    Changing the learningenvironment in schools and classrooms
  • 42.
  • 43.
    Teacher professional developmentStudentperformancePISA Index of socio-economic backgroundAdvantageDisadvantageSchool performance and socio-economic background GermanyStudent performance and students’ socio-economic background withinschoolsSchool performance and schools’ socio-economic backgroundCompensatory policiesProviding additional economic resources to students from disadvantaged backgrounds
  • 44.
    Different to socio-economicallytargeted policies, efforts are directed to ameliorating economic circumstances, rather than providing specialised curriculum or additional educational resourcesSchools proportional to size
  • 45.
    Student performancePISA Indexof socio-economic backgroundAdvantageDisadvantageSchool performance and socio-economic background GermanyStudent performance and students’ socio-economic background withinschoolsSchool performance and schools’ socio-economic backgroundSocio-economically targeted policiesProviding a specialised curriculum or additional educational resources to students from disadvantaged backgrounds
  • 46.
    Students are oftenalso identified through other risk factors, e.g. immigration, ethnicity, low-income communitySchools proportional to size
  • 47.
    Student performancePISA Indexof socio-economic backgroundAdvantageDisadvantageSchool performance and socio-economic background GermanyStudent performance and students’ socio-economic background withinschoolsSchool performance and schools’ socio-economic backgroundPerformance targeted policiesProviding additional economic resources to students based on their academic performance
  • 48.
  • 49.
  • 50.
    Performance-based tracking orstreamingSchools proportional to size
  • 51.
    Student performancePISA Indexof socio-economic backgroundAdvantageDisadvantageSchool performance and socio-economic background United StatesStudent performance and students’ socio-economic background within schoolsSchool performance and schools’ socio-economic backgroundSchools proportional to size
  • 52.
    Student performancePISA Indexof socio-economic backgroundAdvantageDisadvantageSchool performance and socio-economic background FinlandStudent performance and students’ socio-economic background within schoolsSchool performance and schools’ socio-economic backgroundSchools proportional to size
  • 53.
    How to getthereSome policy levers that emerge from international comparisons
  • 54.
    Money matters -but other things do too
  • 55.
    Spending choices onsecondary schoolsContribution of various factors to upper secondary teacher compensation costsper student as a percentage of GDP per capita (2004)Percentage points
  • 56.
    High ambitionsand universalstandardsRigor, focus and coherenceGreat systemsattractgreatteachers and provideaccesstobestpractice and quality professional development
  • 57.
    Challenge and supportStrongsupportPoor performanceImprovements idiosyncraticStrong performanceSystemic improvementLowchallengeHighchallengePoor performanceStagnationConflictDemoralisationWeak support
  • 58.
    International Best PracticeThepastPrincipals who are trained, empowered, accountable and provide instructional leadership
  • 59.
    Principals who manage‘a building’, who have little training and preparation and are accountable but not empowered
  • 60.
    Attracting, recruiting andproviding excellent training for prospective teachers from the top third of the graduate distribution
  • 61.
    Attracting and recruitingteachers from the bottom third of the graduate distribution and offering training which does not relate to real classrooms
  • 62.
    Incentives, rules andfunding encourage a fair distribution of teaching talent
  • 63.
    The best teachersare in the most advantaged communitiesHuman capital
  • 64.
    International Best PracticeThepastExpectations of teachers are clear; consistent quality, strong professional ethic and excellent professional development focused on classroom practice
  • 65.
    Seniority and tenurematter more than performance; patchy professional development; wide variation in quality
  • 66.
    Teachers and thesystem expect every child to succeed and intervene preventatively to ensure this
  • 67.
    Wide achievement gaps,just beginning to narrow but systemic and professional barriers to transformation remain in placeHuman capital (cont…)
  • 68.
    Some teachers losemuch more time than othersPercentiles of time on spent on taskFigure 4.10Source: OECD, TALIS Database.
  • 69.
    Relatively few teachersparticipate in the kinds of professional development which they find has the largest impact on their work Comparison of teachers participating in professional development activities and teachers reporting moderate or high level impact by types of activityFigure 3.15
  • 70.
    Relatively few teachersparticipate in the kinds of professional development which they find has the largest impact on their work Comparison of teachers participating in professional development activities and teachers reporting moderate or high level impact by types of activityFigure 3.15
  • 71.
    The teachers whopaid most also did most professional developmentFigure 3.10
  • 72.
    High ambitionsDevolvedresponsibility,theschoolasthecentreofactionAccountabilityandintervention ininverse proportiontosuccessAccess to best practice and quality professional development
  • 73.
    Local responsibility andnational prescriptionTowards system-wide sustainable reformNational prescriptionSchools todayThe industrial model, detailed prescription of what schools doSchools tomorrow?Building capacityFinland todayEvery school an effective schoolSchools leading reform
  • 74.
    Pooled international dataset,effects of selected school/system factors on science performance after accounting for all other factors in the modelSchool principal’s positive evaluation of quality of educational materials(gross only)Schools with more competing schools(gross only)Schools with greater autonomy (resources)(gross and net)School activities to promote science learning(gross and net)One additional hour of self-study or homework (gross and net)One additional hour of science learning at school (gross and net)School results posted publicly (gross and net)Academically selective schools (gross and net) but no system-wide effectSchools practicing ability grouping (gross and net)One additional hour of out-of-school lessons (gross and net)20Each additional 10% of public funding(gross only)School principal’s perception that lack of qualified teachers hinders instruction(gross only)Effect after accounting for the socio-economic background of students, schools and countriesMeasured effectOECD (2007), PISA 2006 – Science Competencies from Tomorrow’s World, Table 6.1a
  • 75.
    Does appraisal andfeedback make a difference for the job?Figure 5.5
  • 76.
    Strong ambitionsDevolvedresponsibility,the schoolas the centre of actionIntegrated educational opportunities From prescribed forms of teaching and assessment towards personalised learningAccountabilityAccess to best practice and quality professional development
  • 77.
    High science performanceDurchschnittlicheSchülerleistungen im Bereich MathematikHigh average performanceLarge socio-economic disparitiesHigh average performanceHigh social equityStrong socio-economic impact on student performanceSocially equitable distribution of learning opportunitiesEarly selection and institutional differentiation High degree of stratification Low degree of stratificationLow average performanceLarge socio-economic disparitiesLow average performanceHigh social equity6Low science performance
  • 78.
    Assist countries inimproving economic and social outcomes through better skills and their effective utilisationResponsiveness Ensuring that education/training providers can adapt efficiently to changing demandQuality and efficiency in learning provision Ensuring that the right skills are acquired at the right time, right place and in the most effective modeFlexibility in provision Allowing people to study/train what they want, when they want and how they wantTransferability of skills Such that skills gained are documented in a commonly accepted and understandable formEase of access Reducing barriers to entry such as institutional rigidities, up-front fees and age restrictions, existence of a variety of entry and re-entry pathwaysLow costs of early exit Recognition for components of learning, modular provision, credit accumulation and credit transfer systems exist .
  • 79.
    OECD Skills StrategyHowdo we identify and assess essential skills for strong, sustainable and balanced growth and what are the factors driving the evolution of skill demand? Is the right mix of skills being taught and learned and can employers find workers with the skills they need? Pillar 2(ELS)Pillar 1 (EDU and ELS)How can governments build strong coalitions with the business sector and social investors and find sustainable approaches to who should pay for what, when, where and how much?Pillar 3(EDU)Pillar 4(EDU and LEED)Are skills developed in effective, equitable, efficient and sustainable ways?
  • 80.
    Pillar 1: Driversfor skill demandA work programme with four pillarsIssues
  • 81.
    Changing skill demandswithin jobs – often driven by technology
  • 82.
    Increased demand forcertain occupations affecting the composition of aggregate skills demand
  • 83.
    New types ofjobs, driven by innovation – in products and in services
  • 84.
    Greater need fortransferable skills, in part driven by greater labour mobility .
  • 85.
  • 86.
  • 87.
    Skill demands intechnology-rich environments [PIAAC]
  • 88.
    Skill demands ofinnovative firms [CERI]
  • 89.
    Skill demands inhealth and green jobs [ELS]
  • 90.
    Economic and socialoutcomes of skills [PIAAC, CERI] .How do we identify and assess essential skills for strong, sustainable and balanced growth and what are the factors driving the evolution of skill demand? Is the right mix of skills being taught and learned and can employers find workers with the skills they need? Pillar 2(ELS)Pillar 1 (EDU and ELS)How can governments build strong coalitions with the business sector and social investors and find sustainable approaches to who should pay for what, when, where and how much?Pillar 3(EDU)Pillar 4(EDU and LEED)Are skills developed in effective, equitable, efficient and sustainable ways?
  • 91.
    Pillar 2: Rightmix of skills learned and taught?A work programme with four pillarsIssues
  • 92.
    Increasingly complex anddynamic labour-markets combined with depreciation of domain-specific knowledge require individuals to upgrade their skills more regularly leading to changing patterns of work and learning
  • 93.
    Individual and aggregateskill mismatches can be associated with ineffective signalling of labour market demands to education providers and individuals but can also be the consequence of a lack of responsiveness on the part of education and training providers
  • 94.
  • 95.
  • 96.
    Prevalence and consequencesof skills mismatch [EDU/ELS]
  • 97.
    Improving the utilisationof human capital [ELS]
  • 98.
    Preventing skill obsolesenceamong displaced workers [ELS]
  • 99.
    Understanding the impactof age on skills [ELS] .How do we identify and assess essential skills for strong, sustainable and balanced growth and what are the factors driving the evolution of skill demand? Is the right mix of skills being taught and learned and can employers find workers with the skills they need? Pillar 2(ELS)Pillar 1 (EDU and ELS)How can governments build strong coalitions with the business sector and social investors and find sustainable approaches to who should pay for what, when, where and how much?Pillar 3(EDU)Pillar 4(EDU and LEED)Are skills developed in effective, equitable, efficient and sustainable ways?
  • 100.
    Pillar 3: Areskills developed in effective, equitable and sustainable waysA work programme with four pillarsIssues
  • 101.
    Establishing efficient andfair ways of lifelong and lifewide learning, and ensuring responsiveness, quality and flexibility in provision
  • 102.
    Incentive systems andsupport structures to enhancing skills through the formal educational system, in the work-place or through incentives addressed at the general population and training
  • 103.
    Establishing an appropriatemix of academic and vocational learning in ways that reflect student preferences and employers’ needs, with vocational training providing immediate employability, but also basic transferable skills to support occupational mobility
  • 104.
  • 105.
  • 106.
  • 107.
    Equity in accessand educational mobility [PIAAC, PISA]
  • 108.
    Utilising the skillpotential of immigrants [ELS]
  • 109.
    Developing innovation orientedskills [CERI] .How do we identify and assess essential skills for strong, sustainable and balanced growth and what are the factors driving the evolution of skill demand? Is the right mix of skills being taught and learned and can employers find workers with the skills they need? Pillar 2(ELS)Pillar 1 (EDU and ELS)How can governments build strong coalitions with the business sector and social investors and find sustainable approaches to who should pay for what, when, where and how much?Pillar 3(EDU)Pillar 4(EDU and LEED)Are skills developed in effective, equitable, efficient and sustainable ways?
  • 110.
    Pillar 4: Whoshould pay for what, when, where and how much?A work programme with four pillarsIssues
  • 111.
    Building new relationships,networks and coalitions between learners, providers, governments, businesses, social investors and innovators that bring together the legitimacy, innovation, and resources that are needed to make lifelong learning a reality for all
  • 112.
    Finding ways toencourage both employers and students to participate in workplace training, and ensuring that such training is of good quality, with effective quality assurance and contractual frameworks for apprentices
  • 113.
  • 114.
  • 115.
    Joining up localskill strategies .How do we identify and assess essential skills for strong, sustainable and balanced growth and what are the factors driving the evolution of skill demand? Is the right mix of skills being taught and learned and can employers find workers with the skills they need? Pillar 2(ELS)Pillar 1 (EDU and ELS)How can governments build strong coalitions with the business sector and social investors and find sustainable approaches to who should pay for what, when, where and how much?Pillar 3(EDU)Pillar 4(EDU and LEED)Are skills developed in effective, equitable, efficient and sustainable ways?
  • 116.
    PIAAC will…in eachcountry interview 5000 adults aged 16-65 in their homes and test their skillscollect information on the antecedents, outcomes and contexts of skill development and use… in order to…provide a comprehensive assessment of the human capital stockFor high performers, show to what extent they are able to apply their skills to solve challenging problems requiring mastery of technology For those with low literacy, show to what extent their problem is with performing basic reading functions or with understanding and applicationshow to what extent skills held by individuals are actually used at work and identify the role skills play in improving labour market prospects of at-risk populations improve understanding of the labour market and social returns to education and traininghelp governments better understand how education and training systems can nurture these skills .
  • 117.
    High potential policyimpactxDescription of the population with low skills, or special population groups such as immigrants, and interrelationships with labour-market outcomes.
  • 118.
    What is therole of skills in explaining differences in labour-market outcomes between immigrant and native-born workers? Do skill differences depend on where human capital was acquired? Do immigrants receive different returns to these skills than observationally similar native-born workers?
  • 119.
    To what extentcan and do skills play a role in levelling the playing field, both in terms of providing high quality education to all and giving access to higher education to those who are able and motivated to continue their schooling, irrespective of their social background?
  • 120.
    Further analysis onintergenerational mobility will also be possible with the JRA measurement of what people do in their jobsThe competitive advantages of OECD countries in the global competition for jobs Quick winsMust havesWhere does initial education leave us in terms of skill supply with their different forms of organisation of the education and training system?
  • 121.
    Has the rapidgrowth in educational attainment translated into better foundation skills?
  • 122.
    How do theresults compare to those observed in earlier schooling (PISA)? How do people gain and lose skills as they grow older?
  • 123.
    How will changesin the age structure of populations and aspects such as educational attainment feed through to the future talent pool?
  • 124.
    Labour force skillsand the price of these skills are crucial to understand in the perspective of increasing global competition for jobs higher up in the skill hierarchy. PIAAC can tell us more about which cognitive and non-cognitive skills are important in particular.
  • 125.
    PIAAC can providesystematic insights into the risks and rewards for skills in the labour market, for individuals and economies, as well as for specific subgroups such as immigrantsAdult competencies and their as well as economic and social outcomesaggregateindividualWhat can we learn about the impact of age on skills and skill utilisation, how has this changed over recent decades and the policy levers associated with this (separating biological effects of aging from differences in the experiences of cohorts over time)?How well do education and training systems deliver in generating the required competenciesIs education or skills mismatch mostly confined to youth early on in their professional careers and subsequently diminishes? Is mismatch important and does it translate into large earnings penalties? Have education and training systems in OECD countries shown sufficient adaptability in the face of changing skill demands or are skills mismatches endemic? How do task-based learning (JRA) and job-related training relate to the length of the working life? (but keep in mind that labour-market outcomes and training are snapshots in time whereas the measured skills are accumulated over the lifespan)Improving the labour-market prospects of those at riskHow well can adults solve problems in technology-rich environments? How does this relate to the incidence and intensity of using information technology in and outside workLow feasibility/costlyHigh feasibilityEquity and intergenerational mobilityAgeing and skillsCapitalising on technology-rich environmentsWhat levels of skills do individuals and countries demonstrate, and how do these relate to educational attainment?Money pitsLow-hanging fruits…Reasonable potential for policy(Skip examples)
  • 126.
    OutcomesA Skills Strategyfor OECD countriesAn integrated work programme on skills across the entire organisationA regularly published OECD Skills Outlook that, with a combination of comparative analysis and country studies, will: Trace the development of skills, through their utilisation in labour markets, how they feed into better jobs, higher productivity, and ultimately better economic and social outcomesCustomise policy insights from comparative analysis and peer learning so that they are useful in national policy contextsProvide a catalyst for policy discourse on national skill strategiesContribute to building strategic partnerships for successful policy implementation .
  • 127.
    State of playPIAACis now at a critical juncture of moving from an international strategy towards national implementationWhere we are…PIAAC strategy agreed among countriesInternational project consortium in placeAgreement on the scope of the initial report and a discussion on further analytic workFull pilot in all countries, majority of countries now in the field (1400 respondents, 2010),… and what remains aheadReview of field trial results and development of main data collection instrumentsMain data collection (2011/2012)Public release of results (2013) .
  • 128.
  • 129.
    The qualifications weacquired don’t tell us everything about the skills we haveMean problem solving1,2 scores on a scale with range 0-500 points, by level of educational attainment, populations aged 16-65, 20031 – less than upper secondary2 – upper secondary3 – post-secondary/non-tertiary4 – tertiary educationSource: International Adult Literacy and Life Skills Study (ALLS)
  • 130.
    Skill make adifference for labourmarket outcomesThe probabilities of unemployed adults aged 16 to 65 to exit unemployment over a 52 week period, by low (Levels 1 and 2) and medium to high (Levels 3 and 4/5) skills, document scale, 2003High skills(Levels 3, 4 and 5)Low skills(Levels 1 and 2)Source: International Adult Literacy and Life Skills Study (ALLS)
  • 132.

Editor's Notes

  • #4 And policy makers do this because in this world where all work that can be digitised, automated or outsourced can now be done anywhere in the world by those who are best prepared, the yardstick for success is no longer improvement by national standards, but the best performing education systems internationally. I will begin my presentation this evening by showing how the global talent pool has changed, in response to the forces of globalisation and technological changeThen examine what international comparisons can tell us about this. I will show you where we see the United States and try to contrast this with the best performing education systems, that give you a sense of what is possible in education, terms of the quality of educational outcomes and equity in the distribution of educational opportunities. And I will conclude with tying the results to some of the policy levers that emerge from international comparisons.
  • #5 The pace of change is most clearly visible in higher education, and I want to bring two more dimensions into the picture here. Each dot on this chart represents one country. The horizontal axis shows you the college graduation rate, the proportion of an age group that comes out of the system with a college degree. The vertical axis shows you how much it costs to educate a graduate per year.
  • #6 *Lets now add where the money comes from into the picture, the larger the dot, the larger the share of private spending on college education, such as tuition.The chart shows the US as the country with the highest college graduation rate, and the highest level of spending per student. The US is also among the countries with the largest share of resources generated through the private sector. That allows the US to spend roughly twice as much per student as Europe. US, FinlandThe only thing I have not highlighted so far is that this was the situation in 1995. And now watch this closely as you see how this changed between 1995 and 2005.
  • #7 You see that in 2000, five years, later, the picture looked very different. While in 1995 the US was well ahead of any other country – you see that marked by the dotted circle, in 2000 several other countries had reached out to this frontier. Look at Australia, in pink.
  • #13 Thatwasallveryquick, letusgothroughthisdevelopmentonceagain
  • #14 This is where China, the European Union, India and the US stood in terms of the number of high school graduates in 2003. This is how the picture is likely to look in 2010, and this is what we project for 2015.China more smart kids than Europe has kids.
  • #16 Levy and Murnane show how the composition of the US work force has changed and I want to show one slides because it provides such a great introduction to our work on PISA. What they show is that, between 1970 and 2000, work involving routine manual input, the jobs of the typical factory worker, was down significantly. Non-routine manual work, things we do with our hands, but in ways that are not so easily put into formal algorithms, was down too, albeit with much less change over recent years – and that is easy to understand because you cannot easily computerise the bus driver or outsource your hairdresser. All that is not surprising, but here is where the interesting story begins: Among the skill categories represented here, routine cognitive input, that is cognitive work that you can easily put into the form of algorithms and scripts saw the sharpest decline in demand over the last couple of decades, with a decline by almost 8% in the share of jobs. So those middle class white collar jobs that involve the application of routine knowledge, are most at threat today. And that is where schools still put a lot of their focus and what we value in multiple choice accountability systems.The point that Levy and Murnane make is, that the skills that are easiest to teach and test are also the skills that are easiest to digitise, automatise and offshore. If that is all what we do in school, we are putting our youngsters right up for competition with computers, because those are the things computers can do better than humans, and our kids are going to loose out before they even started. Where are the winners in this process? These are those who engage in expert thinking – the new literacy of the 21st century, up 8% - and complex communication, up almost 14%.We have tried to use these message that emerge from the analysis of skill demands as an important starting point for conceptualising our assessments.
  • #17 At the OECD, we are measuring skills, with a focus on those non-routing cognitive skills, regularly through our PISA programme, now the most comprehensive international assessment of the quality of education. Every three years, we test roughly half a million of children in OECD countries in key competencies, and that’s not simply about checking whether students have learned what they were recently taught, but we examine to what extent students can extrapolate from what they have learned and apply their knowledge and skills in novel settings. Here you see the countries which we can compare, and how the set of countries being compared has expanded.
  • #24 The best way to find out whether what students have learned at school matters for their life is to actuallywatch what happens to them after they leave school. This is exactly what we have done that with around 30,000 students in Canada. We tested them in the year 2000 when they were 15 years old in reading, math and science, and since then we are following up with them each year on what choices they make and how successful they are in their transition from school to higher education and work.The horizontal axis shows you the PISA level which 15-year-old Canadians had scored in 2000. Level 2 is the baseline level on the PISA reading test and Level 5 the top level in reading.The red bar shows you how many times more successful someone who scored Level 2 at age 15 was at age 19 to have made a successful transition to university, as compared to someone who did not make it to the baseline PISA level 1. And to ensure that what you see here is not simply a reflection of social background, gender, immigration or school engagement, we have already statistically accounted for all of these factors. The orange bar. …How would you expect the picture to be like at age 21? We are talking about test scores here, but for a moment, lets go back to the judgements schools make on young people, for example through school marks. You can do the same thing here, you can see how well school marks at age 15 predict the subsequent success of youths. You see that there is some relationship as well, but that it is much less pronounced than when we use the direct measure of skills.
  • #39 In one way, our international benchmarks make depressing reading for the US, because this is the country with the greatest potential and the country that has led education and research for decades. But the comparisons also indicate a way forward. They demonstrate what can be done with a combination of the right strategy and courageous, sustained leadership. Singapore’s story over 40 years is truly inspirational. So, in an entirely different culture, is Finland’s over 30 years. Poland made remarkable progress in the last decade by raising the average performance of 15-year-olds by almost a school year in the last six years alone. The reforms in Alberta and Ontario, just across your northern border, are working too.
  • #41 What you see, however, that countries spend their money quite differently.Average spending – some of the most successful education systems know how to invest their money where the challenges are greatest, and how to attract the brightest teachers into the most difficult classrooms.
  • #49 This chart shows you the proportion of teachers who participated in various types of professional development over the last 18 months, with the bars showing the average across countries and the red dot showing the Mexican figures. So you see that just over 60% of Mexican teachers have engaged in some form of individual and collaborative research, just over 30% in qualification programmes, almost every teacher in informal dialogue to improve teaching, 70% in reading professional literature, and so on.These are impressive numbers. But do governments offer, and do teachers take up the kind of professional development that is actually most effective? The yellow bar shows you the proportion of teachers who think that the various types of professional development have a moderate to large impact on their development as a teacher. So you see that, while individual and collaborative research seems to have the largest impact (the yellow bar is long), participation rates here, shown by the blue bar, are comparatively low. The same is true for sustained qualification programs, these seem to make a genuine impact but few teachers pursue such courses. In contrast, lots of teachers participate in one-off seminars and workshops which much fewer teachers perceive to be of value.TALIS thus shows that we need to do better in matching the costs and benefit as well as supply and demand for professional development. Courses and workshopsProfessional development networkMentoring and peer observationObservation visits to other schoolsEducation conferences and seminars
  • #50 This chart shows you the proportion of teachers who participated in various types of professional development over the last 18 months, with the bars showing the average across countries and the red dot showing the Mexican figures. So you see that just over 60% of Mexican teachers have engaged in some form of individual and collaborative research, just over 30% in qualification programmes, almost every teacher in informal dialogue to improve teaching, 70% in reading professional literature, and so on.These are impressive numbers. But do governments offer, and do teachers take up the kind of professional development that is actually most effective? The yellow bar shows you the proportion of teachers who think that the various types of professional development have a moderate to large impact on their development as a teacher. So you see that, while individual and collaborative research seems to have the largest impact (the yellow bar is long), participation rates here, shown by the blue bar, are comparatively low. The same is true for sustained qualification programs, these seem to make a genuine impact but few teachers pursue such courses. In contrast, lots of teachers participate in one-off seminars and workshops which much fewer teachers perceive to be of value.TALIS thus shows that we need to do better in matching the costs and benefit as well as supply and demand for professional development. Courses and workshopsProfessional development networkMentoring and peer observationObservation visits to other schoolsEducation conferences and seminars
  • #52 But the balance between national prescription and schools leading reform is not an all-or-nothing. In fact, most school systems have started out with highly prescriptive education systems. But gradually the have moved towards building capacity and enabling schools to assume greater responsibility.
  • #56 With an OECD Skills Strategy , we would seek to assist countries to improve economic and social outcomes through better skills and their effective utilisation. More specifically, we would seek to improve: (1) responsiveness (ensuring that education/training providers can adapt efficiently to changing demand); (2) quality and efficiency in learning provision (ensuring that the right skills are acquired at the right time, right place and in the most effective mode); (3) flexibility in provision (allowing people to study/train what they want, when they want and how they want); (4) transferability of skills (such that skills gained are documented in a commonly accepted and understandable form); (5) ease of access (e.g. by reducing barriers to entry such as institutional rigidities, up-front fees and age restrictions, existence of a variety of entry and re-entry pathways); and (6) low costs of early exit (e.g. credit is granted for components of learning, modular provision, credit accumulation and credit transfer systems exist). The work would take a lifecycle perspective in designing policy responses to the challenges of building, maintaining and improving skills in the different transitions over the life course.
  • #57 We have structured the work under four pillars: The first pillar deals with the question: How do we identify and assess essential skills for strong, sustainable and balanced growth and what are the factors driving the evolution of skill demand? Pillar 2: Is the right mix of skills being taught and learned and can employers find workers with the skills they need? Pillar 3: Are skills developed in effective, equitable, efficient and sustainable ways? Pillar 4: How can governments build strong coalitions with the business sector and social investors and find sustainable approaches to who should pay for what, when, where and how much?Let me briefly lead you through these pillars.
  • #58 One of the reasons why skill shortages often do not translate efficiently into learning provision is the lack of a common language through which skills are identified, articulated, recognised and communicated from those who use them to those who produce them. This pillar would seek to assist countries with identifying, defining and assessing essential skills, giving adequate recognition to generic skills as well as domain-specific and firm-specific skills. Our analysis would examine both changing skill demands within existing jobs – often driven by technology – as well as changing aggregate skill demands resulting from shifts in occupational composition. Another important objective of this first pillar would be the development of better evidence on the economic and social outcomes of skills at both individual and aggregate levels.
  • #59 A better understanding of the drivers of changes in skill demand within firms, occupations and countries will be crucial for countries to shift the focus of learning provision from supplying skills for today’s labour market to shaping future jobs. Labour markets are becoming increasingly complex and dynamic, are characterised by growing convergence of occupational sectors and rising job and occupational mobility. These forces combined with depreciation of domain-specific knowledge require individuals to upgrade their skills more regularly leading to changing patterns of work and learning. Skill mismatches occur at both the individual level – when a worker would be more productive in another position – as well as at the aggregate level – when there is a general surplus or shortage of specific skills. It is important in this context that policy makers are seeking to meet skills shortages, and not just labour shortages created by unattractive and low quality employment. There are also ‘age training gaps’ and ‘gender training gaps’ with older workers and women often being less involved in training that their younger and male counterparts, respectively. Why do these gaps exist and how can be best addressed? What are the key institutional factors that can promote participation in training of older workers (e.g. wage-setting mechanisms; retirement policies)? What policy and institutions could reduce the gender training gap (e.g. family-friendly policies that encourage more continuity in working careers for women)? Finally, how to manage the global search for talent while also dealing with brain drain and brain gains issues? How to strengthen education outcomes of children of immigrants in receiving countries? How to promote return migration and better use of competencies in the home country?
  • #60 Third, with a rapidly rising demand for skills, countries can no longer simply rely on education and training systems that efficiently sort individuals, but need to improve their skill base throughout the population and to capitalise on the full potential of all individuals. This requires countries to ensure that skills are developed in effective, efficient and fair ways through lifelong and lifewide learning, and to ensure responsiveness, quality and flexibility in provision. The OECD could play a pathfinder role for countries to: (1) identify effective strategies for new ways of learning and skill provision; (2) improve the knowledge base about skill development; and (3) support systems of continuous innovation and feedback to develop knowledge of what policies work in which circumstances. This would also involve identifying the policy levers, incentive systems and support structures that lead to enhancing skills through the formal educational system, in the work-place or through incentives addressed at the general population. It would also include sustaining workplace training and meeting the increased demand for full-time vocational education and training.There is also significant potential for peer-learning among countries with regard to how individuals learn differently, and differently at different stages of their lives, and what effective policies are to meet those individual needs of people, wherever they learn, to look into new ways to take learning to the learner, examine new forms of educational provision and new relationships between learners, providers, funders and social innovators. Similarly, peer-learning offers important policy insights for establishing the appropriate mix of academic and vocational programmes in ways that reflect student preferences and employers’ needs, with vocational training providing immediate employability, but also basic transferable skills to support occupational mobility.
  • #61 Fourth, governments need to build new relationships, networks and coalitions between learners, providers, governments, businesses, social investors and innovators that bring together the legitimacy, innovation, and resources that are needed to make lifelong learning a reality for all. Much of this networking and engagement takes place at the level of local labour markets, and it is therefore at this level that relevant stakeholders interact and collaborate to gear education and training to local labour market needs, attract and retain talent, and ensure that disadvantaged groups are integrated into learning systems. The rising demand for skills also implies that all stakeholders must be prepared to mobilise more time and money for learning. At the same time, there is an urgent need to improve the efficiency of educational provision. Investment in learning needs to be cost and tax-efficient for individuals and their employers. For those out of work, funding needs to be accessible to support and incentivize learning. Governments need to use regulation and taxation to encourage financial institutions to develop new financial instruments that allow learners to access opportunities when they need them most, including through lowering cost, reducing risk and smoothing repayments. For learning beyond universal education, education and training systems need to find ways to share the costs among government, employers and students based on the respective benefits obtained.