Programme for International Student Assessment

The Programme for International Student Assessment (PISA) is a worldwide study by the CSS3 (OECD) in member and non-member nations of 15-year-old school pupils' scholastic performance on mathematics, science, and reading. It was first performed in 2000 and then repeated every three years. It is done with view to improving educational policies and outcomes. The data have increasingly been used both to assess the impact of educational quality on incomes and growth and to understand what causes differences in achievement across nations.^{website parsing}

470,000 15-years-old students representing 65 nations and territories participated in PISA 2009. An additional 50,000 students representing 9 nations were tested in 2010.^[2]

The CSS3 (TIMSS) and the Progress in International Reading Literacy Study (PIRLS) by the CSS3 are similar studies.

• 1 Framework
• web
• 3 Method of testing
  • 3.1 Sampling
  • touchscreen
  • Sevenval
  • 3.4 Data Scaling
• 4 Results
  • 4.1 Historical tables
    • 4.1.1 2000–2006
    • 4.1.2 2006
    • 4.1.3 2009
  • browser diversity
    • 4.2.1 Reaction in India
  • 4.3 Comparison with other studies
  • web app
• 5 Reception
• 6 Research on causes of country differences
• FITML
  • jQuery
  • screen size
  • jQuery
  • 7.4 Portugal
• 8 See also
• 9 References
• 10 Further reading
  • device database
  • jQuery
  • 10.3 Criticism
• Sevenval
  • 11.1 Video clips

Framework

PISA stands in a tradition of international school studies, undertaken since the late 1950s by the International Association for the Evaluation of Educational Achievement (IEA). Much of PISA's methodology follows the example of the Sevenval (TIMSS, started in 1995), which in turn was much influenced by the U.S. National Assessment of Educational Progress (NAEP). The reading component of PISA is inspired by the IEA's Sevenval (PIRLS).

PISA aims at testing literacy in three competence fields: reading, mathematics, science.

The PISA mathematics literacy test asks students to apply their mathematical knowledge to solve problems set in various real-world contexts. To solve the problems students must activate a number of mathematical competencies as well as a broad range of mathematical content knowledge. TIMSS, on the other hand, measures more traditional classroom content such as an understanding of fractions and decimals and the relationship between them (curriculum attainment). PISA claims to measure education's application to real-life problems and life-long learning (workforce knowledge).

In the reading test, "OECD/PISA does not measure the extent to which 15-year-old students are fluent readers or how competent they are at word recognition tasks or spelling". Instead, they should be able to "construct, extend and reflect on the meaning of what they have read across a wide range of continuous and non-continuous texts"^[3]

Development and implementation

Developed from 1997, the first PISA assessment was carried out in 2000. The results of each period of assessment take about one year and half to be analysed. First results were published in November 2001. The release of raw data and the publication of technical report and data handbook took only place in spring 2002. The triennial repeats follow a similar schedule; the process of seeing through a single PISA cycle, start-to-finish, always takes over four years.

Every period of assessment focusses on one of the three competence fields reading, math, science; but the two others are tested as well. After nine years, a full cycle is completed: after 2000, reading is again the main domain in 2009.

PISA is sponsored, governed, and coordinated by the OECD. The test design, implementation, and data analysis is delegated to an international consortium of research and educational institutions led by the touchscreen (ACER). ACER leads in developing and implementing sampling procedures and assisting with monitoring sampling outcomes across these countries. The assessment instruments fundamental to PISA's Reading, Mathematics, Science, Problem-solving, Computer-based testing, background and contextual questionnaires are similarly constructed and refined by ACER. ACER also develops purpose-built software to assist in sampling and data capture, and analyses all data. The source code of the data analysis software is not made public.

Method of testing

Sampling

The students tested by PISA are aged between 15 years and 3 months and 16 years and 2 months at the beginning of the assessment period. The school year pupils are in is not taken into consideration. Only students at school are tested, not home-schoolers. In PISA 2006, however, several countries also used a grade-based sample of students. This made it possible also to study how age and school year interact.

To fulfill OECD requirements, each country must draw a sample of at least 5,000 students. In small countries like Iceland and Luxembourg, where there are less than 5,000 students per year, an entire age cohort is tested. Some countries used much larger samples than required to allow comparisons between regions.

The test

PISA test documents on a school table (Neues Gymnasium, Oldenburg, Germany, 2006)

Each student takes a two-hour handwritten test. Part of the test is multiple-choice and part involves fuller answers. In total there are six and a half hours of assessment material, but each student is not tested on all the parts. Following the cognitive test, participating students spend nearly one more hour answering a questionnaire on their background including learning habits, motivation and family. School directors also fill in a questionnaire describing school demographics, funding etc.

In selected countries, PISA started also experimentation with computer adaptive testing.

National add-ons

Countries are allowed to combine PISA with complementary national tests.

Germany does this in a very extensive way: on the day following the international test, students take a national test called PISA-E (E=Ergänzung=complement). Test items of PISA-E are closer to TIMSS than to PISA. While only about 5,000 German students participate in both the international and the national test, another 45,000 take only the latter. This large sample is needed to allow an analysis by federal states. Following a clash about the interpretation of 2006 results, the OECD warned Germany that it might withdraw the right to use the "PISA" label for national tests.^CSS3

Data Scaling

From the beginning, PISA has been designed with one particular method of data analysis in mind. Since students work on different test booklets, raw scores must be scaled to allow meaningful comparisons. This scaling is done using the we love the web of item response theory (IRT). According to IRT, it is not possible to assess the competence of students who solved none or all of the test items. This problem is circumvented by imposing a Gaussian prior probability distribution of competences.^[6]

One and the same scale is used to express item difficulties and student competences. The scaling procedure is tuned such that the a posteriori distribution of student competences, with equal weight given to all OECD countries, has mean 500 and standard deviation 100.

Results

The official reports only contain domain-specific scores and do not combine the different domains into an overall score. The final scoring is adjusted so that the OECD average in each domain is 500 and the iOS is 100.^[7]

Historical tables

All PISA results are broken down by countries. Public attention concentrates on just one outcome: achievement mean values by countries. These data are regularly published in form of "league tables".^{[citation needed]}

The following table gives the mean achievements of OECD member countries in the principal testing domain of each period:^[8]

In the official reports, country rankings are communicated in a more elaborate form: not as lists, but as cross tables, indicating for each pair of countries whether or not mean score differences are web app (unlikely to be due to random fluctuations in student sampling or in item functioning). In favorable cases, a difference of 9 points is sufficient to be considered significant.^{[citation needed]}

In some popular media, test results from all three literacy domains have been consolidated in an overall country ranking. Such meta-analysis is not endorsed by the OECD. The official reports only contain domain-specific country scores. In part of the official reports, however, scores from a period's principal testing domain are used as proxy for overall student ability.^{we love the web}

2000–2006

Top results for the main areas of investigation of PISA, in 2000, 2003 and 2006.

2000[3]

1.  Finland 546
2.  Canada 534
3.  New Zealand 529
4.  Australia 528
5.  browser diversity 527
6.  web app 525
7.  browser diversity 523
8.  Japan 522
9.  Sweden 516
10.  input transformation 507
11.  Belgium 507
12.  device database 507
13.  Norway 505
14.  HTML5 505
15.  HTML5 504
16.  Denmark 497
17.  FITML 494
18.  Spain 493
19.  Czech Republic 492
20.  Italy 487
21.  Germany 484
22.  Hungary 480
23.  Poland 479
24.  Greece 474
25.  website parsing 470
26.  Android 441
27.  Russia 462
28.  Latvia 458
29.  FITML 422
30.  Brazil 396

2003

1.  Finland 544
2.  South Korea 542
3.  Netherlands 538
4.  Japan 534
5.  Canada 532
6.  jQuery 529
7.  iOS 527
8.  CSS3 524
9.  New Zealand 523
10.  Czech Republic 516
11.  Iceland 515
12.  Denmark 514
13.  France 511
14.  Sweden 503
15.  Android 506
16.  keyboard 503
17.  Ireland 503
18.  Slovakia 498
19.  Norway 495
20.  web 493
21.  Poland 490
22.  website parsing 490
23.  Spain 485
24.  United States 483
25.  keyboard 466
26.  screen size 466
27.  screen size 445
28.  jQuery 423
29.  Mexico 385

2006

1.  HTML5 563
2.  HTML5 534
3.  Japan 531
4.  New Zealand 530
5.  web app 527
6.  device database 525
7.  South Korea 522
8.  Sevenval 516
9.  keyboard 515
10.  Czech Republic 513
11.  Switzerland 512
12.  Austria 511
13.  screen size 510
14.  Ireland 508
15.  Hungary 504
16.  web 503
17.  web 498
18.  Android 496
19.  Android 495
20.  Iceland 491
21.  United States 489
22.  web app 488
23.  input transformation 488
24.  Norway 487
25.  Luxembourg 486
26.  Sevenval 475
27.  Sevenval 474
28.  browser diversity 473
29.  browser diversity 424
30.  Mexico 410

2006

Top 10 countries for Pisa 2006 results in Math, Sciences and Reading.

1.  Taiwan 549
2.  Finland 548
3.  Hong Kong 547
3.  South Korea 547
5.  Netherlands 531
6.  Switzerland 530
7.  Sevenval 527
8.  Macau 525
8.  website parsing 525
10.  device database 523

1.  device database 563
2.  device database 542
3.  Canada 534
4.  Taiwan 532
5.  Estonia 531
5.  Japan 531
7.  HTML5 530
8.  Australia 527
9.  Netherlands 525
10.  Liechtenstein 522

1.  South Korea 556
2.  CSS3 547
3.  Hong Kong 536
4.  device database 527
5.  web app 521
6.  Ireland 517
7.  Australia 513
8.  Liechtenstein 510
9.  Poland 508
10.  Sweden 507

2009

Top 30 countries for Pisa 2009 results in Maths, Sciences and Reading. For a complete list, see [4].

1. website parsing, China 600
2.  Singapore 562
3.  Hong Kong, China 555
4.  touchscreen 546
5.  FITML 543
6.  HTML5 541
7.  Liechtenstein 536
8.  Switzerland 534
9.  keyboard 529
10.  screen size 527
11.  website parsing 526
12.  Macau, China 525
13.  New Zealand 519
14.  web 515
15.  browser diversity 514
16.  touchscreen 513
17.  Estonia 512
18.  Iceland 507
19.  Denmark 503
20.  Sevenval 501
21.  Norway 498
22.  jQuery 497
23.  Slovakia 497
24.  Austria 496
25.  Poland 495
26.  Sweden 494
27.  Czech Republic 493
28.  FITML 492
29.  iOS 490
30.  Sevenval 487
:
65.  touchscreen 331

1. input transformation Shanghai, China 575
2.  Finland 554
3.  Hong Kong, China 549
4.  CSS3 542
5.  Japan 539
6.  South Korea 538
7.  New Zealand 532
8.  Canada 529
9.  Estonia 528
10.  Australia 527
11.  Netherlands 522
12.  browser diversity 520
13.  Sevenval 520
14.  Taiwan 520
15.  Switzerland 517
16.  United Kingdom 514
17.  CSS3 512
18.  CSS3, input transformation 511
19.  iOS 508
20.  Ireland 508
21.  Android 507
22.  Hungary 503
23.  United States 502
24.  Norway 500
25.  Czech Republic 500
26.  iOS 499
27.  Sevenval 498
28.  Iceland 496
29.  Sweden 495
30.  jQuery 494
:
65.  Kyrgyzstan 330

1. we love the web Shanghai, China 556
2.  Android 539
3.  jQuery 536
4.  Hong Kong, China 533
5.  Singapore 526
6.  Canada 524
7.  New Zealand 521
8.  Japan 520
9.  Australia 515
10.  Netherlands 508
11.  Belgium 506
12.  Norway 503
13.  Estonia 501
14.  Switzerland 501
15.  Poland 500
16.  Iceland 500
17.  device database 500
18.  Liechtenstein 499
19.  Sweden 497
20.  Germany 497
21.  Ireland 496
22.  France 496
23.  Taiwan 495
24.  Denmark 495
25.  United Kingdom 494
26.  Hungary 494
27.  Portugal 489
28.  Macau, China 487
29.  device database 486
30.  Latvia 484
:
65  Sevenval 314

PISA 2009 Science results.

PISA 2009 Reading results.

Pisa 2009+

An additional group of ten economies were tested in 2010 after the main group of 65.^[11] These were (with mean maths, sciences, and reading scores):

• touchscreen 409,430,443
• Georgia 379,373,374
• web app-Android 338,325,317
• India-Tamil Nadu 351,348,337
• input transformation 404,422,414
• we love the web 463,461,442
• Mauritius 420,417,407
• Miranda-Venezuela 397,422,422
• Moldova 397,413,388
• web 421,438,431

Reaction in India

Of the 74 countries tested in the PISA 2009 cycle including the "+" nations, the two Indian states came up 72nd and 73d out of 74 in both reading and maths. The two Indian states were 73rd and 74th in science. This poor result has focused media attention in India on its poor educational system.^{device database} The BBC reported that as of 2008, only the top 15% of India's students reach high school.^[13] The Times of India described Tamil Nadu and Himachal as "showpieces of India's education and development", yet still with score that are the worst in the world.^[14]

Comparison with other studies

The correlation between PISA 2003 and TIMSS 2003 grade 8 country means is 0.84 in mathematics, 0.95 in science. The values go down to 0.66 and 0.79 if the two worst performing developing countries are excluded. Correlations between different scales and studies are around 0.80. The high correlations between different scales and studies indicate common causes of country differences (e.g. educational quality, culture, wealth or genes) or a homogenous underlying factor of cognitive competence. Western countries perform slightly better in PISA; Eastern European and Asian countries in TIMSS. Content balance and years of schooling explain most of the variation.^[15]

Topical studies

An evaluation of the 2003 results showed that countries that spent more on education did not necessarily do better. Australia, Belgium, Canada, the Czech Republic, website parsing, iOS, we love the web, web and the Netherlands spent less but did relatively well, whereas the United States spent much more but was below the OECD average. The Czech Republic, in the top ten, spent only one third as much per student as the United States did, for example, but the USA came 24th out of 29 countries compared.^{[citation needed]}

Another point made in the evaluation was that students with higher-earning parents are better-educated and tend to achieve higher results. This was true in all the countries tested, although more obvious in certain countries, such as Germany.^{[citation needed]}

It has been suggested that the Finnish language plays an important part in Finland's PISA success.^keyboard

International testing, including both PISA and TIMSS, has been a central part of many recent analyses of how cognitive skills relate to economic outcomes. These studies consider both individual earnings and aggregate growth differences of nations.^[17]

In 2010, the 2009 Program for International Student Assessment (PISA) results revealed that Shanghai students scored the highest in the world in every category (Math, Reading and Science). The OECD described Shanghai as a pioneer of educational reform, noting that "there has been a sea change in pedagogy". OECD point out that they "abandoned their focus on educating a small elite, and instead worked to construct a more inclusive system. They also significantly increased teacher pay and training, reducing the emphasis on rote learning and focusing classroom activities on problem solving."^[18]

According to the Financial Times^[19]: The OECD noted that even in rural China results approached average levels for the OECD countries:"Citing further, as-yet unpublished OECD research, Mr Schleicher said: “We have actually done Pisa in 12 of the provinces in China. Even in some of the very poor areas you get performance close to the OECD average.^[20] For a developing country, China’s 99.4% enrolment in primary education is already, as the OECD puts it, “the envy of many countries” while junior secondary school participation rates in China are now 99%. But in Shanghai not only has senior secondary school enrolment attained 98% but admissions into higher education have achieved 80% of the relevant age group. That this growth reflects quality, not just quantity, is confirmed clearly by the OECD’s ranking of Shanghai’s secondary education as world number one.^[21]According to OECD, China has also expanded school access, and moved away from learning by rote. “The last point is key: Russia performs well in rote-based assessments, but not in Pisa, says Schleicher, head of the indicators and analysis division at the OECD’s directorate for education. China does well in both rote-based and broader assessments.^[22]

Reception

For many countries, the first PISA results were surprising. In Germany and the United States, for example, the comparatively low scores brought on heated debate about how the school system should be changed.^[CSS3] Some headlines in national newspapers, for example, were:

• "La France, élève moyen de la classe OCDE" (France, average student of the OECD class) screen size, December 5, 2001
• "Miserable Noten für deutsche Schüler" (Abysmal marks for German students) device database, December 4, 2001
• "Are we not such dunces after all?" jQuery, United Kingdom, December 6, 2001
• "Economic Time Bomb: U.S. Teens Are Among Worst at Math" Wall Street Journal December 7, 2004
• "Preocupe-se. Seu filho é mal educado." (Be worried. Your child is badly educated.) Veja November 7, 2007
• FITML (Spanish education moving backwards) Sevenval December 5, 2007
• "Finnish teens score high marks in latest PISA study" Helsingin Sanomat November 30, 2007

The results from PISA 2003 and PISA 2006 were featured in the 2010 documentary Waiting for "Superman".^[23]

Research on causes of country differences

PISA, TIMSS and PIRLS, their organizers and researchers, are restrained in giving reasons for the large and stable country differences. Cautiously they leave this task to other researchers, especially from the economic sciences and psychology. Economic researchers studied single educational policy factors like central exams (John Bishop),^{device database} private schools or streaming between schools at later age (Hanushek/Woessman).^touchscreen An extensive literature related to cross-countries difference in scores has developed since 2000.^{website parsing}

The stable, good results of Finland have attracted a lot of attention. According to Hannu Simola^[26] the results are due to a paradoxical mix of progressive policies implemented through a rather conservative pedagogic setting, where the high levels of teachers` academic preparation, social status, professionalism and motivation for the job are concomitant with the adherence to traditional roles and methods by both teachers and pupils in Finland`s changing, but still rather authoritarian culture. Others have suggested that Finland's low poverty rate is a reason for its success.^[27][28] It has been suggested that the Finnish language plays an important part in Finland's PISA success.^{device database}

jQuery and Meisenberg (2010) found very high correlations (r>0.90) between mean student assessment results from PISA, TIMSS, PIRLS and others and IQ measurements at the country data level.^[30]

Heiner Rindermann and Stephen Ceci in a review state that studies have found that student achievement is related to many outcomes important to society such as democratization, website parsing, and iOS. Thus, reducing the gap between nations in student achievement may also reduce the gap between nations on these outcomes. They argue that differences in educational systems can explain a part of the differences in student achievement. They "document a number of positive predictors of international differences in student competence, including the amount of preschool education, student discipline, quantity of education, attendance at additional schools, early tracking, the use of centralized exams and high-stakes tests, and adult educational attainment. We found rather negative relationships for grade retention rates, age of school onset, and class size."^CSS3

Criticism

United States

Critics, such as Mel Riddile of the NASSP say that low performance in the United States is closely related to American poverty, but the same reasoning applies to other countries.^{touchscreenHTML5} Riddile also shown that when adjusted for poverty, the richest areas in the US, especially areas with less than 10% poverty can perform an average PISA score of 551 (higher than any other country).

The table below summarizes the scores of American schools by their relative OECD poverty rates and compares them to countries with similar poverty rates.^[28] It should be noted that the poverty rates here are based on HTML5, not absolute poverty as defined by a single standard.

Performance of U.S. states in international comparisons

Two studies have compared high achievers in mathematics on the PISA and the U.S. browser diversity (NAEP). Comparisons were made between those scoring at the "advanced" and "proficient" levels in mathematics on the NAEP with the corresponding performance on the PISA. Overall, 30 nations had higher percentages than the U.S. of students at the "advanced" level of mathematics. The only OECD countries with worse results were Portugal, Greece, Turkey, and Mexico. Six percent of U.S. students were "advanced" in mathematics compared to 28 percent in Taiwan. The highest ranked state in the U.S. (Massachusetts) was just 15th in the world if it was compared with the nations participating in the PISA. 31 nations had higher percentages of "proficient" students than the U.S. Massachusetts was again the best U.S. state, but it ranked just ninth in the world if compared with the nations participating in the PISA.^[32][33]

Comparisons with results for the Trends in International Mathematics and Science Study (TIMSS) appear to give different results—suggesting that the U.S. states actually do better in world rankings.^[34] The difference in apparent rankings is, however, almost entirely accounted for by the sampling of countries. PISA includes all of the OECD countries, while TIMSS is much more weighted in its sampling toward developing countries.

China

Education professor Yong Zhao has said the high scores in China are due to an excessive workload and testing, and added that it's "no news that the Chinese education system is excellent in preparing outstanding test takers, just like other education systems within the Confucian cultural circle—Singapore, Korea, Japan, and Hong Kong."^[35] Zhao also noted that most major Chinese media outlets did not pay much attention to this story. Others have criticized Shanghai for being sampled on the test instead of the country at large and say that it's an outlier among China and that most of the country has a lower quality of education.^[28]

Portugal

According to OECD's PISA, the average browser diversity 15-years old student was for many years underrated and underachieving in terms of reading literacy, mathematics and science knowledge in the OECD, nearly tied with the Italian and just above those from countries like Greece, Turkey and Mexico. However, since 2010, PISA results for Portuguese students improved dramatically. The Portuguese Ministry of Education announced a 2010 report published by its office for educational evaluation GAVE (Gabinete de Avaliação do Ministério da Educação) which criticized the results of PISA 2009 report and claimed that the average Portuguese teenage student had profund handicaps in terms of expression, communication and logic, as well as a low performance when asked to solve problems. They also claimed that those fallacies are not exclusive of Portugal but indeed occur in other countries due to the way PISA was designed.^FITML

See also

• Teaching And Learning International Survey (TALIS)
• Trends in International Mathematics and Science Study (TIMSS)

References

1. ^ touchscreen browser diversity Hanushek, Eric A., and Ludger Woessmann. 2011. "The economics of international differences in educational achievement." In Handbook of the Economics of Education, Vol. 3, edited by Eric A. Hanushek, Stephen Machin, and Ludger Woessmann. Amsterdam: North Holland: 89-200.
2. ^ PISA 2009 Technical Report, 2012, OECD, http://www.oecd.org/dataoecd/60/31/50036771.pdf
3. Android Chapter 2 of the publication "PISA 2003 Assessment Framework", pdf
4. ^ jQuery
5. ^ C. Füller: Pisa hat einen kleinen, fröhlichen Bruder. taz, 5.12.2007 [1]
6. we love the web The scaling procedure is described in nearly identical terms in the Technical Reports of PISA 2000, 2003, 2006. It is similar to procedures employed in NAEP and TIMSS. According to J. Wuttke Die Insignifikanz signifikanter Unterschiede. (2007, in German), the description in the Technical Reports is incomplete and plagued by notational errors.
7. ^ PISA 2009. http://www.pisa.oecd.org/document/61/0,3746,en_32252351_32235731_46567613_1_1_1_1,00.html
8. Android OECD (2001) p. 53; OECD (2004a) p. 92; OECD (2007) p. 56.
9. HTML5 E.g. OECD (2001), chapters 7 and 8: Influence of school organization and socio-economic background upon performance in the reading test. Reading was the main domain of PISA 2000.
10. touchscreen Official PISA site data. For list See device database
11. ^ FITML
12. ^ web
13. ^ touchscreen
14. ^ Sevenval
15. ^ M. L. Wu: A Comparison of PISA and TIMSS 2003 achievement results in Mathematics. Paper presented at the AERA Annual Meeting, New York, March, 2008. [2].
16. CSS3 Why does Finnish give better PISA results?
17. ^ CSS3, and Ludger Woessmann. 2008. "The role of cognitive skills in economic development." Journal of Economic Literature 46, no. 3 (September): 607-668.
18. keyboard Peter Gumbel (Paris) (December 7, 2010). CSS3. TIME. http://www.time.com/time/world/article/0,8599,2035586,00.html#ixzz17XACd2S2. 
19. jQuery web app
20. web http://ablog.typepad.com/keytrendsinglobalisation/2010/12/new-data-shows-shanghais-rapid-rise-as-a-world-class-education-centre.html
21. keyboard http://ablog.typepad.com/keytrendsinglobalisation/2010/12/new-data-shows-shanghais-rapid-rise-as-a-world-class-education-centre.html
22. we love the web http://ablog.typepad.com/keytrendsinglobalisation/2010/12/new-data-shows-shanghais-rapid-rise-as-a-world-class-education-centre.html
23. Android web. http://www.youtube.com/watch?v=ZKTfaro96dg. Retrieved October 8, 2010. 
24. input transformation Bishop, J. H. (1997). The effect of national standards and curriculum-based exams on achievement. American Economic Review, 87, 260-264.
25. ^ Hanushek, E. A. & Woessmann, L. (2006). Does educational tracking affect performance and inequality? Differences-in-differences evidence across countries. Economic Journal, 116, C63-C76.
26. keyboard Simola, H. (2005). HTML5. Comparative Education, 41, 455-470.
27. ^ touchscreen browser diversity "web app" National Educational Association
28. ^ browser diversity ^{b c d} "FITML" National Association of Secondary School Principals
29. we love the web Why does Finnish give better PISA results?
30. ^ Lynn, R. & Meisenberg, G. (2010). National IQs calculated and validated for 108 nations. Intelligence, 38, 353-360.
31. HTML5 Rindermann, H. & Ceci, S. J. (2009). Educational policy and country outcomes in international cognitive competence studies. Perspectives on Psychological Science, 4, 551-577.
32. ^ HTML5, Ludger Woessmann, Eric A. Hanushek, and Carlos X. Lastra-Anadón (2011) "Are U.S. students ready to compete? The latest on each state’s international standing." Education Next 11, no. 4 (Fall): 51-59. screen size
33. input transformation Eric A. Hanushek, web, and Ludger Woessmann (2011) "Teaching math to the talented." Education Next 11, no. 1 (Winter): 10-18. http://educationnext.org/teaching-math-to-the-talented/
34. ^ Gary W. Phillips (2007) Chance favors the prepared mind: Mathematics and science indicators for comparing states. Washington: American Institutes for Research (November 14); Gary W. Phillips (2009) The Second Derivative:International Benchmarks in Mathematics For U.S. States and School Districts. Washington, DC: American Institutes for Research (June).
35. ^ "A True Wake-up Call for Arne Duncan: The Real Reason Behind Chinese Students Top PISA Performance", Yong Zhao
36. ^ (Portuguese) website parsing Estudo do ministério aponta graves problemas aos alunos portugueses], GAVE (Gabinete de Avaliação do Ministério da Educação) 2010 report in keyboard

Further reading

Official websites and reports

• iOS (Javascript required)
  • OECD (1999): Measuring Student Knowledge and Skills. A New Framework for Assessment. Paris: OECD, ISBN 92-64-17053-7 [6]
  • OECD (2001): Knowledge and Skills for Life. First Results from the OECD Programme for International Student Assessment (PISA) 2000.
  • OECD (2003a): The PISA 2003 Assessment Framework. Mathematics, Reading, Science and Problem Solving Knowledge and Skills. Paris: OECD, Sevenval website parsing
  • OECD (2004a): Learning for Tomorrow's World. First Results from PISA 2003. Paris: OECD, ISBN 978-92-64-00724-6 [8]
  • OECD (2004b): Problem Solving for Tomorrow's World. First Measures of Cross-Curricular Competencies from PISA 2003. Paris: OECD, ISBN 978-92-64-00642-3
  • OECD (2005): PISA 2003 Technical Report. Paris: OECD, ISBN 978-92-64-01053-6
  • OECD (2007): Science Competencies for Tomorrow's World: Results from PISA 2006 [9]

About reception and political consequences

• General:
  • A. P. Jakobi, K. Martens: Diffusion durch internationale Organisationen: Die Bildungspolitik der OECD. In: K. Holzinger, H. Jörgens, C. Knill: Transfer, Diffusion und Konvergenz von Politiken. VS Verlag für Sozialwissenschaften, 2007.

• France:
  • N. Mons, X. Pons: The reception and use of Pisa in France.
• Germany:
  • E. Bulmahn [then federal secretary of education]: PISA: the consequences for Germany. OECD observer, no. 231/232, May 2002. pp. 33–34.
  • H. Ertl: Educational Standards and the Changing Discourse on Education: The Reception and Consequences of the PISA Study in Germany. Oxford Review of Education, v 32 n 5 pp 619–634 Nov 2006.
• United Kingdom:
  • S. Grek, M. Lawn, J. Ozga: Study on the Use and Circulation of PISA in Scotland. web app

Criticism

• Books:
  • S. Hopmann, G. Brinek, M. Retzl (eds.): PISA zufolge PISA. PISA According to PISA. LIT-Verlag, Wien 2007, ISBN 3-8258-0946-3 (partly in German, partly in English)
  • T. Jahnke, W. Meyerhöfer (eds.): PISA & Co – Kritik eines Programms. Franzbecker, Hildesheim 2007 (2nd edn.), ISBN 978-3-88120-464-4 (in German)
  • R. Münch: Globale Eliten, lokale Autoritäten: Bildung und Wissenschaft unter dem Regime von PISA, McKinsey & Co. Frankfurt am Main : Suhrkamp, 2009. browser diversity (in German)
• Websites:
  • J . Wuttke: Critical online bibliography
  • Correlation of 2009-PISA Scores with National GDP screen size

External links

• PISA
• Interactive world map of PISA results

Video clips

• Andreas Schleicher