Indian Engineering Students Perform Poorly on International Assessment Tests

The results of a test called "Supertest", developed by researchers from the US, China, Russia and India,, show that Indian engineering students perform very poorly relative to their  peers in other countries. Supertest is the first study to track the progress of students in computer science and electrical engineering over the course of their studies with regard to their abilities in physics, mathematics and critical thinking and compare the results among four countries.  

Supertest was initiated by Stanford University, HSE University Moscow, the Educational Testing Service (ETS), and partner universities in China and India, according to Phys.org.  Here's an excerpt of the article in journal that explains the test:

"More than 30,000 undergraduate students participated in the study. The researchers collected a sample of students from elite and large universities, roughly equal in number for each country. In Russia, the sample included students from six Project 5-100 universities and 28 other universities. Their skill development was measured three times: upon entering university, at the end of their second year, and at the end of their studies........Russian engineering students outperform Indian students while performing lower than Chinese students. In terms of developing these skills over the course of their studies, students of all three countries perform lower than students in the United States. "We found that, as the students progress in their studies, their critical thinking skills remain approximately the same in Russia and India, but significantly decrease in China. On the contrary, American students show improvement," said Igor Chirikov. This is a serious problem, the researchers note, because technologies change rapidly, and in order to be able to master new ones, you need not only a firm grasp of the subject area, but, above all, skills of the 21st century".

Earlier testing of Indian students on international assessment tests has also shown that they rank near the bottom on PISA, a global test of learning standards conducted in 74 nations in 2011.  TIMSS, another standardized international test, produced similar results earlier in 2003.


The year 2011 was the first time that Indian students participated in PISA. Students from Himachal Pradesh and Tamil Nadu took the Program for International Student Assessment (PISA) test, coordinated by the Paris-based Organization for Economic Co-operation and Development (OECD). Prior to this participation, students from Indian states of Orissa and Rajasthan took a similar test called Trends in International Mathematics and Science Study (TIMSS) in 2003.

Tamil Nadu and Himachal Pradesh rank high on human development indicators among Indian states. The India Human Development Report 2011, prepared by the Institute of Applied Manpower Research (IAMR), categorized them as “median” states, putting them significantly ahead of the national average. IAMR is an autonomous arm of India's Planning Commission.



Himachal Pradesh ranked 4 and Tamil Nadu 11 in literacy rates on India's National Family Health Survey released in 2007. However, in the PISA study, Tamil Nadu ranked 72 and Himachal Pradesh 73, just ahead of the bottom-ranked Kyrgyzstan in mathematics and overall reading skills. Shanghai, China's biggest city, topped the PISA rankings in all three categories—overall reading skills, mathematical and scientific literacy. The new entrants included Costa Rica, Georgia, India (Himachal Pradesh & Tamil Nadu), Malaysia, Malta, Mauritius, Venezuela (Miranda), Moldova, United Arab Emirates. PISA 2009+ involved testing just over 46 000 students across these ten economies, representing a total of about 1,377,000 15-year-olds.


In Tamil Nadu, only 17% of students were estimated to possess proficiency in reading that is at or above the baseline needed to be effective and productive in life. In Himachal Pradesh, this level is 11%. “This compares to 81% of students performing at or above the baseline level in reading in the OECD countries, on an average,” said the study.

The average Indian child taking part in PISA2009+ is 40 to 50 points behind the worst students in the economic superstars. Even the best performers in Tamil Nadu and Himachal Pradesh - the top 5 percent who India will need in science and technology to complete globally - were almost 100 points behind the average child in Singapore and 83 points behind the average Korean - and a staggering 250 points behind the best in the best.

The average child in HP & TN is right at the level of the worst OECD or American students (only 1.5 or 7.5 points ahead). Contrary to President Obama's oft-expressed concerns about American students ability to compete with their Indian counterparts, the average 15-year-old Indian placed in an American school would be among the weakest students in the classroom, says Lant Pritchett of Harvard University. Even the best TN/HP students are 24 points behind the average American 15 year old.

The 2003 TIMSS study ranked India at 46 among 51 countries. Indian students' score was 392 versus average of 467 for the group. These results were contained in a Harvard University report titled "India Shining and Bharat Drowning".

These results are not only a wake-up call for the Hindutva brigade, but also raise serious questions about the credibility of India's western cheerleaders like Indian-American journalist Fareed Zakaria and New York Times' columnist Tom Friedman.

Children Who Can Not Read by Age 10. Source: World Bank via Economist


A World Bank report on student learning in South Asia is also depressing. Sri Lanka is the sole exception to the overall low levels of achievement for primary and secondary school kids in the region.  The report documents with ample data from various assessments to conclude that "learning outcomes and the average level of skill acquisition in the region are low in both absolute and relative terms". The report covers education from primary through upper secondary schools.

Source: World Bank Report on Education in South Asia 2014

Buried inside the bad news is a glimmer of what could be considered hope for Pakistan's grade 5 and 8 students outperforming their counterparts in India. While 72% of Pakistan's 8th graders can do simple division, the comparable figure for Indian 8th graders is just 57%. Among 5th graders, 63% of Pakistanis and 73% of Indians CAN NOT divide a 3 digit number by a single digit number, according to the World Bank report titled "Student Learning in South Asia: Challenges, Opportunities, and Policy Priorities".  The performance edge of Pakistani kids  over their Indian counterparts is particularly noticeable in rural areas. The report also shows that Pakistani children do better than Indian children in reading ability.

Source: World Bank Report on Education in South Asia 2014


Here are some excepts from the World Bank report:

Unfortunately, although more children are in school, the region still has a major learning challenge in that the children are not acquiring basic skills. For example, only 50 percent of grade 3 students in Punjab, Pakistan, have a complete grasp of grade 1 mathematics (Andrabi et al. 2007). In India, on a test of reading comprehension administered to grade 5 students across the country, only 46 percent were able to correctly identify the cause of an event, and only a third of the students could compute the difference between two decimal numbers (NCERT 2011). Another recent study found that about 43 percent of grade 8 students could not solve a simple division problem. Even recognition of two-digit numbers, supposed to be taught in grade 2, is often not achieved until grade 4 or 5 (Pratham 2011). In Bangladesh, only 25 percent of fifth-grade students have mastered Bangla and 33 percent have mastered the mathematics competencies specified in the national curriculum (World Bank 2013). In the current environment, there is little evidence that learning outcomes will improve by simply increasing school inputs in a business-as-usual manner (Muralidharan and Zieleniak 2012).


Source: The Hindu

In rural Pakistan, the Annual State of Education Report (ASER) 2011 assessment suggests, arithmetic competency is very low in absolute terms. For instance, only 37 percent of grade 5 students can divide three-digit numbers by a single-digit number (and only 27 percent in India); and 28 percent of grade 8 students cannot perform simple division. Unlike in rural India, however, in rural Pakistan recognition of two-digit numbers is widespread by grade 3 (SAFED 2012). The Learning and Educational Achievement in Punjab Schools (LEAPS) survey—a 2003 assessment of 12,000 children in grade 3 in the province—also found that children were performing significantly below curricular standards (Andrabi et al. 2007). Most could not answer simple math questions, and many children finished grade 3 unable to perform mathematical operations covered in the grade 1 curriculum. A 2009 assessment of 40,000 grade 4 students in the province of Sindh similarly found that while 74 percent of students could add two numbers, only 49 percent could subtract two numbers (PEACE 2010).


Source: World Bank Report on Education in South Asia 2014




The report relies upon numerous sources of data, among them key government data (such as Bangladesh’s Directorate of Primary Education; India’s National Sample Survey, District Information System of Education, and National Council of Education Research and Training Assessment; and Pakistan’s National Education Assessment System); data from nongovernmental entities (such as Pakistan’s Annual Status of Education Report, India’s Student Learning Study, and its Annual Status of Education Report); international agencies (such as the Organisation for Economic Co-operation and Development [OECD] Programme for International Student Assessment [PISA] 2009+ for India; the World Bank Secondary Education Quality and Access Enhancement Project in Bangladesh); and qualitative studies undertaken for the report (such as examining decentralization reforms in Sri Lanka and Pakistan). The study also uses the World Bank Systems Approach for Better Education Results (SABER) framework to examine issues related to ECD, education finance, assessment systems, and teacher policies.

I hope that these reports serve as a wake-up call for political leaders and policymakers in South Asia to redouble their efforts with significant additional resource allocations of nutrition, education and healthcare.

Related Links:

Haq's Musings

South Asia Investor Review

Who's Better for Pakistan Human Development?

History of Literacy in Pakistan

Myths and Facts About Out-of-School Children in Pakistan

PISA, TIMSS Results Confirm Low Quality of Indian Education

India Shining, Bharat Drowning

Learning Levels and Gaps in Pakistan by Jishnu Das and Priyanka Pandey

Pasi Sahlberg on why Finland leads the world in education

CNN's Fixing Education in America-Fareed Zakaria

PISA's Scores 2011

Poor Quality of Education in South Asia

Infections Cause Low IQs in South Asia, Africa?

Peepli Live Destroys Western Myths About India

Learning Levels and Gaps in Pakistan by Jishnu Das and Priyanka Pandey

Pasi Sahlberg on why Finland leads the world in education

CNN's Fixing Education in America-Fareed Zakaria

PISA's Scores 2011

Poor Quality of Education in South Asia

Infections Cause Low IQs in South Asia, Africa?

Peepli Live Destroys Western Myths About India

PISA 2009Plus Results Report

Comments

Riaz Haq said…
#Indian-descent #Americans are taking over #US, jokes Biden. #Biden's remarks are being described as "head-turning" and "tone-deaf". He told #NASA's Mars Project Manager Swati Mohan: "We (in US) give people an opportunity to let their dreams run forward" http://toi.in/7kwWGZ/a24gk


Swati Mohan came to the United States when she was just one year old and grew up and studied in America.
Riaz Haq said…
Cambridge International students excel in top Pakistan university entrance tests

https://www.cambridgeinternational.org/news/news-details/view/cambridge-international-students-excel-in-top-pakistan-university-entrance-tests-20210202/


Results from entrance tests at three top Pakistan universities have revealed that Cambridge International students perform exceptionally well and secure places on the courses they want to study at university.

Recent newspaper reports in Pakistan revealed the results of the competitive entrance tests for NED, Dawood and Karachi Universities, which students took between October and December 2020. They found almost 80% of Cambridge students passed the entrance tests for NED and Karachi Universities, and that rose to 100% pass rate, for Cambridge students sitting the Dawood University tests.

The results published by the universities themselves showed, of the 9,290 students taking the NED University entrance test exam, 54% could pass the test. Out of these, 552 were Cambridge students, and of those 78% passed the test.

The results were similar for Cambridge students sitting the Karachi University test. A total of 8,983 students took the test, of which almost 30% passed it. This pass rate rose to 80% when looking at the results of just the Cambridge students who took the test.

And in the Dawood University entrance test results, all 22 Cambridge students passed. The overall pass rate of the 2,809 students taking the test was just over 60%.

The results confirm that Cambridge qualifications, particularly Cambridge International AS and A Level, are good preparation for higher education, equipping students with the skills and knowledge they need to succeed at university and in their future careers.

It is also very encouraging to see that Cambridge students are doing so well in the highly competitive local universities entrance tests, as about 90% of Cambridge students in Pakistan go to local universities for higher studies.

To ensure the impacts of Covid-19, do not prevent Cambridge students from pursuing their further education plans, we have been working closely with the Federal Ministry of Education and Training in Pakistan. Together we have provided students with the help and support they need to enable them to progress with their education as planned. Subsequently, the Inter Board Committee of Chairmen (IBCC) confirmed that grades from the Cambridge International’s June 2020 series would be accepted by Pakistan universities in the same way as those from other exam series.

Cambridge International programmes help students to broaden their outlook, build life-long skills and instil principles and values deemed vital to help them succeed in further education and their future careers. Our programmes encourage learners to become confident, responsible, reflective, innovative, and engaged. Our curriculum and assessments are designed with these learner attributes in mind.
Riaz Haq said…
Speaking at the inaugural event of the new Infosys Science Foundation (ISF) building in Bengaluru Thursday, founder of Infosys Ltd Narayana Murthy stressed on the need to offer innovative and affordable solutions in science, mathematics and engineering to solve India’s “grand problems”.

https://indianexpress.com/article/india/india-still-a-long-way-from-solving-problems-related-to-education-healthcare-nutrition-narayana-murthy-8029873/

“Our country is making scientific and engineering progress. We have sent rockets and satellites into space, built dams, steel plants and have produced Covid vaccines. However, we are still a long way off from solving our grand problems of education, healthcare, nutrition and shelter for every one of our 1.4 billion Indians,” he said.

He added, “As people interested in science, mathematics and engineering, we must think about how they can solve our grand problems. The need of the day is for us to use the power of the human mind to find quick, innovative and affordable solutions to these and other major problems that our country is facing.” He added, science is a “front-line warrior” against solving the grand problems.

The ISF, which opened its physical space in the city Thursday, aims to facilitate opportunities for science enthusiasts, start-ups, companies, industrialists and students to exchange ideas and congregate to deliver science related speeches, presentations, workshops that addresses a larger social issue.

Kris Gopalakrishnan, the co-founder of Infosys, said, “Not many are utilising the advantage of Bengaluru’s capabilities in terms of tapping into deep technology and using the public spaces to exchange ideas. ISF wants to bring in the collaborative culture to utilise science and technology and work together in a public space. I also feel that we need to invest more money in research, wherein we need to increase spending from 0.7% of GDP to 3% of the GDP.”

ISF is also a foundation that gives the Infosys Prize to Indian scientists and scholars working on path breaking research in categories like engineering, computer science, mathematical sciences, social sciences, life sciences, physical sciences and humanities.

The inaugural event also featured a panel of students at various stages of their education and research careers who spoke about their aspirations and experiences in the greater Indian research landscape. A panel comprising Arundhati Ghosh (Executive Director, India Foundation for the Arts), Jahnavi Phalkey (Founding Director, Science Gallery Bengaluru), and V Ravichandar (Honorary Director, Bangalore International Centre) also discussed the importance of public spaces in enabling arts and sciences.
Riaz Haq said…
Infosys founder NR Narayana Murthy says IITs have become victims to rote learning due to coaching classes


https://www.timesnownews.com/business-economy/companies/infosys-founder-nr-narayana-murthy-says-iits-have-become-victims-to-rote-learning-due-to-coaching-classes-article-95545869

As more and more students leave India for higher studies, Infosys founder Narayana Murthy proposed that governments and corporates should “incentivise” researchers with grants and provide facilities to work here. “The 10,000 crore per year grants for universities under the New Education Policy will help institutions become competitive", he said.


https://youtu.be/2vzSwExIoNg

Infosys founder NR Narayana Murthy on Tuesday expressed concern over India’s education system saying that even the IITs are becoming a victim of learning by rote due to the “tyranny of coaching classes.” Murthy suggested that our education system needs a reorientation directed towards Socratic questioning.
The Infosys founder, who himself is an IIT alumnus, batted for Socratic questioning in the classroom in order to arrive at solutions to real-world issues. “Many experts feel that (in) our country, (there is an) inability to use research to solve our immediate pressing problems around us… (this) is due to lack of inculcating curiosity at an early age, disconnect between pure or applied research," he said.

As to what could be done to solve this, the 76-year-old suggested that the first component is to reorient teaching in schools and colleges towards Socratic questioning in the classroom to solve real-world problems rather than passing the examinations by rote learning. Socrates was a fifth century (BCE) Greek philosopher credited as the founder of Western philosophy.
Speaking at the 14th edition of the Infosys Prize event in Bengaluru, Murthy said that the nation’s progress on the economic and social front depends on the quality of scientific and technological research. Research thrives in an environment of honour and respect for intellectuals, meritocracy and the support and approbation of such intellectuals from society, he noted.

Riaz Haq said…
Education system leading India down the hole - The Hans India
https://www.thehansindia.com/hans/opinion/news-analysis/education-system-leading-india-down-the-hole-692943
Jun 28, 2021 — India was placed at 59th rank among 64 countries in education. They have also said that youth unemployment increased from 10.4 percent to 23.0 ...


Learning poverty: Education crisis in India - Sentinelassam
https://www.sentinelassam.com/editorial/learning-poverty-education-crisis-in-india-569438


Revamp of Indian learning needed, says Narayana Murthy
https://economictimes.indiatimes.com/tech/information-tech/infosys-founder-narayana-murthy-bats-for-revamp-of-indian-education-system/articleshow/95528265.cms
Nov 15, 2022 — A reorientation of the Indian education system is needed which is more directed towards Socratic questioning other than just rote learning, according to Infosys Founder NR Narayana Murthy.

"The first component is to reorient our teaching in schools and colleges towards Socratic questioning, in the classroom to solve real world problems around them rather than passing the examinations by rote learning," said Murthy while speaking at the Infosys Prize announcement event in Bengaluru.

"Even our top institutions have become victims of this syndrome. Thanks to the tyranny of coaching classes," he said.
Riaz Haq said…
Over 50% of #India's children can not read by age 10. Can India educate its vast workforce? #Education for most Indians is still at best unskilled. #Unemployed youngsters risk bringing India’s #economic development to a premature stop. #Modi #BJP https://www.economist.com/leaders/2023/06/29/can-india-educate-its-vast-workforce

https://twitter.com/haqsmusings/status/1674441854136512513?s=20

As the rich world and China grow older, India’s huge youth bulge—some 500m of its people are under 20—should be an additional propellant. Yet as we report, although India’s brainy elite hoovers up qualifications, education for most Indians is still a bustUnskilled, jobless youngsters risk bringing India’s economic development to a premature stop.

India has made some strides in improving the provision of services to poor people. Government digital schemes have simplified access to banking and the distribution of welfare payments. Regarding education, there has been a splurge on infrastructure. A decade ago only a third of government schools had handwashing facilities and only about half had electricity; now around 90% have both. Since 2014 India has opened nearly 400 universities. Enrolment in higher education has risen by a fifth.

Yet improving school buildings and expanding places only gets you so far. India is still doing a terrible job of making sure that the youngsters who throng its classrooms pick up essential skills. Before the pandemic less than half of India’s ten-year-olds could read a simple story, even though most of them had spent years sitting obediently behind school desks (the share in America was 96%). School closures that lasted more than two years have since made this worse.

There are lots of explanations. Jam-packed curriculums afford too little time for basic lessons in maths and literacy. Children who fail to grasp these never learn much else. Teachers are poorly trained and badly supervised: one big survey of rural schools found a quarter of staff were absent. Officials sometimes hand teachers unrelated duties, from administering elections to policing social-distancing rules during the pandemic.

Such problems have led many families to send their children to private schools instead. These educate about 50% of all India’s children. They are impressively frugal, but do not often produce better results. Recently, there have been hopes that the country’s technology industry might revolutionise education. Yet relying on it alone is risky. In recent weeks India’s biggest ed-tech firm, Byju’s, which says it educates over 150m people worldwide and was once worth $22bn, has seen its valuation slashed because of financial troubles.

All this makes fixing government schools even more urgent. India should spend more on education. Last year the outlays were just 2.9% of gdp, low by international standards. But it also needs to reform how the system works by taking inspiration from models elsewhere in developing Asia.

As we report, in international tests pupils in Vietnam have been trouncing youngsters from much richer countries for a decade. Vietnam’s children spend less time in lessons than Indian ones, even when you count homework and other cramming. They also put up with larger classes. The difference is that Vietnam’s teachers are better prepared, more experienced and more likely to be held accountable if their pupils flunk.

With the right leadership, India could follow. It should start by collecting better information about how much pupils are actually learning. That would require politicians to stop disputing data that do not show their policies in a good light. And the ruling Bharatiya Janata Party should also stop trying to strip textbooks of ideas such as evolution, or of history that irks Hindu nativists. That is a poisonous distraction from the real problems. India is busy constructing roads, tech campuses, airports and factories. It needs to build up its human capital, too.
Riaz Haq said…
The State of Global
Learning Poverty:
2022 Update


CONFERENCE EDITION
June 23, 2022

Annex 5: Detailed 2019 country learning poverty data

Country Name Learning Poverty Learning Deprivation Schooling Deprivation Year Assessment Assessment


Iceland 9.3 6.8 2.7 2006 PIRLS
India 56.1 53.7 5.1 2017 NLA
Indonesia 52.8 49.4 6.8 2015 TIMSS
Iran, Islamic Rep 35.2 35.1 0.2 2016 PIRLS


Norway 6.0 5.8 0.2 2016 PIRLS
Oman 41.8 40.9 1.4 2016 PIRLS
Pakistan 77.0 65.0 34.2 2014 NLA

https://thedocs.worldbank.org/en/doc/e52f55322528903b27f1b7e61238e416-0200022022/original/Learning-poverty-report-2022-06-21-final-V7-0-conferenceEdition.pdf

Popular posts from this blog

Pakistani Women's Growing Particpation in Workforce

Project Azm: Pakistan to Develop 5th Generation Fighter Plane

Pakistan's Saadia Zahidi Leads World Economic Forum's Gender Parity Effort