Pakistan's MCQ Dependency: A Flawed Measure of Competence
Pakistan's MCQ Dependency: A Flawed Measure of Competence

Pakistan's relationship with the multiple-choice question (MCQ) is long, deep, and largely unexamined. From school board exams to civil service selection, from university admission to professional licensing, the MCQ has become the state's instrument of first and often last resort. The recently introduced Higher Education Aptitude Test (HAT), launched by the Higher Education Commission (HEC) through its own Education Testing Council, was presented as a modernization of graduate selection. In practice, it is a rebranding. HAT replaced GAT General and GAT Subject, tests that had governed MS, MPhil, and PhD admissions for over a decade. The format is almost identical: 100 multiple-choice questions, 120 minutes, and a single score that determines access to postgraduate education and HEC scholarships. The institution changed; the instrument did not. That distinction matters because the instrument is precisely what needs to change.

The Genuine Problem HEC Faces

The problem HEC is trying to solve is genuine. Studies indicate that over 32% of young graduates remain unemployed, with postgraduate degree holders among the most affected. Pakistan's higher education sector includes hundreds of HEC-recognized universities and degree-awarding institutions, and HEC's annual reporting shows graduate output in the tens of thousands each year. Yet, employer after employer reports that degree transcripts are poor predictors of workplace performance. Graduate unemployment in Pakistan runs at nearly three times the national average, and the country ranks 63rd out of 163 on the University-Industry Linkages Index, behind India at 26th and Sri Lanka at 53rd. A better filter between education and employment is not just defensible; it is necessary. The question is whether 100 MCQs constitute that filter or merely simulate one.

Research on MCQ Limitations

Research on what MCQs can and cannot measure is fairly settled. A 2023 study of university faculty across disciplines found that MCQs are capable of testing cognition at the "apply" and "analyse" levels of Bloom's taxonomy, but that their adoption is driven primarily by the practicality of assessing large cohorts, not by evidence of effectiveness at higher cognitive levels. More troublingly, the study found that high-stakes MCQ exams exert a powerful backwash effect on the curriculum: once such an exam exists, teaching narrows to match it, and changing assessment becomes structurally difficult. This is not a minor side effect. It is the mechanism by which a test reshapes an entire educational system, quietly, over the years.

Wide Pickt banner — collaborative shopping lists app for Telegram, phone mockup with grocery list

The Coaching Industry

The coaching industry is where this mechanism becomes visible. Across Pakistan, a thriving market of MCQ preparation academies, test-series providers, and online platforms has grown up around PPSC, FPSC, NTS, GAT, and now HAT. These businesses exist because the tests are learnable, not because the underlying competence is teachable, but because the test format rewards pattern recognition and examination tactics. A candidate who memorizes past papers and practices answer elimination is not building the skills a graduate program or employer needs. They are learning to pass a specific type of test. When a state runs this system at scale, from matriculation to civil service selection, it does not merely assess a generation. It trains one in the wrong direction.

The National Skills Competency Test

The National Skills Competency Test (NSCT) for computing graduates makes this problem acute. Fifty thousand CS graduates enter Pakistan's labor market every year. What serious technology employers, domestic or international, test for is not the recall of definitions. GitHub, Google, and virtually every credible technology company screen candidates through live coding exercises, system-design problems, and take-home projects precisely because those instruments reveal something that multiple-choice questions cannot: whether a person can actually build, debug, and reason about software. An NSCT that consists entirely of objective questions tells an employer almost nothing that a transcript does not already tell them. It produces a score where a portfolio would produce evidence.

Pickt after-article banner — collaborative shopping lists app with family illustration

Civil Service Testing Gaps

Pakistan's civil service testing exhibits the same gap. The CSS examination retains written papers, a partial concession to the limits of MCQs, but the MCQ-based Preliminary Test functions as the dominant funnel, determining who reaches the written stage and therefore shaping what aspirants spend most of their preparation time on. Compare this to the UK Civil Service Fast Stream, which uses written analysis exercises, inbox simulations, and structured competency interviews as primary instruments, or to Singapore's Public Service Commission, which combines analytical writing, psychological assessment, and behavioral interviews. India's UPSC insists on essay papers and an extended interview panel because it understands that what an officer needs cannot be assessed through options A to D.

The Needed Reform

The reform Pakistan needs is not radical. It is layered. MCQs may remain as a first-stage screen; there is legitimate value in efficiently eliminating candidates who lack basic domain knowledge. But that screen should be the beginning of the assessment, not the end of it. For HAT and postgraduate admissions, analytical writing sections are standard in comparable international tests and require no exotic infrastructure. For the NSCT, coding tasks and debugging exercises can be delivered through the same computer-based platform HEC already uses. For FPSC and PPSC, written analysis components and structured interviews, which the CSS process already includes, should be extended into general recruitment rather than reserved for the elite tier. None of this requires abandoning standardization. It requires accepting that standardization through MCQs alone is not rigor; it is a shortcut that has been mistaken for one.

With roughly 63% of Pakistan's 240 million population under the age of 30, the cost of getting this wrong compounds every year. A generation trained to select correct answers rather than produce original ones will struggle to build industries, staff capable institutions, or generate the research and innovation a developing economy requires. HEC's recognition that degrees alone are no longer reliable signals is the right starting point. But awareness expressed as a rebranded MCQ test is not reform. It is an administration. Pakistan does not need a new name for the same instrument. It needs a genuine answer to the question it keeps refusing to ask: what does competence actually look like, and are we actually testing for it?