Graphic: ANA mathematics results over three years. Note that experts say year-to-year results are not comparable.
South Africa’s major teachers’ unions and the Department of Basic Education agree: standardised testing can be a useful tool to measure the progress and gaps in a country’s education. But they don’t agree on the current format of the tests.
Launched in 2011, the annual national assessments (ANAs) were designed to measure and track the literacy and numeracy skills of learners in Grade 1 to 9 — with the aim of diagnosing areas of weakness and providing the Department of Basic Education and teachers with insights that could be used to craft remedial interventions.
But the teachers’ unions say the ANAs are not achieving their intended purpose: measuring the health of the education system and assessing whether there’s an improvement from year to year.
This is why five teachers’ unions have vowed not to administer the tests this year, scheduled for 1 to 4 December— a date set by the department without consulting teachers’ unions. The department, on the other hand, maintains that the tests will go ahead as planned.
GroundUp asked two academic experts and a leader of a teachers’ union to share their views on how they think the ANAs could be remodelled.
Nick Taylor: ANAs should be administered by an independent agency
Dr Nick Taylor, research fellow at JET Education Services, is one of South Africa’s foremost education experts. Taylor argues that for the ANAs to be an effective mechanism to track progress in the country’s education system, they need to be administered independently. The ANAs currently face a legitimacy problem: they are set, marked and reported on by the Department of Basic Education.
Taylor suggests that an independent agency — working with the department — could help design, administer and report on the results. This would lessen the administration burden the tests place on the teachers, and would also help promote the integrity and independence of the testing process.
“Not only will this provide for a more reliable measure of how the system is doing, it will also increase public confidence in the results. The last two ANA reports stated that scores are not comparable from year to year, but nevertheless claim to have achieved major gains,” says Taylor. “These contradictions seriously undermine the integrity of the results in the eyes of the expert community and the public in general.”
Taylor is also convinced that not all learners in the country, from Grade 1 to 9, need to take the tests. He suggests a national sample of schools — that is representative — that will help to drastically reduce the costs of the tests.
Mellony Graven: ANAs need to inform teachers about the levels of mathematical competence, not only performance.
Based at Rhodes University, Professor Mellony Graven chairs the South African Numeracy Project, a research initiative aimed at improving mathematics education in the country.
While the department reported an improvement in the national average mathematics results in 2014 for Grade 1 to 5, it was the Grade 9 results that were a shocker. In 2014, the national average for Grade 9 mathematics results registered 11% — the lowest since the tests were first introduced. (Results for Grade 7 and 8 were excluded from the department’s report.)
In its report on the 2014 ANA results, the department acknowledged that the performance in mathematics at Grade 9 level had dropped in almost all districts in the country.
Graven says the ANAs in their current form are not detailed enough to help teachers and the department craft remedial interventions that will help learners struggling with mathematics.
“A national average of 11% for Grade 9 mathematics is not helpful to teachers or learners. The ANAs should be designed to point out the level at which teachers need to begin remediation work with learners. The current ANAs only assess at the particular grade level focusing on curriculum coverage at that grade level, whereas I think they would be more useful as a diagnostic assessment indicating the levels (from previous grades) that learners are operating at,” said Graven.
Basil Manuel: Graded testing — conducted over a period of time — can help better track the progress of learners
Basil Manuel is president of the National Professional Teachers’ Association of South Africa, one of the five unions that have come out strongly against the current format of the tests.
Manuel suggests the tests could be written at the exit points of the various phases in South Africa’s education system – Grade 3, 6 and 9 – as opposed to Grade 1 to 9.
One of the limitations of the ANAs currently, according to Manuel, is that they don’t track the progress of the learners over time. Learners move from one grade to another, writing the tests each year, without their cumulative knowledge being properly assessed.
“You cannot measure progress of the education system if the learner’s progress isn’t tracked over time,” says Manuel.
Manuel gives the following example: “If you’re testing a 10-year old in maths, who is in Grade 3 this year, you would ask her to do a long-division with a three-digit sum for her year’s test. The following year, when she is in Grade 4, you would then proceed to ask her to do a long-division sum with four-digits to track her grasp of the concept with an added layer of complexity. This will help indicate whether she’s progressed or not over the past year.” DM
Photo: Children write notes from a makeshift black board at a school in Mwezeni village in South Africa’s Eastern Cape Province in this picture taken June 5, 2012. REUTERS/Ryan Gray.
In other news...
South Africa is in a very real battle. A political fight where terms such as truth and democracy can seem more of a suggestion as opposed to a necessity.
On one side of the battle are those openly willing to undermine the sovereignty of a democratic society, completely disregarding the weight and power of the oaths declared when they took office. If their mission was to decrease society’s trust in government - mission accomplished.
And on the other side are those who believe in the ethos of a country whose constitution was once declared the most progressive in the world. The hope that truth, justice and accountability in politics, business and society is not simply fairy tale dust sprinkled in great electoral speeches; but rather a cause that needs to be intentionally acted upon every day.
However, it would be an offensive oversight not to acknowledge that right there on the front lines, alongside whistleblowers and civil society, stand the journalists. Armed with only their determination to inform society and defend the truth, caught in the crossfire of shots fired from both sides.
If you believe in supporting the cause and the work of Daily Maverick then take your position on the battleground and sign up to Maverick Insider today.
For whatever amount you choose, you can support Daily Maverick and it only takes a minute.
Green screens are green because the colour does not match any natural skin tone of an actor.