National phonics testing

How the national phonics test is failing England and why it will fail Australia too

A national test of phonics skills will not improve faltering literacy standards in Australia. The test is being imported from England where it has been in place since 2011. It has failed to improve national standards in reading in England. Instead the phonics frenzy of testing and practicing nonsense words that has accompanied the implementation of the test appears to be narrowing classroom practice and damaging literacy standards.

The test itself is ill conceived and poorly structured. Should we wish to test the phonological awareness of our six year olds this test would be inadequate.

So how did we end up even considering the test for Australian children? The process that led to this test being recommended for all Australian six year olds was deeply flawed and is an unfortunate example of the growing influence of ultra-conservative think tanks on educational policy.

What is the phonics screening check?

The phonics screening check is a test devised in England. It is conducted one on one with Year 1 students (typically aged 6). The children are presented with 40 decodable words. Twenty are pseudo words that are indicated as such by an accompanying alien icon. The other 20 are real words, but ideally unknown to the students.

The rationale is that this is a test of pure phonic knowledge, not vocabulary or sight word knowledge. Students need to score 32 from 40 to pass the Check. Those who don’t pass are given intervention using a government mandated synthetic phonics program.

Why was the check recommended and who was involved?

Jennifer Buckingham from the conservative think tank, the Centre for Independent Studies, was appointed to chair the panel that was tasked with conducting an independent review of the need for Year 1 Literacy and Numeracy checks.

Dr Buckingham was a public advocate for England’s Phonic Screening Check before she was appointed to head the review and write the report. And she continued to publicly advocate for the Check whilst conducting the review, and before the review’s final report was released. So the report’s findings were not surprising.

What was surprising was the report’s lack of reference to any of the peer reviewed research studies that have been conducted on the Phonics Screening Check since its introduction in England.

A review of that research finds little value in the Phonics Screening Check.

The phonics check is not helping England; in fact England is going backwards

The Check is not improving reading comprehension scores in England. This year’s literacy test results are disturbing.

Scores on the phonics screening check do not correlate with scores in reading comprehension tests as measured by England’s national SAT reading tests in Year 2 and Year 6.

In 2016, 91% of Year 1 students passed the Phonics Screening Check. This was lauded as evidence the Check was working because it was forcing teachers to focus on phonics, and therefore students were passing the Check at higher rates than ever before.

In 2017 these ‘successful’ phonics-ready students sat their Year 2 Key Stage 1 reading comprehension test. To pass this reading comprehension test, children only had to score 25 from 40 questions. However, only 76% passed. And only 61% of low SES students passed the test.

It appears then that being poor has more to do with your reading comprehension achievement than knowing your sounds.

It also seems the phonics check hasn’t solved the gender puzzle in reading achievement, as girls consistently outperform boys on both the phonics check (by 7 percentage points in 2017) and the reading comprehension tests (by 9 percentage points in 2017).

Again in 2017, Year 6 children sat the Key Stage 2 Reading comprehension test. These are children who sat the Phonics Screening Check in 2011. Those who didn’t pass were placed in synthetic phonics programs mandated by the English Department of Education, until they passed the Check. Yet, this year, only 71% reached the minimum benchmark in their Year 6 reading comprehension test.

Thus, in 2017, more than 1 in 4 English children in Year 6 are not able to read with basic comprehension. The phonics inoculation they were given in their early years patently hasn’t worked, and there is trouble ahead as they move into high school. England should feel very nervous about the next round of PISA results.

The test fails to deliver on any of its claims

Buckingham’s report to the Minister describes the check as a ‘light-touch’ assessment. The research indicates that this is a problematic claim on two counts. It is too ‘light’ to identify and diagnose reading difficulties, but its prominence as a mandatory standardised assessment means its influence on literacy instruction has not been ‘light’.

As a short assessment, it assesses a limited range of phoneme/grapheme relationships, which limits its use as a phonics check. Recent research in England, which pointed this out, goes on to question the purpose and validity of the check.

As a partial assessment of only one reading skill it cannot give a diagnosis of a reading difficulty, and it can offer no direction for subsequent interventions.

Indeed the check has been found to be no more accurate than a teacher’s judgement in identifying struggling readers.

In short, the check doesn’t tell teachers anything they didn’t know already. And it doesn’t tell them what kind of instructional intervention their identified strugglers need.

Heavy-handed effect in England

The phonics screening check has had a very heavy-handed effect on literacy instruction in England. The UK Literacy Association claims it has failed a generation of able readers in the UK.

Students who don’t pass the check are required to re-sit the test after yearlong participation in the government mandated synthetic phonics program. These programs relentlessly drill the children in out-of-context phonic decoding to prepare them to read the unknown or alien words in the check. The deliberate focus on these non-meaningful words has shifted the focus of literacy instruction away from meaning, despite the fact that evidence suggests that the ability to read pseudo words is not a good predictor of later reading comprehension

England now has the farcical situation where literacy time is spent teaching struggling Year 1 and Year 2 readers to decode pseudo words to pass a test.

As a consequence of the over emphasis on synthetic phonic decoding skills, other reading skills have been sidelined. The very purpose of reading, comprehension, has dropped off the instructional agenda as schools focus on ensuring their students pass the phonics screening check.

Flawed reasoning behind recommending the test 

The report provided to the Minister by the panel headed by Buckingham claims the check is required because early reading assessments currently used in every state and territory in Australia are inadequate. The report provides a table of ‘necessary’ components of a phonics check, although it is not made clear what research has been drawn upon to come up with those components.

Notwithstanding this limitation, analysis of the English Phonics Screening Check shows it does not even meet these, the panel’s own requirements for a valid phonics check. Indeed the existing Northern Territory Foundations of Early Literacy Assessment (FELA) meets more of the panel’s criteria than the proposed Check does.

The Check contains both real and pseudo words. The real words are ideally not in the children’s existing vocabulary. The rationale for the inclusion of pseudo and unfamiliar real words is to ensure the children are relying solely on their phonic knowledge rather than prior familiarity with the word. Thus the check is supposed to be a pure assessment of phonic knowledge.

It does not do that. The test itself is flawed.

Detailed analysis of the flaws in the test

An analysis of 10 of the 40 words in the 2017 English Phonics Screening Check is provided below. The analysis confirms research findings that the Check is neither a pure test of phonic knowledge, nor an accurate assessment of phonic skills.

Scoring real word decoding in the 2017 Check

To achieve a correct answer on the 20 unfamiliar real words in the check, a student must correctly read the ‘real’ word, and not use any other plausible phonic decoding for that word. This makes the Check a vocabulary test rather than a phonics test.

For example, ‘groups’ must be read so the ‘ou’ is pronounced as /oo/. If the children decode this word with the ‘ou’ pronounced as /ow/ as in ‘house’, or /u/ as in ‘tough’, they are marked wrong.

As such, the child is marked on their existing knowledge of the word and its pronunciation. The children who used other accurate phonic possibilities for the letters ‘ou’ are marked incorrect, and we are left with inaccurate information about their phonic knowledge.

Similarly ‘chum’ must be read with the ‘ch’ pronounced as /ch/ in chip, not /k/ as in Chris or /sh/ as in chef.

‘Blot’ must be decoded to rhyme with ’hot’. If the ‘o’ is pronounced as the ‘o’ in ‘so’ or ‘go’ the student is marked wrong.

The ‘oa’ in ‘goal’ must be pronounced to rhyme with ‘foal’. If the student breaks the word into go – al, using the pattern found in ‘boa’, they are marked as wrong.

These examples show the children are being marked on their vocabulary knowledge, not their ability to use phonic knowledge. They are being marked wrong, despite plausible phonic decoding, and as such we have not gathered accurate information about their phonic strengths and weaknesses.

Scoring pseudo word decoding in the 2017 Check

To achieve a correct score for the pseudo words, the students must decode the word using only the phonemes identified in the marking guidelines.

For example, the pseudo word ‘braits’ is only marked correct when the ‘ai’ is pronounced as /ay/ as in ‘rains’. If the child decodes the word using the /a/ in ‘plaits’, or the /e/ in ‘said’, they are marked incorrect.

Given ‘braits’ is not a real word it is unclear why only one phonological interpretation is allowable. And it is unclear what we have learned about the child’s phonological skills, given they were marked wrong when their decoding was correct.

The pseudo word ‘zued’ is only marked correct if the ‘ue’ is pronounced as /oo/ as in ’too’, ‘to’ or ‘two’. If the students use any other pronunciation of ‘ue’ as heard in ‘duet’, ‘cruel’, ‘suede’ or ‘cue’ they are marked incorrect.

The ‘ue’ pattern is assessed yet again in the pseudo word ‘splue’. Once again the only decoding effort marked as correct is the /oo/ as in ’too’, ‘to’ or ‘two’.

The ‘ue’ digraph is being tested twice in 40 words, and with only the one pronunciation marked as correct. It leaves unanswered how the ‘ue’ in ‘cue’, ‘league’, ‘duet’, ‘cruel’, and ‘suede’ might be assessed.

‘Tay’ is designated a pseudo word in the 2017 test, which I’m sure the Scots would be surprised to hear given it is the name of Scotland’s longest river. Another reason for Scottish independence perhaps?

To score correctly on this word the students must rhyme it with ‘pay’.

However it turns out ‘tay’ is also a real word in the vocabulary of a Turkish 6 year old. It is the Turkish word for a baby horse – pronounced like the English word ‘tie’ to rhyme with ‘aye’.

It is also a real word in the vocabulary of a Vietnamese 6 year old. It is the Vietnamese word for hand – also pronounced like the English word ‘tie’ to rhyme with ‘aye’.

What information has been gained, or missed, about these children’s linguistic competence by marking their decoding as incorrect?

Scoring two syllable words in the 2017 Check

There are 36 one syllable decodable words in the Check, and 4 two-syllable words. The two syllable words are particularly problematic when using a synthetic left to right decoding method, which is the theoretical basis of the Check, and the accompanying mandated instructional interventions.

‘Model’ was one of those four two-syllable words in 2017.

If the word is decoded left to right using synthetic decoding processes we are likely to read the word as ‘mo’ to rhyme with ‘so’ and ‘del’ to rhyme with ‘hell’. As a consequence we end up with a word that sounds like the way we pronounce the word ‘modal’. If a child decodes the word in this manner, they will be marked wrong in the check.

It is necessary to have the word ‘model’ in your vocabulary to pronounce it correctly, to know which syllable takes the emphasis, and to know that that the second vowel is reduced to a schwa sound.

‘Reptiles’ is also on the 2017 test. Using the left to right approach taught in synthetic phonics programmes this word can be plausibly broken up as follows: rep – til – es. This would be marked wrong in the Check. Marking such an attempt as incorrect would fail to take account of the phonic knowledge the student has. Consider, in contrast, if the word had been ‘similes’. If the child had broken the word into si – miles, they would have been marked as incorrect The only way a child would know to break the words into rep – tiles, or sim -il -es, is if they have the word already in their vocabulary.

So the check is failing in even what it is purporting to do, that is measure phonological processing.

England should pull the plug on this test

The Phonics Check has failed to deliver the desired improvements in reading comprehension in England. It was worth a shot, but it is time to pull the plug.

It has failed because it attends to only one early reading skill, and thus distorts reading instruction in the early years to the detriment of reading comprehension in the later years.

It has failed because the Check is faulty, and ill constructed. It is unable to successfully assess the one skill it seeks to assess, phonological processing, and as such cannot even provide accurate diagnostic information to teachers.

Facing our literacy challenges in Australia

Australia can avoid falling into the same trap. Like England, we clearly have literacy challenges in the upper years of primary and secondary school. Our NAPLAN results for Year 7 and 9 make this very evident. But these are not challenges with the basic skills of phonological decoding of simple words and nonsense stories of Pip and Nip. These are challenges with depth of vocabulary and the capacity to deal with the complex syntactic structures of written texts across the disciplines.

It is crucial the State and Territory Ministers of Education are not distracted from these real challenges by placing false hope in a Phonics Screening Check. It is time to dump the idea.

 

Misty Adoniou PhD is Associate Professor in Language, Literacy and TESL at the University of Canberra. She was a primary school teacher for 10 years before moving to Greece and teaching and consulting in the area of English Language Teaching for 7 years. She has received numerous Teaching Awards including the Vice-Chancellor’s Award for Teaching Excellence, and was the Lead Writer of the Federal Government’s Teachers’ Resource for English Additional Language/Dialect (EAL/D) learners. She sits on a number of national and international advisory boards as a literacy expert.

 

Misty Adoniou with UK Professors Greg Brooks (member of the Rose Report Panel), Terry Wrigley, and Henrietta Dombey have contributed to a book edited by distinguished researcher Margaret Clark (OBE) published this month outlining how England came to adopt the Phonics Screening Check and providing more detail of its impact on teaching and learning as well as its costs.

Margaret Clark (Ed) (2017) Reading the Evidence : Synthetic Phonics and Literacy Learning. Glendale Education, Birmingham available on Amazon

A new phonics test for Australian six year olds is a BAD idea

The recent announcement by Education Minister, Simon Birmingham, of a nation-wide phonics assessment for six year olds is of great concern to me. I believe, as do many of my fellow literacy expert colleagues, this new test will not help improve our literacy levels.

Australian children have been “marking time” or “falling behind” when compared on international benchmarks like PISA since high-stakes testing has been introduced and ramped up in this country. This latest mandate is part of the political cycle associated with testing regimes. Continuing this kind of assessment will not improve student literacy outcomes.

Evidence from the UK and USA, where similar tests have been used, may show improvement in performance on the phonics test over time but do not correlate with an improvement in children’s literacy levels. In fact what can happen is a narrowing of the literacy curriculum.

No evidence that phonics training preceding meaning making helps

 As renowned English author Michael Rosen explains, the difference between a phonics test and learning to read is that a phonics test merely requires children to pronounce a list of words, while learning to read is about making meaning of a text.  Phonics is only one part of the literacy story. And there is no evidence that phonics training should precede meaning making in literacy learning. It is much more productive to address decoding skills in meaningful contexts.

Absolutely the drilling of phonics will help some children do better in phonics tests, but there is no correlation with ultimately learning to be literate.

What the evidence says

We do know that six year olds should not be subjected to this kind of assessment. There is emerging evidence that teachers and students are finding the test-driven approach to education in Australia is anxiety producing.

Early childhood contexts and the first years of schooling should be centred on engaging in creative play with language including poetry, songs and rhymes, developing children’s confidence in talking about and responding to story, building a rich vocabulary and developing an understanding and love of literature.

One of the best predictors of literacy success is access to books in the home, as well known research tells us. In addition, shared reading, storytelling, talking about books from an early age and the opportunity for children to read widely are all important in learning to be literate.  Many children living in poverty do not have access to a wide range of books and shared reading experiences from an early age. If we want to spend more money in Australia to develop literacy we should be investing in the provision of quality literature for all Australian children and better resources for teachers who teach disadvantaged children. We need more teacher librarians in our schools. At the moment, however, we are seeing a reduction in teacher librarians in public schools.

A new research brief from Save our Schools supports the argument that the continuing gap in access to education resources between advantaged and disadvantaged schools in Australia are among the largest in the world and the OECD. Disadvantaged students in Australia continue to be denied equal opportunities to learn because they have less access to qualified teachers and resources than their more advantaged counterparts.

Data from PISA 2015 published in a supplementary report by the OECD show that disadvantaged schools in Australia experience more teacher shortages, higher teacher-student ratios and more shortages or inadequacy of material educational resources than advantaged schools.

If we are serious about improving literacy levels in Australia we should be investing our money more wisely than in another useless test. Widening socioeconomic inequality will be a much larger determiner of children’s literacy achievement than performance on a phonics test.

 

Robyn Ewing is Professor of Teacher Education and the Arts at the University of Sydney. She teaches in the areas of curriculum, English and drama, language and early literacy development. She works with both undergraduate and postgraduate pre-service and inservice teachers. Robyn’s research has particularly focused on the use of educational or process drama with authentic literary texts to develop students’ imaginations and critical literacies. She has been published widely in this area. Her current research interests also include teacher education, especially the experiences of early-career teachers and the role of mentoring; sustaining curriculum innovation; and evaluation, inquiry and case-based learning.

 Robyn was president of the Primary English Teachers Association from 2001-2006 and is immediate past president of the Australian Literacy Educators Association (ALEA) and former vice president of Sydney Story Factory.  She is also a council member of the Australian Film, Television and Radio School (AFTRS), an Honorary Associate with Sydney Theatre Company, Board member of West Words and Visiting Scholar at Barking Gecko Children’s Theatre. She enjoys working collaboratively with classroom teachers interested in innovative curriculum practices.