Skip to main content

Assessing performance or proficiency?


In their new book The Art and Science of Language Teaching, Lara Bryfonski and Alison Mackey, in their chapter on assessment, remind us that there is a distinction to be made between assessing performance and proficiency. For example, in an oral test, if a student talks about their family, does this tell you they can reproduce some rehearsed language (performance) or that they have an underlying ability to generate original utterances in a creative way (proficiency)?

Teachers of novices and pre-intermediate school students know that the majority of their learners often have little ability to extemporise when speaking. This is because they have not had enough time, input and interaction to internalise (‘acquire’) enough of the language system (grammar) to speak spontanously. The same is basically true of written production, although in this case students do at least have time to reflect on what they want to write.

So with less experienced students we often end up assessing performance, and with good reason. Students learn and practise sentences and paragraphs to reproduce during a test. In other school subjects we have few qualms about testing what learners have memorised  Indeed, in musical instrument exams, it’s all about performance. So why should we worry too much about this in MFL/WL lessons? In time, those students who elect to continue with an additional language for, say, a fourth year and beyond will gradually be able to be creative with language. At advanced level the assessment regime can reflect this by including elements where students are forced to think on their feet and generate new utterances, revealing that they have underlying proficiency.

So with our younger learners, including many of those who are taking the GCSE in the UK, it is right that we allow students to ‘perform’ in oral and written tests to a large extent. This lets students show off what they have learned, what they can do. If we did not include this element of rehearsed performance, many students would flounder and be discouraged in their pursuit of learning a language. To what extent in your own setting do unit tests, school exams and standardised tests assess performance or proficiency?

At levels up to GCSE (CEFR A2 more or less), we can in fact combine assessment of both performance and proficiency. At GCSE we have always done this in the speaking test by letting candidates do a short presentation or give answers to predictable questions that have been practised before, while adding some unpredictable elements. The new GCSEs (first teaching 2024) allow for pre-learning of photo card conversation questions which are largely predictable. The same is true of the role-plsy tasks. Skilled teacher-examiners will encourage weaker candidates to show what they have rehearsed and give opportunities to more skilled students to make up new language on the spot (e.g. by asking unexpected follow-up questions).

For writing papers there will also be a strong element of pre-learning, which is also fine. Indeed, knowing how much weaker students struggle with written papers, we would be delighted of more students prepared more thoroughly and reproduced their knowledge under exam pressure.

Listening and reading are another kettle of fish. In this instance, we are always more likely to be asessing proficiency rather than performance. This is because the content will always vary a good deal, so learners have to deploy their various acquired skills to achieve success: distinguishing sounds and intonation patterns, recalling words/chunks and parsing the grammar to make meaning. This means that, overall, when you take into account a whole exam including all the four skills of listening, speaking, reading and writing, we can always say that we are assessing proficiency to a degree. GCSE success is, taken as a whole, a reasonable measure of proficiency, I would argue.

My main takeaway here, then, is that, rather than fretting too much over performance and proficiency, we should acknowledge the distinction, be aware of it, but perhaps focus on what students KNOW AND CAN DO, whether it be via pre-learning or spontaneously, on the spot. Our current exams in England do this pretty well overall, even if they can be criticised for other reasons. If a key goal is for us to engender self-efficacy in students it’s only fair that we let them learn, memorise and reuse known language.

Comments

Popular posts from this blog

What is the natural order hypothesis?

The natural order hypothesis states that all learners acquire the grammatical structures of a language in roughly the same order. This applies to both first and second language acquisition. This order is not dependent on the ease with which a particular language feature can be taught; in English, some features, such as third-person "-s" ("he runs") are easy to teach in a classroom setting, but are not typically fully acquired until the later stages of language acquisition. The hypothesis was based on morpheme studies by Heidi Dulay and Marina Burt, which found that certain morphemes were predictably learned before others during the course of second language acquisition. The hypothesis was picked up by Stephen Krashen who incorporated it in his very well known input model of second language learning. Furthermore, according to the natural order hypothesis, the order of acquisition remains the same regardless of the teacher's explicit instruction; in other words,

What is skill acquisition theory?

For this post, I am drawing on a section from the excellent book by Rod Ellis and Natsuko Shintani called Exploring Language Pedagogy through Second Language Acquisition Research (Routledge, 2014). Skill acquisition is one of several competing theories of how we learn new languages. It’s a theory based on the idea that skilled behaviour in any area can become routinised and even automatic under certain conditions through repeated pairing of stimuli and responses. When put like that, it looks a bit like the behaviourist view of stimulus-response learning which went out of fashion from the late 1950s. Skill acquisition draws on John Anderson’s ACT theory, which he called a cognitivist stimulus-response theory. ACT stands for Adaptive Control of Thought.  ACT theory distinguishes declarative knowledge (knowledge of facts and concepts, such as the fact that adjectives agree) from procedural knowledge (knowing how to do things in certain situations, such as understand and speak a language).

12 principles of second language teaching

This is a short, adapted extract from our book The Language Teacher Toolkit . "We could not possibly recommend a single overall method for second language teaching, but the growing body of research we now have points to certain provisional broad principles which might guide teachers. Canadian professors Patsy Lightbown and Nina Spada (2013), after reviewing a number of studies over the years to see whether it is better to just use meaning-based approaches or to include elements of explicit grammar teaching and practice, conclude: Classroom data from a number of studies offer support for the view that form-focused instruction and corrective feedback provided within the context of communicative and content-based programmes are more effective in promoting second language learning than programmes that are limited to a virtually exclusive emphasis on comprehension. As teachers Gianfranco and I would go along with that general view and would like to suggest our own set of g