Skip to main content

Building assessment into the curriculum plan



This is the fourth blog I've posted in recent weeks about curriculum planning, and this one, like the previous two, draws on the book Language Curriculum Design (Nation and Macalister, 2010). The subject this time is assessment and how this can be built into a successful curriculum. Gianfranco Conti and I have covered some similar ground in The Language Teacher Toolkit (2016) and Breaking the Sound Barrier (2019), but these important issues are worth spelling out again as many languages departments evaluate their curricula.

So I shall summarise some points referred to in Chapter 7 of Nation and Macalister (2010), adding a few observations of my own.

What is good assessment?

Assessment needs to be reliable, valid and practical. Let's look at these three aspects:

Reliability

A reliable test gives results which are not greatly affected by conditions which the test was not intended to measure. If the same person sat the test twice you would expect them to get more or less the same result. A test is more reliable if it is always given in the same conditions, is marked consistently, has the largest number of questions possible and in which questions and instructions are as clear as possible. An unreliable test cannot be valid.

(I would add a couple of other issues here. One very obvious one is that pupils should not have the opportunity to copy each other. If classroom layout means pupils are sat close to one another the temptation to cheat is too great for a good number of students, so steps need to be taken to ensure it is virtually impossible to see a neighbour's work. My solution was to have pupils place a bag in the middle of their shared table so that it was extremely difficult to see their partner's work.

A second point is that the type of question has a significant influence on reliability. So-called objective questions such as true/false or multi-choice are inherently more reliable than essay-style questions or oral tests where a level-based mark scheme has to be applied. If you set free writing, for example, you need to decide precisely what you are assessing and to apply any mark scheme as consistently as possible. Research shows that this is not easy, as teachers bring their own bias to the marking of pupils' work. As far as speaking and writing are concerned, you need to decide what you are assessing. Is it accuracy? Relevance to the question title? Pronunciation accuracy? Range and complexity of language?)

Validity

A valid test measures what it is supposed to measure. A valid achievement test measures what has been learned on the course, not language to which students have not been exposed. A valid listening test measures skill at listening. To ensure this teachers need to consider face validity. If it's a test of reading, does it look like one? If it's a vocabulary test, does the test actually test the spelling and meaning of words and phrases. But as well as face validity, we have content validity. When you analyse a test does it actually test what it's supposed to/ For example, if you wish to test reading or listening alone it would be unwise to include questions which require written target language answers, since these involve knowledge of writing as well as reading.

(I would add that this presents a challenge. If you decide to separate out the four skills and test each individually, this may end up having an effect on the way you teach, owing to what's called the backwash effect (aka washback). let's suppose that you want to test listening by asking questions in English (so as to avoid using target language writing), the danger is that, in the run-up to the test and in other prior lessons you use English questions when doing listening lessons. This, in turn, reduces the amount of target language (comprehensible input) you use in lessons. In this case the backwash effect is negative since we know that maximising comprehensible input is likely to lead to more acquisition.

On the other hand, if you design assessments to reflect the way you would like to teach then the backwash effect of tests can be positive. Suppose you believe that teaching is best when skills are integrated in lessons, with listening reinforcing reading, reinforcing speaking, reinforcing writing, and so on, then a good test would reflect this practice by including mixed skill assessment, e.g. a TL text with questions in the TL.

This has important implications when we look at GCSE and A-level in England, Wales and Northern Ireland. At GCSE Ofqual/DfE has long ago decided that, in general, we need to test the four skills separately. Yet they also reduce the validity of the tests by including TL answers in listening and reading tests. At A-level mixed skill testing has long been taken for granted.

The backwash effect is very powerful and encourages, for example, schools to use GCSE-style assessment even as early as Y7, which I find very unwise. These issues need to be kept in mind when designing unit tests and end of year exams.

In sum, I would argue for designing tests to resemble well-conceived lesson activities. You then end up with positive backwash and fairness, as students are asked to do well-designed tasks with which they are familiar. the test thus becomes a natural extension of the teaching. Remember too that research clearly shows students do better on tests whose form resembles what they have previously done in class.)

Practicality

When you consider practicality you need to look at factors such as cost, time taken to sit the test, time needed to mark it, the number of people needed to mark it and the ease in interpreting the results.

Practicality is aided when you can reuse tests year on year, or when a course book provides well-designed unit tests. Tests are more practical when they can be quickly marked, e.g. true/false or multi-choice, as opposed to composition or question-answer. But keep in mind that reliability and validity should take precedence over practicality. A multi-choice test is quick to mark, may be reliable to a limited extent, but certainly lacks validity in important areas.

(I would add that one way in which practicality comes in is to do with speaking tests. If you spend too much time on these during the year you risk sacrificing other areas of teaching. One formal oral assessment a year is probably enough, as long as you are assessing oral performance informally the rest of the time. Some might argue that a formal oral assessment is not worth doing at all in the early years since it is stressful and you already have enough information from lessons to assess spoken ability. But my experience is that you need at least one formal spoken assessment a year for the benefit of quieter, less confident learners who are reluctant to perform in normal classroom tasks.)


In conclusion, as Nation and Macalister point out: "Assessment also contributes significantly to the teacher's and learner's sense of achievement in a course and thus is important for motivation. It is often neglected in curriculum design and courses are less effective as a result" (p.120). So  I conclude with these few general pointers;
  • There's nothing wrong with testing - it provides opportunities for review and retrieval.
  • Design a regular programme of low-stakes assessments covering all the skills in an integrated way, as far as possible.
  • If you decide to test skills discretely (separately), don't let this have negative backwash on lesson design.
  • Only test what pupils have learned, keeping input comprehensible.
  • Don't spend too long on tests.
  • Make sure tests can be marked quickly.
  • Record results carefully to enable you to have an idea of a student's progress.
  • Make sure you use test results and analysis to help guide your future teaching.
  • Change tests if they are found not to work, e.g. they are too easy, too hard, or unclear.
  • All classroom activities, including tests, involve retrieval practice - if a test is a just like a regular classroom tasks it will be less stressful and produce positive backwash.
  • If the course book tests need adapting, do so, e.g. by adding more repetitions of audio tracks or reading them aloud.
  • When setting and marking end of year exams, spread the workload fairly across the department.
  • If you decide to do regular vocabulary testing, remember what research says about vocabulary acquisition - learning isolated words in written form has severe limitations. "Knowing words" is much more than knowing what they look like and what they mean.
  • Raising the status of tests can have a motivating effect (many pupils learn hard for them), but keep things in proportion!
Image: pixabay.com

Comments

Popular posts from this blog

Delayed dictation

What is “delayed dictation”?

Instead of getting students to transcribe immediately what you say, or what a partner says, you can enforce a 10 second delay so that students have to keep running over in their heads what they have heard. Some teachers have even used the delay time to try to distract students with music.

It’s an added challenge for students but has significant value, I think. It reminds me of a phenomenon in music called audiation. I use it frequently as a singer and I bet you do too.

Audiation is thought to be the foundation of musicianship. It takes place when we hear and comprehend music for which the sound is no longer or may never have been present. You can audiate when listening to music, performing from notation, playing “by ear,” improvising, composing, or notating music. When we have a song going round in our mind we are audiating. When we are deliberately learning a song we are audiating.

In our language teaching case, though, the earworm is a word, chunk of l…

Sentence Stealers with a twist

Sentence Stealers is a reading aloud game invented by Gianfranco Conti. I'll describe the game to you, then suggest an extension of it which goes a bit further than reading aloud. By the way, I shouldn't need to justify the usefulness of reading aloud, but just in case, we are talking here about matching sounds to spellings, practising listening, pronunciation and intonation and repeating/recycling high frequency language patterns.

This is how it works:

Display around 15 sentences on the board, preferably ones which show language patterns you have been working on recently or some time ago.Hand out four cards or slips of paper to each student.On each card students must secretly write a sentence from the displayed list.Students then circulate around the class, approaching their classmates and reading a sentence from the displayed list. If the other person has that sentence on one of their cards, they must hand over the card. The other person then does the same, choosing a sentenc…

Using sentence builder frames for GCSE speaking and writing preparation

Some teachers have cottoned on to the fact that sentence builders (aka substitution tables) are a very useful tool for helping students prepare for their GCSE speaking and writing tests. My own hunch is that would help for students of all levels of proficiency, but may be particularly helpful for those likely to get lower grades, say between 3-6. Much depends, of course, on how complex you make the table.

To remind you, here is a typical sentence builder, as found on the frenchteacher site. The topic is talking about where you live. A word of warning - formatting blogs in Blogger is a nightmare when you start with Word documents, so apologies for any issues. It might have taken me another 30 minutes just to sort out the html code underlying the original document.


Setting work for home study

A major challenge for language teachers just now is selecting and sharing work with students to do at home. Here a few suggestions on the issue to add to your own. The sites I mention are the tip of the iceberg and focus mainly on French. I have stuck to free resources, not subscription sites.

By the way, I'm not getting into the use of tech here, as I have no great expertise on that. In any case, I imagine for younger learners especially it may be a question of setting other types of work.

ADVANCED

For advanced learners the job is not so tough. There is a plethora of listening, reading and grammar material they can use, whether it be from their textbooks, other resources shared electronically or online resources. You may have your favourites, but for a selection for French you can check out my links here and here. You may want to stick with topics on the syllabus, or free up students to read and listen more generally to what interests them.

One idea I used was to ask students to c…

"Ask and move" task

This is a lesson plan using an idea from our book Breaking the Sound Barrier (Conti and Smith, 2019). It's a task-based lesson adapted from an idea from Paul Nation and Jonathan Newton. It is aimed at Y10-11 pupils aiming at Higher Tier GCSE, but is easily adaptable to other levels and languages, including A-level. This has been posted as a resource on frenchteacher.net.

This type of lesson plan excites me more than many, because if it runs well, you get a classroom of busy communication when you can step back, monitor and occasionally intervene as students get on with listening, speaking and writing.