Skip to main content

Comparing draft GCSE MFL specification mark schemes (2)

In my previous post about the new draft GCSE MFL mark schemes I focused on the Foundation Speaking Conversation grids. remember that it is really only the Speaking and Writing grids that need close attention as Listening and Reading mark schemes are largely objective (i.e. one point for one correct answer).

This time I shall look at the mark schemes for the Higher Writing question. You'll know that the marking of Writing controlled assessments has been a bone of contention ever since they were introduced, so will the new marks schemes lead to fairer and more consistent grading?

Sources

AQA:  http://filestore.aqa.org.uk/resources/french/specifications/AQA-8658-SP-2016-V1-0.PDF

Pearson: http://qualifications.pearson.com/content/dam/pdf/GCSE/French/2016/specification-and-sample-assessments/GCSE-French-SAMs-Combined.pdf

OCR: http://www.ocr.org.uk/Images/207218-specification-draft-gcse-french-german-and-spanish-j720-j721-j722.pdf

Eduqas: http://www.eduqas.co.uk/qualifications/french/gcse/WJEC-Eduqas-GCSE-French-SAMs.pdf?language_id=1


Here is how the awarding bodies allocate marks for the second composition (non-overlap):

AQA  32 marks out of 60

Content 15    Range  12    Accuracy 5

Pearson Edexcel   28 marks out of 60

Communication/Content   14     Knowledge/Accuracy  14

OCR   24 marks out of 60

Content  12   Language  12

Eduqas   30 marks out of 60 (unlike the other boards this is the overlap question)

Communication 16    Knowledge/Accuracy   7     Range    7

Note that the Eduqas Communication mark is awarded differently to that of the other boards. They say:

The candidate will be required to give ten responses to the question set. Each response will be assessed for Communication according to the following criteria: 2 Response is complete, appropriate and without ambiguity. 1 Response is partially complete or with some ambiguity. 0 Inappropriate, incomprehensible, or no response. 

This has the potential to be more objective than the other mark schemes, but also gives the examiner less leeway to reward an excellent candidate who may miss a point or two.


Notes

There is some significant variation in approach here in relation to range and accuracy. All boards allocate about half the marks for appropriate content. Pearson Edexcel and OCR incorporate accuracy and range, whilst AQA and Eduqas separate out accuracy. My own preference would be to mark range and accuracy separately. If you don't this can cause issues with candidates who write plenty of information, with a good range of vocabulary, but inaccurately. Conversely, some may play safe by being accurate but with a narrower range.

*************************************************************

Next I'm going to have a look at descriptors just below the middle of the mark range for Language/Range/Accuracy - direct comparisons are not easy because of the different approaches adopted by each awarding body. I shall mark in bold interesting points of comparison.

AQA

Range (4-6/12)

Some variety of appropriate vocabulary and structures used. Longer sentences are attempted, using appropriate linking words, often successfully

Accuracy (2/5)

More accurate than inaccurate. The intended meaning is generally clear. Verb and tense formations are sometimes correct

Pearson Edexcel

Knowledge/Accuracy 6-8/14

Uses familiar and predictable vocabulary and grammatical structures. There may be the occasional use of a complex item. Uses tenses and time frames, with some success, with reference to past, present, and future events, as appropriate to the task. Some evidence of manipulation of language to produce sentences but this is not sustained. Generally accurate in using straightforward language, but there are major errors with verbs and tenses 

OCR

Language 4-6/12

Simple language is mostly accurate. Errors do not impede communication. A good variety of vocabulary, appropriately used in places. A good variety of structures; simple structures used appropriately. Reference to past, present and future events. Language is generally fluent and generally manipulated well 

Eduqas

Knowledge/Accuracy  3/7

Errors in simple structures sometimes impede meaning. A large number of inaccuracies. 

Range 3/7

A limited range of vocabulary and structures is produced. Language for the most part is simple and use is made of uncomplicated structures, although not always accurately.

Notes

Compare OCR and Eduqas - for similar marks Eduqas expect "limited range" whilst OCR expect "good variety". This makes OCR look harder.

Compare Pearson/OCR with AQA/Eduqas - the former expect past, present and future (with some error). AQA make no reference to tense, though marks would clearly be lost for Content if subject matter were not communicated in the right tense. I like to see tense referred to explicitly.

I like the fact that Pearson Edexcel's descriptor is more detailed.

*********************************************************

I've also looked at the top of the mark range in the range/accuracy grids. I have marked in bold interesting points of comparison. Bear in mind there is less wiggle room in the Eduqas grid.

AQA

Range (10-12/12)

Very good variety of appropriate vocabulary and structures used. More complex sentences are handled with confidence, producing a fluent piece of coherent writing.

Accuracy (5/5)

Accurate, although there may be a few errors especially in attempts at more complex structures. Verbs and tense formations are secure.

Pearson Edexcel

Knowledge/Accuracy  12-14/14

Uses wide range of vocabulary and grammatical structures, including effective use of complex items. Uses tenses and time frames successfully with reference to past, present, and future events, as appropriate to the task. Clear ability to manipulate language to produce longer, fluent sentences with ease. Very accurate with only isolated minor errors e.g. spellings, genders and agreements.

OCR

Language (10-12/12)

Language is almost fully accurate. Complex language is mostly accurate. A very good variety of vocabulary, used entirely appropriately. A variety of complex structures, used appropriately. Complex tenses are used. Language is highly fluent and creatively and independently manipulated.

Eduqas

Knowledge/Accuracy (7/7)

Writing is mostly accurate with few mistakes. Verbs and time references are secure. Principles of grammar are sound.

Range (7/7)

A fluid and fluent style is developing. Appropriate style and register is always maintained. The language is sophisticated. Uses a wide variety of tenses, vocabulary and structures. Language is almost always totally correct.*

Notes

There is clearly broad similarity here.

*I find it odd that Eduqas include a reference to accuracy in their Range descriptor. Do they mean accurate? Or appropriate? is there a mismatch between "mostly accurate" and "almost always totally correct"? I find this a bit sloppy.

AQA's reference to "a few errors" may be a little vague, but at standardisation a numerical figure may be put on this to help examiners. Pearson's "isolated minor errors" seems a little tougher. It would be useful to know what AQA mean by "more complex sentences" - will we see a return to what we used to use i.e. the need for subordinate clauses to indicate complexity? This was useful.

I find OCR's descriptor a little confusing. "Language is almost fully accurate". But then "complex language is mostly accurate". ??? Did they mean "Simple language is almost fully accurate"? I dislike the use of "creatively" and "independently". An examiner cannot know for sure if something has been pre-learned and reproduced or if it is the result of creative or independent thought. If it's good, you reward it. There is nothing wrong with pre-learning for an exam.

**************************************************************

Well, you can be nit-picking with these things, but they are actually very important. My department and I found the AQA's CA Writing mark schemes too loose and they may have contributed to inconsistent marks from examiners (the other boards too, no doubt).

I like to see detailed descriptors with useful items to latch on to. "At least three subordinate clauses", "past, present and future", at least 4 adjectives and adverbs, at least 3 linking words etc. This may be too much for a general mark scheme and you may fear that it would confine candidates too much, but I imagine examiners would find this type of thing useful when moderating/standardising. In this way we may remove some of the subjectivity which inevitably arises when marking compositions.

Ultimately there will be problems with marking compositions, but the new system will be more reliable than the existing one, partly because all candidates will be doing the same questions.

Finally, just for fun: here is a go at a top Language mark descriptor based on work I have read over the years:

Very accurate, with no more than ten minor errors and two major errors. Use of past, present and future time frames. Much complex language, with at least 5 complex sentences (subordinate clauses), five or more adjectives and adverbs, three linking words and two modal verbs. Wide range of vocabulary and Higher Tier linguistic structures.

And a mid range descriptor:

Between 5-8 major errors and frequent minor errors. At least five successful attempts at different time frames. At least three linking words and one subordinate clause. At least one adjective and adverb. Meaning nearly always clear to a sympathetic native speaker.












Comments

Popular posts from this blog

What is the natural order hypothesis?

The natural order hypothesis states that all learners acquire the grammatical structures of a language in roughly the same order. This applies to both first and second language acquisition. This order is not dependent on the ease with which a particular language feature can be taught; in English, some features, such as third-person "-s" ("he runs") are easy to teach in a classroom setting, but are not typically fully acquired until the later stages of language acquisition. The hypothesis was based on morpheme studies by Heidi Dulay and Marina Burt, which found that certain morphemes were predictably learned before others during the course of second language acquisition. The hypothesis was picked up by Stephen Krashen who incorporated it in his very well known input model of second language learning. Furthermore, according to the natural order hypothesis, the order of acquisition remains the same regardless of the teacher's explicit instruction; in other words,

What is skill acquisition theory?

For this post, I am drawing on a section from the excellent book by Rod Ellis and Natsuko Shintani called Exploring Language Pedagogy through Second Language Acquisition Research (Routledge, 2014). Skill acquisition is one of several competing theories of how we learn new languages. It’s a theory based on the idea that skilled behaviour in any area can become routinised and even automatic under certain conditions through repeated pairing of stimuli and responses. When put like that, it looks a bit like the behaviourist view of stimulus-response learning which went out of fashion from the late 1950s. Skill acquisition draws on John Anderson’s ACT theory, which he called a cognitivist stimulus-response theory. ACT stands for Adaptive Control of Thought.  ACT theory distinguishes declarative knowledge (knowledge of facts and concepts, such as the fact that adjectives agree) from procedural knowledge (knowing how to do things in certain situations, such as understand and speak a language).

La retraite à 60 ans

Suite à mon post récent sur les acquis sociaux..... L'âge légal de la retraite est une chose. Je voudrais bien savoir à quel âge les gens prennent leur retraite en pratique - l'âge réel de la retraite, si vous voulez. J'ai entendu prétendre qu'il y a peu de différence à cet égard entre la France et le Royaume-Uni. Manifestation à Marseille en 2008 pour le maintien de la retraite à 60 ans © AFP/Michel Gangne Six Français sur dix sont d’accord avec le PS qui défend la retraite à 60 ans (BVA) Cécile Quéguiner Plus de la moitié des Français jugent que le gouvernement a " tort de vouloir aller vite dans la réforme " et estiment que le PS a " raison de défendre l’âge légal de départ en retraite à 60 ans ". Résultat d’un sondage BVA/Absoluce pour Les Échos et France Info , paru ce matin. Une majorité de Français (58%) estiment que la position du Parti socialiste , qui défend le maintien de l’âge légal de départ à la retraite à 60 ans,