The Second Language Proficiency Test (SLPT) is an educational resource created by the Collegial Centre for Educational Materials Development (CCDMD) for the Québec college network.
The CCDMD’s mandate is to ensure that students throughout the network have access to quality educational materials in both French and English, and to contribute to the development of such materials at the different stages of production. The CCDMD produces materials for students in a wide range of courses and programs as well as documents intended specially to help them improve their French and English language skills.
These services are funded by the Québec Ministère de l’Éducation, de l’Enseignement supérieur et de la Recherche and, in some cases, benefit from support under the Canada-Québec Agreement on Minority-language Education and Second Language Instruction.
Colleges wishing to use this test must subscribe for it. Anyone wishing to use it for commercial purposes must enter into a specific agreement with the CCDMD. To become a subscriber or to obtain more information, please contact the CCDMD by email at info@ccdmd.qc.ca or by telephone at (514 873-2200).
Initially, the project was implemented by the Ministère de l’Éducation, du Loisir et du Sport (MELS) through its 2004-2008 second language action plan, when it agreed to develop, along with the Official Languages Program, a scale of second language proficiency levels and the related evaluation mechanisms. The general objective of the project was to improve the second language proficiency of college graduates, as recommended by the Commission d’évaluation de l’enseignement collégial (CEEC).
The project led to a long collaboration between the members of the coordinating committees responsible for the production of French and English tests: a large number of teachers and professionals in the French and English CEGEP networks participated in the first phase of development of the linguistic scales and items associated with the resulting tests.
In the fall of 2012, the Collegial Centre for Educational Materials Development (CCDMD) was entrusted with a new mandate to develop the second language proficiency test. In 2012-2013, the CCDMD consulted some twenty professionals and experts in the college and university networks. It set up a production team, with project managers, content specialists, programmers and technicians.
When the technical analysis was concluded, the CCDMD proposed an adaptive test model and a linguistic scale based on new criteria.
The primary objective of the Second Language Proficiency Test (SLPT) is to determine the proficiency level of the respondent in order to propose appropriate courses as well as tailored learning activities within those courses. When the respondent finishes the test, the result is given as a number from 1 to 10 and corresponds to a level on the Scale of Second Language Proficiency Levels for the College Student. The teacher and student can then consult the proficiency level descriptions for information on what the student is able to do at that level. The teacher can also use this information to plan learning activities to help the student progress to the next level. As a result, the SLPT goes further than a traditional placement test designed strictly to assign a student to a course level according to his or her results. Nonetheless, the head of a subscribing college has the option, in the management module, of associating a course number with each of the 10 levels.
The 10 levels in the Scale of Second Language Proficiency Levels for the College Student are closely related to the levels in other recognized international scales. The proficiency of students taking an upgrading (mise à niveau) course is at about level 1. A level 10 result means that the student may be more proficient than the maximum level measured by the test. Ideally, college graduates should reach level 8: subsequent university training should enable students to fine-tune their proficiency and achieve level 9 or higher during their university studies. Students registered in some ACS (attestation of collegial studies) programs would be well advised to achieve this level of proficiency so they can pass the OLF (Office de la langue française) examination for their profession.
The Scale of Second Language Proficiency Levels for the College Student includes 10 levels. The SLPT is made up of two categories of items: written comprehension and oral comprehension. However, the platform can accommodate two additional categories, if required.
There are six types of items: associations, multiple choice, sequencing, multiple answers, cloze text with drag and drop, and cloze text with menus. Each item is accompanied by a timer, a volume control slider bar (oral comprehension), and an interactive button enabling the respondent to go to the next item. The items are presented in a random manner. Each item includes:
The SLPT is adaptive. Each answer, correct or incorrect, affects the progression of the test, so that the respondent’s proficiency level can be determined quickly and efficiently. The platform can also operate in non-adaptive mode, so that the items can be tested and calibrated. However, the performance of the SLPT and the reliability of the results, in particular, depend on the interaction of the platform with appropriate content that is carefully targeted, finely calibrated, associated with predefined levels of difficulty, and classified in relevant categories.
There are six item types:
The answers to the following questions can be found in this text:
ASSOCIATIONS: Drag and drop the answer choices to form pairs.
Respond to an association question by pairing each of a set of elements in the 2nd column with one of the choices provided in the 1st column. Association questions are used to assess recognition and recall of related information. The response is deemed correct when the respondent has successfully matched all of the elements.
MULTIPLE CHOICE: Select the correct answer from a list of possible answers.
Respond to a multiple choice question by selecting the correct answer from a list that includes the correct answer and several incorrect answers. Multiple choice questions are used to test comprehension of a broad range of content. The context of the item and the type of response required determines whether the item is recall or interpretation. The response is deemed correct when the respondent has selected the single correct answer.
SEQUENCING: Drag and drop the answer choices in the correct order to form a logical text.
Respond to a sequencing question by dragging the elements into the correct order. Sequencing questions are used to test the ability to recall a series of events or a process in the order in which it was presented. They measure the ability to construct meaning and comprehend logical consequences expressed in verbal or written form. The response is deemed correct when the respondent has arranged all of the elements in the correct order.
CLOZE TEXT: Drag and drop the correct answers into the blank spaces.
Respond to a cloze text with drag-and-drop question by filling in the blanks in a text. Drag the correct answer from a predefined set of possible answers above the text to the appropriate blank in the text. Cloze text with drag-and-drop questions are used to assess language skills by imitating the editing process. They measure the ability to infer the most appropriate conclusion to an incomplete statement. The response is deemed correct when the respondent has filled in all of the blanks correctly.
CLOZE TEXT: Select the correct answer from a list of possible answers.
Respond to a cloze text with menus question by filling in the blanks in a text. Select the correct answer from a predefined list of possible answers. Cloze text with menus questions are used to assess the ability to compare options and make accurate choices. Cloze text with menus questions are simpler to decode than cloze text with drag-and-drop, as they narrow the range of correct answers. The response is deemed correct when the respondent has selected the single correct answer.
The educational design of the SLPT is based on principles of universal accessibility. The written instructions for each item, intended to guide the respondent in his or her approach, are accompanied by visual instructions. Thus, a respondent who is not sufficiently proficient to read the written instructions should be able to understand the task and answer the question. Visual instructions are provided for all items, including those in the advanced levels. This strategy creates a predictable virtual environment suitable for various types of learning.
Images have been included with the text or audio recording in the majority of items in proficiency levels 1 to 3. In some cases, the answer choices consist of numbers, images or even colours. An alternative text for each audio recording and image has been provided for in the editor.
Accommodation for Students with Special Needs
Since the objective of the SLPT is to determine reading and listening proficiency, no writing support measure (screen reader) or oral support measure (audio transcription) has been provided for in the test. The allotted answer time for each item is regulated by the administrator.
The test is an objective measure of second language proficiency throughout the college network. We thus ask educational institutions not to adapt it, as we wish to avoid distortion of the data collected.
The CCDMD development team would be pleased to discuss the development of an untimed replacement test, hosted on a separate virtual environment, to meet the needs of colleges having to accommodate groups of students with special needs.
The CCDMD can be reached at 514 873-2200 or info@ccdmd.qc.ca.
The SLPT is intended to be administered twice during a student’s college studies: once at the beginning and once before the diploma is awarded. The head of a subscribing college may decide to use it differently: the test can be used as a placement test under certain conditions or as a test within a language course. However, since students do not progress rapidly to a higher level of proficiency, it is recommended that students not take the test numerous times during their studies.
The subscription manager can create groups and define the testing schedule from the management module. The manager has access to both the overall results and detailed data and can decide whether or not to display the respondent’s results on screen at the end of the test.
The test can be taken online from home, in class or in a lab. Students can access the test using an ID and a password sent by the test manager. The monitoring of tests administered in class or in a lab is facilitated by the fact that the test progression (the type and order of items) varies with the respondent. Similarly, the correct answer is not always in the same order in the list of answer choices.
The scale used for the SLPT was developed on the basis of a comparison with three recognized scales in Québec: the Échelle québécoise des niveaux de compétence en français des personnes immigrantes adultes, the Quebec College ESL Benchmarks (provisional version), and the Échelle des niveaux de compétence en français langue seconde pour le collégial (provisional version). These benchmark scales include 12 levels.
For this project, only the first 10 levels were taken into account, since the proficiency level of the target audience generally ranges from 1 to 10. The SLPT scale development team selected indicators whose content was common to that of at least two scales. The team subsequently chose other indicators that were consistent with and complementary to the ones initially selected. It later added descriptions to the scale from the Canadian Language Benchmarks. Then 147 passages and 302 items were prepared to delimit the scale indicators and make up the proficiency test.
Importance of a Scale of Proficiency Levels
The interpretation of a proficiency level result based on a scale offers a number of advantages:
The Scale of Second Language Proficiency Levels for the College Student describes the development of second language proficiency in 10 levels. For each level, it defines what the learner is able to understand orally and in writing.
The proficiency test is made up of a number of items divided into two categories:
The items measuring oral comprehension are based on audio recordings, which vary in length and complexity depending on the target proficiency level. The audio recordings serve as the foundation for the questions appearing in one or more items.
Each item in oral comprehension includes:
Oral Comprehension – Level 1
In predictable situations, level 1 listeners can understand a few isolated words and expressions with the support of the speaker. They can understand, for example, times, dates, telephone numbers, abbreviations and acronyms, basic questions about their personal identity, the parts of the body and personal greetings.
Indicators
OC-L1-1 | Recognize the numbers in telephone numbers, addresses, dates and times |
OC-L1-2 | Recognize isolated words and a few memorized expressions in short exchanges of individual greetings, introductions and common courtesy formulas (one or two answers by the speaker) |
OC-L1-4 | Recognize the days of the week and the months of the year |
OC-L1-5 | Recognize words related to personal identity and information |
OC-L1-6 | Recognize the parts of the body |
OC-L1-7 | Recognize, from a list, the abbreviation or acronym that corresponds to the statement heard |
Oral Comprehension – Level 2
In predictable situations, level 2 listeners can understand simple sentences and short conversations with the support of the speaker. They can understand key words, common expressions and simple information. They can understand, for example, simple information on how an establishment operates and how to find their way around in it. They can also understand simple descriptions of people (weight, height, age) as well as numbers and colours.
Indicators
OC-L2-1 | Recognize a few words related to colours, numbers, time, place and movement |
OC-L2-2 | Grasp the meaning of a few key words and common expressions in short, simple conversations when the parties speak at a slow rate |
OC-L2-4 | Understand that they are being asked to identify people and objects |
OC-L2-5 | Grasp some simple, predictable information on how an establishment operates and how to find their way around in it |
OC-L2-6 | Grasp some information on directions to follow and the spatial location of a place |
OC-L2-7 | Recognize key words in a short dialogue providing a description of someone (weight, height, age) |
Oral Comprehension – Level 3
In predictable situations, level 3 listeners can understand the gist of a simple conversation or message. They can understand, for example, simple information on housing, a domestic problem, leisure or health. They can also understand measurements.
Indicators
OC-L3-1 | Recognize a few words related to colours, numbers, time, location, movement and measurements |
OC-L3-3 | Understand instructions concerning the directions to follow to locate a place or an object in space |
OC-L3-4 | Recognize simple information about their health and that of someone else |
OC-L3-5 | Recognize simple information about housing or a domestic problem |
OC-L3-6 | Recognizes simple information about leisure or recreation |
OC-L3-7 | Recognize the main idea in a simple advertisement |
Oral Comprehension – Level 4
In predictable situations, level 4 listeners can understand the meaning of a simple conversation or message. They can, for example, situate information in time (past, present, future) thanks to time markers and understand simple frequency markers. They can also understand the main information in an announcement (who? what? when? where?).
Indicators
OC-L4-1 | Identify a few of the main ideas in simple presentations (who? what? when? where?) provided the topic is familiar, the speech is clear, and the ideas are presented in a direct manner in everyday language |
OC-L4-2 | Recognize the main topic of television news about an event or accident, when the commentary is accompanied by a visual medium |
OC-L4-3 | Take a simple telephone message |
OC-L4-4 | Establish a sequence of events based on time markers heard in simple conversations |
OC-L4-6 | Grasp the purpose of communication or the main idea |
OC-L4-7 | Situate events by identifying time and frequency indicators |
OC-L4-8 | Identify the intention of a message thanks to the speaker’s tone or intonation |
Oral Comprehension – Level 5
In predictable situations, level 5 listeners can follow conversations and discourse on concrete topics. They can, for example, identify the main ideas in a television or radio show, determine the relationship between people in a conversation and the intention of speaker (for example, to convince people to buy a product).
Indicators
OC-L5-1 | Follow a normal conversation on concrete topics |
OC-L5-2 | Identify the key points in simple presentations, provided the topic is familiar, the speech is clear, and the ideas are expressed succinctly in everyday language (for example, some television and radio shows) |
OC-L5-3 | Sometimes grasp the relationship between speakers if the context facilitates comprehension and the situation is predictable |
OC-L5-4 | Recognize the main ideas |
OC-L5-5 | Recognize the intention of communication (for example, to persuade, sell, inform) |
Oral Comprehension – Level 6
In predictable or partially predictable situations, level 6 listeners can understand conversations and discourse on concrete topics. They can identify, for example, the primary and secondary ideas in a television or radio show, and distinguish fact from opinion if the distinction is explicit. They can also predict what comes next in discourse or the conclusion, if it is not given.
Indicators
OC-L6-1 | Generally recognize primary and secondary ideas |
OC-L6-3 |
Anticipate what comes next in a story Deduce or infer a plausible conclusion after hearing most of the facts |
OC-L6-4 | Grasp the relationship between speakers in predictable situations |
Oral Comprehension – Level 7
In predictable or partially predictable situations, level 7 listeners can understand conversations or discourse on various concrete topics when speech is at a normal rate. They can understand, for example, a variety of common expressions as well as facts and events about work and leisure activities. They can also determine the attitude and emotions of the speakers in a conversation.
Indicators
OC-L7-1 | Follow most ordinary conversations on familiar topics when the parties speak standard English at a normal rate |
OC-L7-2 | Identify most of the main facts and events in conversations on the current situation at work or in leisure activities |
OC-L7-3 | Make inferences about atmosphere, attitudes and emotions based on clear clues |
OC-L7-4 | Recognize a variety of common words and popular idiomatic expressions |
Oral Comprehension – Level 8
In predictable or partially predictable situations, level 8 listeners can understand conversations and opinion discourse on various concrete topics. They can, for example, understand academic vocabulary as well as vocabulary specific to their field of study. They can follow conversations and understand discourse in a formal context. They can also recognize the different parts of a presentation, and distinguish fact from opinion in discourse when the distinction is explicit.
Indicators
OC-L8-1 | Follow most conversations in formal and informal contexts |
OC-L8-2 | Understand the usual vocabulary specific to their field of study |
OC-L8-3 | Follow a structured oral presentation |
OC-L8-4 | Distinguish factual information from opinion when the distinction is explicit |
OC-L8-5 | Recognize language markers that enable them to grasp chronological order, comparisons, contrasts, and cause and effect relationships |
Oral Comprehension – Level 9
In sometimes unpredictable situations, level 9 listeners can understand conversations and discourse on various, sometimes abstract topics. They can identify, for example, key information in a presentation, and distinguish fact from opinion in discourse when the distinction is implicit. They can recognize the tone used by speakers and their social role in complex exchanges.
Indicators
OC-L9-1 | Identify points that will facilitate decision-making in an exchange with known collaborators |
OC-L9-3 | Distinguish factual information from opinions even when opinions are implicit |
OC-L9-5 | Recognize the tone of a conversation |
OC-L9-6 | Understand sometimes abstract remarks in known contexts |
OC-L9-7 | Distinguish the social roles of different speakers in dialogues involving complex social interaction |
Oral Comprehension – Level 10
In sometimes unpredictable situations, level 10 listeners can easily understand conversations and discourse on various sometimes abstract topics even when speech is at a fast rate. They can understand varied vocabulary. They can understand, for example, the values conveyed by discourse and sometimes identify contradictions in reasoning. They can also understand when the hypothetical and conditional are used.
Indicators
OC-L10-1 | Clearly grasp the meaning of comments and criticism made during a formal exchange with unknown collaborators |
OC-L10-2 | Recognize elements of language indicating the persuasive nature of discourse |
OC-L10-3 | Clearly follow various types of discourse when speech is at a normal to fast rate |
OC-L10-4 | Sometimes infer contradictions in discourse |
OC-L10-5 | Understand varied vocabulary |
OC-L10-6 | Recognize when the hypothetical and conditional are used in the past |
OC-L10-7 | Deduce the values conveyed by discourse |
The items measuring written comprehension are based on written texts, which vary in length and complexity depending on the target proficiency level. The texts serve as the foundation for the questions appearing in one or more items.
Each item in written comprehension includes:
Written Comprehension – Level 1
When texts or documents are very simple, one line or sentence long, and deal with concrete, familiar topics, level 1 readers can understand common words, everyday abbreviations and known names. They can understand, for example, the months of the year and words related to personal identity. They can make the link between words and common pictograms. They can also understand representations of time and different lettering or typeface.
Indicators
WC-L1-1 | Understand commonly used words |
WC-L1-3 | Generally recognize everyday words and known names of people and places |
WC-L1-4 | Recognize the most common abbreviations |
WC-L1-5 | Read and identify the months of the year |
WC-L1-6 | Find elements related to personal identification on a very simple form (name, address, telephone number, signature) |
WC-L1-8 | Associate an image or a pictogram with a written word referring to the immediate, predictable environment |
WC-L1-10 | Recognize words even though they are written in different lettering or typeface |
WC-L1-11 | Associate different representations of time |
Written Comprehension – Level 2
When texts or documents are very simple, a few sentences long, and deal with concrete, familiar topics, level 2 readers can understand and identify specific information. They can understand, for example, schedules, prices, weather forecasts and abbreviations for mass, volume and quantity. They can also understand numbers written out in full.
Indicators
WC-L2-1 | Find important or relevant information on ordinary documents (a notice, simple schedule, invoice, receipt, cheque, identification section of a form) |
WC-L2-2 | Choose a greeting card for someone for an event |
WC-L2-3 | Recognize numbers written out in full |
WC-L2-5 | Recognize words or expressions used in weather forecasts |
WC-L2-7 | Associate abbreviations for mass, volume and quantity with the corresponding words |
Written Comprehension – Level 3
When texts or documents are simple, one paragraph long, and deal with concrete, familiar topics, level 3 readers can understand the gist of a message or a description. They can understand, for example, an advertisement or a film summary. They can also understand the function of linking words in a simple sentence.
Indicators
WC-L3-1 |
Find factual information relevant to their needs in simple, informative documents Choose a film in a television guide on the basis of its description |
WC-L3-2 | Understand the gist of advertisements on circulars and coupons |
WC-L3-3 | Understand the gist of brief descriptions in simple texts containing one paragraph with simple sentences |
WC-L3-5 |
Recognize the content and sequencing of simple instructions Recognize instructions given about school work |
WC-L3-6 | Recognize the function of words in a simple sentence |
Written Comprehension – Level 4
When texts or documents are simple, a few paragraphs long, and deal with concrete, familiar topics, level 4 readers can find specific information, identify the order of the steps involved and answer general comprehension questions (who? what? when? where?). They can understand, for example, announcements and directions for use. They can also place events in time thanks to common time markers, and compare simple information of the same nature in order to make a choice.
Indicators
WC-L4-1 |
Identify time markers (before, after, then, now) Place events in time (past, present, future) thanks to time markers |
WC-L4-2 |
Grasp the sequence of steps in directions Follow directions on a label (how to use, how to preserve, first aid instructions) |
WC-L4-3 |
Correctly answer general comprehension questions about messages containing two or three paragraphs with about ten sentences altogether (a news article, health report, note to parents from the school) Demonstrate their understanding of the basic elements of a news article (who wrote it? on what? when? where?) |
WC-L4-4 |
Skim through a short text or simple document to find specific information Find explicit information in classified ads or on a menu |
WC-L4-5 | Find some basic information in reference material (dictionaries, conjugation tables) |
WC-L4-7 | Find and compare several facts of the same nature in a short, simple text in order to make a choice |
WC-L4-8 | Read written messages in any lettering, including in attached lettering |
Written Comprehension – Level 5
When texts or documents, a few paragraphs long, deal with concrete topics, level 5 readers can find the main information. They can understand, for example, a news article or short biography. They can also group together information provided in a document in order to answer questions and situate events in time thanks to the verb tenses.
Indicators
WC-L5-1 | Place the text in time using time markers and certain inflections |
WC-L5-2 | Identify information in a news article or informative text containing two or three paragraphs with about ten sentences altogether |
WC-L5-4 | Demonstrate their understanding by associating information in a text |
WC-L5-5 |
Find relevant information in a notice two or three paragraphs long Select specific, relevant information in a publication |
Written Comprehension – Level 6
When texts, one or two pages long, deal with familiar topics, level 6 readers can understand all the main information. They can understand, for example, a letter or an article on a place to visit. They can also understand complex sentences, cohesion markers, and the link between the paragraphs.
Indicators
WC-L6-1 | Identify all the pertinent information (including the whys and wherefores) in a one-page letter or news article |
WC-L6-2 | Infer the link between paragraphs |
WC-L6-3 | Identify certain cohesion markers in a text (pronoun references, lexical substitution, repetition) |
WC-L6-4 | Demonstrate their comprehension of a text made up of complex sentences that contain common relationship markers |
Written Comprehension – Level 7
When texts a few pages long deal with familiar topics or subjects of general interest, level 7 readers can recognize the primary and secondary information. They can understand columns or editorials, for example. They can differentiate fact from opinion and predict the next step in a text or the conclusion, if it is not given. They can also understand the meaning of a word thanks to its prefix or suffix.
Indicators
WC-L7-1 | Recognize the main idea and secondary ideas in a text |
WC-L7-4 | Differentiate fact from opinion in an editorial or column |
WC-L7-5 | Predict information or a subsequent step in a factual text |
WC-L7-6 | Distinguish the meaning of a word or a nuance according to the prefix or suffix |
Written Comprehension – Level 8
When texts a few pages long deal with topics of general interest, level 8 readers can understand the main ideas. They can read, for example, an opinion text or articles on training, employment or their field of study. They can also explain an opinion and differences in points of view between two documents.
Indicators
WC-L8-1 | Identify the main ideas in an opinion article |
WC-L8-3 | Read magazine articles on training and employment |
WC-L8-5 |
Understand the main ideas (in an opinion text) Explain differences in points of view between two documents |
WC-L8-6 | Understand all the information in a general interest text (article on training, employment or their field of study) |
Written Comprehension – Level 9
When texts are complex and contain varied and sometimes abstract vocabulary, level 9 readers can understand the general meaning and details, even if some sentences are complex. They can understand, for example, scientific articles and the links developed. They can also follow the author’s arguments and understand linking words.
Indicators
WC-L9-1 |
Recount the author’s arguments outlined in an editorial or a column Identify the author’s position expressed in an editorial or a column |
WC-L9-2 | Grasp the meaning of a text even if the grammatical structures are complex |
WC-L9-4 | Recognize the function of linking words in a text |
WC-L9-8 | Understand the meaning of a text with varied vocabulary |
WC-L9-9 | Identify the purpose and general idea of an elaborate text containing complex sentences, as well as pinpoint some details |
Written Comprehension – Level 10
When texts are complex and contain varied, specialized or abstract vocabulary, level 10 readers can understand various documents in a general and often detailed manner, even if some elements are ambiguous. They can understand and summarize, for example, popular novels, research reports and briefs. They can also distinguish registers and understand the tone of a text as well as links expressing cause, intention, time and consequence.
Indicators
WC-L10-2 | Follow most types of text without losing sight of the main theme, even if some of the content is unfamiliar or ambiguous |
WC-L10-3 | Recognize words and expressions from different registers |
WC-L10-4 | Recognize adjectives, adverbs and other words that convey tone (irony, humor, sarcasm, criticism) |
WC-L10-6 | Grasp the author’s intentions, some of which may be implicit |
WC-L10-7 | Summarize a text in a relevant manner |
WC-L10-8 | Distinguish the links of cause, intention, time and consequence, expressed by the most common subordinating words |
WC-L10-9 | Efficiently read different types of complex texts containing specialized vocabulary, for work or school |
The SLPT is adaptive. Each answer, whether correct or incorrect, affects the progression of the test, so that the respondent’s proficiency level is determined quickly and efficiently.
The platform can also operate in non-adaptive mode, so that items can be tested and calibrated.
The administration of an adaptive test is non-linear. The way in which the learner answers the first questions, whether correctly or incorrectly, determines the progression of the test. As the test is administered, it dynamically selects, from a bank of approved and calibrated items, the item most likely to assess the respondent’s skill level in light of his or her preceding answers. The answers are analyzed as the respondent gives them, and tasks are selected progressively according to the answers; the assessment of the respondent’s proficiency level is thus refined quickly and efficiently. The test ends when the proficiency level is determined. An adaptive test, in comparison with a non-adaptive test, makes it possible to reduce the number of items presented, decrease the test administration time and increase the reliability of skill assessment.
The results for the adaptive test vary between -3 and +3. For purposes of interpretation, these results (called “thetas”) are matched with the language proficiency scale levels. In the Cut scores section, the proficiency levels are identified and the thetas corresponding to each level are defined.
The test is generally used in non-adaptive mode so that a representative sample of respondents can go through a representative number of approved items (say, about a hundred). The items can then be calibrated, i.e., a difficulty value on a scale of -3 to +3 can be obtained. Once the test includes about a hundred calibrated items, it can be used in adaptive mode. An automatic calibration mechanism for new items is included in adaptive mode: each respondent is given a certain number of non-calibrated items in each category (for example, two per category), in addition to the items chosen to measure his or her language skill. The results for these items will not be used in the assessment of skill. Once a certain number of respondents (say, 150) have answered a given non-calibrated item, the administrator will calibrate the item, by clicking on the Calibrate button in the Calibration section.
The administration of the non-adaptive test is linear, with a predetermined number of questions to which the learner must respond. The test ends when the bank of questions is used up.
The test in non-adaptive mode randomly presents all items created and approved in the editing module. The non-adaptive mode is used essentially to calibrate items, i.e., to determine their level of difficulty by having a representative sample of respondents take the test. In this mode, the respondent’s results are not calculated in thetas, but according to the number of correct answers out of the number of items presented.
Application Design
Educational Design and Drafting
Project Management
Test Evaluation
Translation
Drafting of Implementation Guide
Language Editing
|
System Design and Programming
Web Integration
Graphic Design
Audio Production
Voice
|
AcknowledgmentsWe at CCDMD wish to thank the following individuals and groups: Deborah Armstrong, Rebecca Baker, Chantal Bélanger, Kathye Bélanger, Philippe Bonneau, Marie-Pierre Bouchard, Yvonne Christiansen, Marie-Claude Doucet, Cathie Dugas, Paul Fournier, Philippe Gagné, Sylvain Gagnon, Francine Gervais, Sue Harrison, Réjean Jobin, André Laferrière, Charles Lapointe, James Laviolette, Julia Lovatt, Michel D. Laurier, Susan MacNeil, Anne McMullon, Jean-Denis Moffet, Andrew Moore, Joanne Munn, Ian Murchison, Colette Noël, Patrick Peachey, Christian Ragusich, Michael Randall, Pierre Richard, Joan Thompson, Rachel Tunnicliffe and Inèse Wilde, as well as
This work is dedicated to the many teachers who contributed in one way or another to the production of a fair and reliable second language proficiency test that is fitting for young students in Québec. This project is funded by the Québec Ministère de l’Éducation, de l’Enseignement supérieur et de la Recherche and the Canada-Québec Agreement on Minority-language Education and Second Language Instruction. |