Avant STAMP and the ACTFL Proficiency Guidelines
Wednesday, June 21, 2017 by David Bong
STAMP was originally developed by the Center for Applied Second Language Studies at the University of Oregon to meet the need for an online proficiency assessment that was based on the ACTFL Proficiency Guidelines. The "STA" in STAMP stands for the "Standards" in the ACTFL Proficiency Guidelines.
Why Avant STAMP Does Not Add Levels to the ACTFL Proficiency Guidelines
Avant STAMP continues to hold true to the main ACTFL Proficiency Guideline levels of Novice, Intermediate, and Advanced and the three sublevels of Low, Mid, and High. The Proficiency Guidelines are the standards that are used to establish the World Language learning standards in virtually all of the states in the US. We believe it is important to maintain the integrity of the three sublevels as defined by ACTFL. Avant does not believe it is appropriate or psychometrically justifiable to create additional sublevels without substantially lengthening the assessment and publishing the specific criteria or details that would differentiate these micro-levels. However, the field has asked for a way of providing more granular levels than the three sublevels the ACTFL Proficiency Guidelines define. In order to address this need, Avant has generated scaled scores of 200 to 800 for the Listening and Reading sections based on a psychometric analysis of testing data. We believe that this approach is more scientifically valid than artificially adding sublevels that do not exist in the ACTFL Proficiency Guidelines 2012(2012 publication), and that do not exist in any of the other major proficiency scales, ILR or CEFR.
How STAMP Aligns with the World Readiness Standards for Language Learning
Some people in the field have raised the question of whether Avant STAMP is aligned with the World Readiness Standards for Language Learning. These, just like the ACTFL Proficiency Guidelines, are defined as having three sublevels of Low, Mid, and High for each of the levels of Novice, Intermediate and Advanced. The World Readiness Standards for Language Learning list three categories of skills:
· Interpersonal (speaking-listening or writing-reading)
· Interpretive (reading, listening, viewing)
· Presentational (writing, speaking, visually representing)
Indeed, STAMP is directly aligned to these levels and all Avant STAMP reports use this language to assist in identifying test taker ability.
Interpersonal Communication - What is it? Can it be Assessed in a Computer-based Assessment?
In the speaking section of Avant STAMP, students produce language after reading or listening to prompts from a conversational setting. We do this because our research has shown that this is the most effective way to obtain responses that are sufficient in length to demonstrate the higher-level language skills defined in the intermediate and advanced levels according to the ACTFL Proficiency Guidelines. Some people have told us that they think Avant STAMP does not align with these standards because STAMP does not include an Interpersonal Speaking section. To answer that question we must first ask - what is Interpersonal Communication? Here is the first descriptor of Interpersonal Speaking from the World Readiness Standards for Language Learning:
"Interpersonal Communication · Interact and negotiate meaning in spoken, signed, or written conversations to share information, reactions, feelings, and opinions."
I have highlighted "Negotiate Meaning" because that is the essence of interpersonal communication. Even with an avatar or mock interview it is just not possible to negotiate meaning in a computer-based test with today's technology, meaning it is not possible to assess Interpersonal Communication with a computer-based assessment. Avant agrees that Interpersonal Communication is a critically important skill, but true Interpersonal communication can only be assessed through a human-to-human interview or synchronous exchange of writing (text messaging for example).
How Valid is Avant's Rating of STAMP Speaking and Writing Responses?
The measure of quality in assessing the productive skills of Speaking and Writing is the consistent and accurate rating of student responses. Avant's rater training processes, certification, and rater management software are core to the quality of Avant STAMP. Avant has developed both the software and the rater training expertise over the 15 years we have delivered STAMP. We believe that our rating quality is equal to or better than any assessment organization. For more detailed information about this process please refer to our blog post on our rating system. How does Avant Rate Speaking and Writing Responses?
Avant is fully committed to assessing language based on the ACTFL Proficiency Guidelines and reporting test taker skills on that scale. We welcome your thoughts and comments.