STAMP WS Guides for Testing Coordinators
Monitor Test Progress
- Use the screen to track test takers’ progress throughout the test.
- Determine how test taker’s Login Name was entered.
Summary Field will show testing group averages and distribution of test takers across levels.
The Test Instances list shows test login/profile information as well as results and status information for each test taker. These lists will start to show test takers and data as soon as the test taker creates a new test instance and completes the profile screen.
Not Ratable (NR) – Writing or Speaking sections will have status NR (Not Ratable) if a rater is not able to rate any of the responses in the section. Not Ratable responses are generally due to technology challenges and are flagged as such in the report. Other situations, for example, if the testing environment is too noisy for the rater to hear the test taker response OR the test taker has whispered their response to the point it cannot be rated, an NR score will be given for that response.
The NR status for Writing or Speaking sections does not count against the test taker in the composite score. Writing and Speaking sections with NR status can be reset at no charge. Resets must be requested and completed within 90 days of starting the test. Please refer to Avant’s Test Retake and Reset Policy.
Section In Progress (IP) – The test taker has started, but not completed, this section of the test. For the Writing and Speaking sections, click the IP to see how many responses have been submitted.
Self-Evaluation (SE) – Self-Evaluation scores for Reading and Listening sections are preceded with SE to designate the score is achieved through a self-evaluation.
Section Not Started (NS) – The test taker has not started this section of the test. If all sections are marked NS the test taker has completed only the Profile.
Individual Reports – Click on the report icon to access the Individual Report for a specific test taker.
Scoring in Progress (SP) – This section of the test is complete, but rating is not complete for one or more responses. You can click the SP in a report to see how many responses have been rated.
Zero score (0) – Writing or Speaking responses will receive a zero score (0) for one of the following reasons which will be displayed on the report:
- Test Agreement Violation
- Non-Target Language
- No Attempt to Respond / Only ONE Target Language Word
- Off Topic Response
- Gibberish
- Violent Language
- Profane Language
Level Zero (0) scores for Writing and Speaking responses will count toward the section score and will lower the overall composite score. Level zero (0) scores cannot be reset. Please refer to Avant’s Test Retake and Reset Policy.
The column headers are interactive and can be clicked to sort the data in the list.
The Date Filter defaults to showing test results from the last 6 months. To select a different date type the date or click on the calendar. Then, click APPLY. There are also presets that can be selected to show the Last 3 Months, Last 6 Months, and Last Year of testing. The Date Filter can also be modified to search by Start Date or by Recent Activity.
To create reports for multiple or all test takers on the list check the box to the left of the test takers for which you wish to generate reports. Then click on the Printer icon, then click on Individual Reports and choose All or Selected. For best results, wait until all testing and rating is complete.
The Test Taker Data download feature creates an Excel (.csv) file that includes test taker results along with the profile information and other test-taking data. From the spreadsheet you can create a customized report, including only the fields you want, and sort it as needed.
Dates and Times – All times will display in your local time, based on your computer’s clock. The Length column displays the total time elapsed between every completed skill’s start and finish time.
Composite Scores are available when Writing and Speaking test sections have been completed and rated. Composite score represents the test taker’s Writing and Speaking scores added together and divided by two. Self-evaluated Reading and Listening scores are not included in Composite score calculation.
Reading and Listening will have Self-Evaluation Levels up to Level 7. Rating for Writing and Speaking is done using Benchmark Levels 1-8. The levels are associated with the benchmark categories of Novice, Intermediate and Advanced as shown in the Level Keys above.
The test taker has not started this section of the test. If all sections are marked NS the test taker has completed only the Profile.
The test taker has started, but not completed, this section of the test. For the Writing and Speaking sections, click the IP to see how many responses have been submitted.
This section of the test is complete, but rating is not complete for one or more responses. Click the SP to see how many responses have been rated.
Writing or Speaking sections will have status NR (Not Ratable) if a rater is not able to rate any of the responses in the section. Not Ratable responses are generally due to technology challenges and are flagged as such in the report. Other situations, for example, if the testing environment is too noisy for the rater to hear the test taker response OR the test taker has whispered their response to the point it cannot be rated, an NR score will be given for that response.
Technology Issues
SPEAKING: No audio, buzzing, static/noises or low audio volume that prevents an accurate score. These are clear cases of technology hindering the ability to complete the task.
WRITING: Test taker indicates that no keyboard was set up for character-based languages or had other typing/input issues.
Other
SPEAKING: Test taker is speaking, however, there are loud background noises like disruptive test takers near the test taker, fire alarms, teachers giving instructions/directions in the background or test taker is whispering preventing the raters from being able to adequately hear the complete response.
SPEAKING/WRITING: Test taker describes the picture or reads/translates the prompt or responds using dialect.
The NR status for Writing or Speaking sections does not count against the test taker in the composite score. Writing and Speaking sections with NR status can be reset at no charge. Resets must be requested and completed within 90 days of starting the test. Please refer to Avant’s Test Retake and Reset Policy.
As the STAMP test is increasingly used for higher stakes purposes like awarding either credit or the Seal of Biliteracy, Avant has also increased the rigor of our rating process. The purpose of the zero score is simply to act as a flag that a potential test taker agreement violation has been identified in the response.
Our raters are trained to identify responses that may include some of the following behaviors in test taker responses:
- Using ANY outside resources (translation support).
- Writing out your Speaking response and reading it (flagged for poor pronunciation of very common words and/or a reading cadence rather than fluent or natural flow).
- Any action or evidence that the test taker may have received assistance or support in completing any portion of the task.
All the above instances will be flagged with zero score. Once these flags are observed in the report by the teacher or administrator, they should review each instance to see what the test taker submitted and if there are further questions, then reach out to Avant to discuss these. If the teacher/proctor can share with us the conditions of the testing environment and verify that the test takers did not use outside resources, including paper to write out their spoken response, we can review those responses.
By doing this, we can better support the validity of the test as it is used for higher stakes purposes. Our intention is to better partner with teachers/proctors and administrators on providing a secure testing environment and accurate scores.
Level zero (0) scores for Writing and Speaking responses will count toward the section score and will lower the overall composite score. Level zero (0) scores cannot be reset. Please refer to Avant’s Test Retake and Reset Policy.
Writing or Speaking responses will receive a zero (0) score for one of the following reasons which will be displayed on the report:
Test Agreement Violation
- Using ANY outside resources (translation support).
- Writing out your Speaking response and reading it (flagged for poor pronunciation of very common words and/or a reading cadence rather than fluent or natural flow).
- Any action or evidence that the test taker may have received assistance or support in completing any portion of the task.
Please refer to the test taker agreement items found here.
Non-Target Language
Response is given entirely in a language other than the target/test language.
No Attempt to Respond / Only ONE Target Language Word
WRITING: No response given.
SPEAKING/WRITING: Speaking response submitted with only background noise (no response), or ONLY ONE target language word. Test taker responds with “I DON’T KNOW” or similar response in English or testing language.
Off Topic
Response fails to address ANY portion of the prompt or task.
Gibberish
Language provided makes no sense to even sympathetic reader/listener.
Violent Language
Any language that is threatening, menacing or violent towards ANY participant in the narrative or to the reader.
Profane Language
Any language that is vulgar, offensive, profane, or disrespectful towards ANY participant in the narrative or to the reader.