2023 AAPPL Rater Survey

Please help the ACTFL QA Team better support you! By filling out this survey, you will contribute valuable information that will improve our QA Program. It is estimated to take less than 10 minutes to complete. We deeply appreciate you!

Question Title

* 1. Full name

Question Title

* 2. Email

Question Title

* 3. AAPPL Language(s) you rate

Arabic

Chinese

English

French

German

Italian

Japanese

Korean

Portuguese

Russian

Spanish

Question Title

* 4. How long have you been an AAPPL Rater?

1 year

2 years

3 years

4+ years

Question Title

* 5. How often do you rate AAPPL tests during the rating season?

Daily

Weekly

Monthly

Other

Question Title

* 6. How would you rate your current performance as an AAPPL rater on a scale of 1-5?

1 - Very Poor (I consistently struggle with most aspects of the rating process and frequently make errors)

2 - Below Average (I often encounter difficulties and am not always confident in my ratings)

3 - Average (I am generally competent in my ratings, but there is room for improvement in some areas)

4 - Above Average (I am confident in my ratings and make few errors, though there are occasional challenges)

5 - Excellent (I am highly proficient in my ratings, consistently accurate, and feel confident in handling all aspects of the rating process)

Question Title

* 7. What aspects of rating do you find most challenging? (i.e., The Advanced level, The ILS or PW mode, the difference between the SE and MM sublevels, etc.)

Question Title

* 8. In which areas do you think you need the most improvement?

Question Title

* 9. Do you have any specific suggestions or ideas that could help improve the rating process?

Question Title

* 10. Have you recently attended office hours with an AAPPL QA Advisor?

Yes

Question Title

* 11. Have you recently accessed the AAPPL Refresher course in our ACTFL QA Learning Platform?

Yes

Question Title

* 12. How effective do you find the current norming, office hours, and resources available to you on a scale of 1-5?

1 (Not effective at all)

2 (Slightly effective)

3 (Moderately effective)

4 (Very effective)

5 (Extremely effective)

Other (please specify)

Question Title

* 13. Would you be interested in rating practice exercises as part of your rater development process?

Yes

Question Title

* 14. What additional training materials or resources do you believe would help your rating skills?

Question Title

* 15. What are your preferred learning methods? Please select all that apply.

Visual

Auditory

Hands-on

(Synchronous) Live Office Hour via Zoom

(Asynchronous) Recorded Webinars

(Asynchronous) Self-paced reading materials and reminders

Other (please specify)

Question Title

* 16. Do you prefer structured learning sessions (webinars, normings) or self-paced learning (online modules, reading materials)?

Structured learning

Self-paced learning

Question Title

* 17. What can we do to improve the support provided to you as a rater?

Question Title

* 18. How comfortable are you with using technology as part of your ratings and trainings?

0 (Very uncomfortable)

Average comfortability

5 (Very comfortable)

Clear

i We adjusted the number you entered based on the slider’s scale.

Question Title

* 19. Is there anything not being addressed in our QA Activities that you think is important?

Question Title

* 20. What motivates you the most in your role as a rater?

Question Title

* 21. Please provide any additional comments or feedback that you think would help us in our QA efforts.

Thank you for taking the time to complete this survey! Your feedback is very important to us!