Rater Eligibility Requirements:

• Hold a Bachelor’s degree or higher
• Hold certification/license and at least 2 years of recent or current experience in a Foreign language or teach graduate level courses in an accredited World or Foreign language program or a field related to Foreign language teaching and learning
• Be currently teaching in a World/Foreign language classroom setting
• Be proficient in the English language
• Be willing to abide by established ETS essay scoring standards and procedures
• Attend/complete all required trainings and remediation sessions, if necessary
• Demonstrate the ability to work well in group situations
• Ensure they maintain technological and confidentiality requirements

           Previous scoring experience preferred.

Additional Qualification Requirements:

• have experience with previous-level positions (e.g., experience as a rater to become a Scoring Leader, etc.).
• meet minimum performance standards for raters.
• have the consistency of scoring, validity agreement, and high calibration as well as good communication and other qualities.
• receive special training, including such things as attending a “Train the trainer” session or online course/video. This training must be renewed annually unless there is a specific program standard determining an alternative frequency of renewal.

Also Required:

• Willingness to accept established ETS essay scoring standards and procedures
• Be open to the concepts and principles of holistic scoring
• Demonstrate the ability to work well in group situations
• Be able to score from secure home or office locations and have the necessary Internet-based scoring equipment. (Please note that these requirements are subject to change.) For security reasons, Raters cannot use shared office computers, or work in public areas where information may be accidentally viewed, i.e. airport terminal, hotel lobby, Internet cafe, etc.
• Provide equipment and are responsible for ensuring that all hardware and software is in good working order.
• Meet agreed-upon commitments to the scoring schedule and devote their full attention to the scoring process during each session
• Be willing to accept established scoring standards and procedures be able to appropriately and consistently apply scoring rubrics
• Be able to accurately evaluate constructed responses
• Have at least the minimum hardware, software, and other requirements necessary to access and use ETS’s Online Network for Evaluation (ONE)

Roles and Responsibilities

• Raters are expected to appropriately apply their knowledge of teaching by reading and understanding the seven constructed-response questions, which are based on scenarios and sets of documents that a school leader might encounter.
• Raters are required to analyze teaching situations and data and make appropriate determinations of examinees written responses, in accordance with the scoring guide. Raters are expected to score candidate constructed response items by accurately applying the scoring guide consistently.
• Raters are trained to score responses holistically, evaluating the overall quality of thinking and writing according to the criteria in scoring guides. Raters assign scores ranging from 3 (thorough understanding) to 0 (little to no understanding).
• Raters are expected to begin each session by completing training and practice scoring to help calibrate their judgments against standards. Raters are expected to complete training and calibration in a timely fashion and in accordance with program guidelines.
• Raters are expected to work with their assigned Scoring Leader (SL) and Content Scoring Leader (CSL) in a manner that promotes teamwork and cohesiveness (i.e. attitude, initiative, flexibility, openness).
• Raters are expected to log in to the ONE system at the beginning of every assigned shift and score for the entire shift in an accurate and timely manner.