Assessment Innovation and Alignment Manager

How to Apply

A cover letter is required for consideration for this position and should be attached as the first page of your resume. The cover letter should address your specific interest in the position and outline skills and experience that directly relate to this position.

Job Summary

The Assessment Innovation and Alignment Manager is responsible for ensuring that exams remain fit for purpose from a content perspective by systematically evaluating the design and specifications of the exams, tasks, and constructed-response rating processes on an ongoing basis. The Assessment Innovation and Alignment Manager will research and evaluate potential improvements to assessment tasks and rating processes based on these evaluations and investigate the content implications of psychometric analyses conducted by the psychometric team. They will make recommendations for and lead the execution of changes to the design of test content and rating rubrics and processes.

Responsibilities*

The Assessment Innovation and Alignment Manager will ensure exams remain fit for purpose from a content perspective by systematically evaluating the designs and specifications of the exams, tasks, and constructed-response rating process on an ongoing basis. 

Duties include:

• Using research, knowledge of test validity principles, and theories of second language acquisition, as well as experience in rating scale development and rater training to evaluate statistical analyses of rater performance and develop rater management and feedback processes.
• Using knowledge of the Common European Framework of Reference for Languages (CEFR), psychometrics, test validity principles, and theories of second language acquisition to evaluate and document alignment of Michigan Language Assessment exams to the CEFR.
• Using knowledge of psychometrics, Michigan Language Assessment's item banking system, test specifications and compilation processes, and test validity theory to evaluate test item performance and determine whether items meet requirements.

Required Qualifications*

• Ph.D. in Applied Linguistics, Language Testing, Language Education, or related field
• More than 2 years of experience in a large-scale, high-stakes language testing program, including:
  • applying theories of second language acquisition and test validity to test and rating scale development;
  • aligning tests and/or test items to a language proficiency scale such as the CEFR; item writing and/or review;
  • training and evaluating raters for standardized tests of English as a foreign language (EFL) writing and/or speaking skills;
  • and developing test specifications and/or rating rubrics for standardized EFL tests.

Desired Qualifications*

• Experience working with CEFR
• Experience teaching English as a foreign or second language
• Experience with digitally-delivered educational content and assessments
• Experience working with Michigan Language Assessment products and processes

Work Locations

Michigan Language Assessment is seeking candidates located in or around Ann Arbor and supports a hybrid schedule with occasionally, allowing for 95% of the work to be done remotely from home.
 

Additional Information

For additional information, please visit our website at https://michiganassessment.org/.

Application Deadline

Job openings are posted for a minimum of seven calendar days.  The review and selection process may begin as early as the eighth day after posting. This opening may be removed from posting boards and filled anytime after the minimum posting period has ended.

U-M EEO/AA Statement

The University of Michigan is an equal opportunity/affirmative action employer.