Job Description
Position Overview
Assessment & Technology Solutions (ATS) is seeking a Psychometrician Associate to support the operational psychometric work for a K-12 large scale assessment program, including a statewide general education summative assessment, interim assessment, and an English language proficiency assessment. Responsibilities include statistical tasks such as cleaning data, managing data sets, and running descriptive and inferential statistics; psychometric tasks such as item and test analysis, calibration, equating and scaling, differential item functioning, and standard setting; using classical and IRT psychometric models to analyze large-scale assessment data; performing quality assurance checks on analysis and reports; collecting reliability and validity evidence; preparing technical documents; and other duties as assigned.
At least 3 years of full-time equivalent experience working on a large-scale operational assessment is required.
Job Description
- Use various types of psychometric models to analyze large-scale assessment data. Conducts all aspects of operational work related to scoring and reporting including data cleaning, key validation, calibration, equating, scoring, quality control, and reporting. Produces item and test analyses and summary data tables for use in technical documentation. Performs other psychometric tasks including differential item function and data analysis for standard setting.
- Prepare technical documents, reports, and manuals. Work under directions of senior staff to document technical qualities of various aspects of the testing program, including the annual technical manual and stand-alone study reports. The tasks include create tables, charts and graphs to communicate technical information and write narratives summarizing the findings.
- Other duties to support the research and psychometrics team
Position Requirements
- This position will require attendance at regularly scheduled meetings, onsite or through telecommunication platforms.
- This position allows for a telework or hybrid work location for well-qualified candidates. A telework position may be required to travel up to four times per year.
Required Qualifications
- Master's degree in educational measurement, psychometrics, or other closely related field.
- Experience with quantitative analysis and coding in R.
- Experience applying classical and IRT psychometric models such as item and test analysis, calibration, equating, scoring, and scaling.
- Experience managing multiple priorities and deadlines, including adapting in response to changes in work priorities and processes, as evidenced in application.
- Detail oriented with strong organizational skills.
- At least 3 years of full-time equivalent experience working on a large-scale operational assessment program (e.g., state large-scale or district-level assessments).
Preferred Qualifications
- Experience with quantitative analysis in multiple IRT and other statistical software (e.g., flexMIRT, ConQuest, R).
- Extensive experience writing scripts in R as evidenced in application materials and interview (e.g., building packages, vignettes, etc.).
- Strong problem-solving skills as evidenced by application materials and interview.
- Effective oral and written communication skills for technical audiences.
Additional Candidate Instructions
A complete application includes an online application, your resume, a letter detailing your professional experiences that align with the required and preferred qualifications, and contact information for three professional references. Only complete applications will be considered.
Review of applications begins on July 23, 2024 and continues as needed to collect a pool of qualified applicants. To ensure consideration, apply before the application review date.
Contact Information to Applicants
Matt Copeland, matt.copeland@ku.edu
Advertised Salary Range
Minimum $70,000, commensurate with experience
Work Schedule
M-F; 8-5
Application Review Begins
Tuesday July 23, 2024
Anticipated Start Date
Monday September 16, 2024
#J-18808-Ljbffr
