Location: Chicago, IL
Job Description:
- Produces and uses in-depth knowledge of current research to inform test design and development and to anticipate problems and their solutions.
- Provides leadership within the OLA and across campus on all aspects of language assessment.
- Consults with departments, programs, divisions and other offices about language testing needs, implementation, as well as how testing and assessment help guide and focus instruction and academic programming.
- Oversees the development and updating of foreign language and ESL tests in consultation with the programs, units and instructors using them. Exams may include placement exams, proficiency exams, graduate reading exams, and English as a second language (ESL) exams in multiple skill areas.
- Facilitates ESL testing across all divisions and units of the University, including the development of specialized assessments for specific programs.
- Ensures and maintains the validity and reliability of tests administered in the OLA. This includes the analysis of test data, including scores and ratings earned by individuals and groups, and scoring and rating by individual graders and across tests and their different versions.
- Designs and implements evaluative instruments, such as learner and instructor evaluations, to determine the validity of different tests. Leads discussion groups and workshops in support of ongoing evaluation of student's academic abilities and/or teacher-designed assessments. Monitors and documents progress and participation.
- Investigates, selects and implements multiple platforms, applications and formats in order to offer tests online, while preserving their integrity and making them accessible to all test users regardless of issues related to geographical location, accommodation of any learning issues or disabilities, and accessibility of WIFI or other necessary technical support.
- Serves as consultant to University offices to inform policy decisions, including Provost’s office, UChicagoGRAD, Admissions, OIA, and others as needed, providing expertise, referenced materials, white papers, and other resources.
- Plans strategically for all OLA hires, in anticipation of current and future needs as programs grow or are established.
- Oversees training of all OLA staff as necessary, both professional and operational, especially in areas of assessment literacy and standards.
- Directs the seasonal hiring and training of internal testers, proctors and graders to meet OLA needs. Updates training as necessary.
- Hires and manages multiple external testers, proctors and graders as needed to ensure sustainable supply and range of new assessments, especially in anticipation of broadened marketing initiatives.
- Organizes regular calibration/norming sessions of both internal and external individuals accurate scoring and rating of all tests.
- Leads and collaborates on research and publication initiatives across professional staff in the OLA and CLC.
- Designs and holds workshops for instructors and others related to assessment, assessment practices, test design and development, and social science research.
- Leads discussion groups and workshops in support of ongoing evaluation of student's academic abilities and/or teacher-designed assessments.
- Serves as adviser to instructors, cohorts of instructors, and graduate students for research projects related to assessment, test design and development, and domain analysis research.
- Works to stay up to date on research methods and theories related to language assessment as well as national and international standards for test design and administration.
- Presents at professional meetings or publishes in professional journals to disseminate new or innovative assessment practices.
- Active in national and international assessment professional organizations, especially taking a leadership role for conference planning and implementation.
- Articulates a vision for the OLA as both a hub and resource for language testing and a revenue-generating center offering its assessment products nationally.
- Works to develop and adapt systematic, strategic processes in all areas of OLA’s endeavors.
- Ensures the stability and growth of the OLA by focusing on its accomplishment of strategic objectives and providing leadership for current and future endeavors.
- Collaborates with the Director of the CLC to lay the groundwork and ultimately establish new programs for both internal and external audiences, including mini-course offerings in niche areas for professional development and graduate degree programming.
- Disseminates research and test products through scholarly publications and participation and leadership in professional organizations, raising the visibility of OLA’s products and the University itself.
- With leadership and knowledge gained through executive training programs, lays the groundwork for major OLA and CLC initiatives, working closely with CLC personnel and the Office of Legal Counsel to develop policy and documentation in order to protect all intellectual property.
- Takes a strategic approach to multiple OLA budgets, accounting, and revenue to enable program development and sustainability.
- Oversees outreach on campus and directs marketing to support initiatives beyond campus.
- Writes an annual report on the OLA for insertion into the CLC annual report.
- Manages the academic and para-curricular programs by providing a range of services, including serving as editor for publications; serving on selection committees for select grants; and providing leadership on matters of governance and curriculum.
- Is accountable for the implementation of new developments in curriculum and student activity policy.
- Executes foundation relations and fundraising strategy. Acts as an official representative at alumni, donor, and friend events and may undertake philanthropic initiatives when required.
- Performs other related work as needed.
Preferred Qualifications
Education:
- PhD in language assessment or a related field.
Experience:
- 5+ years experience in language teaching and testing at the post-secondary level.
- Background using multimedia for teaching and/or testing and in data management.
- Facility with the application of development theories and frameworks in contemporary test design.
- Managing a variety of budgets such as payroll, accounts receivable, and operating budgets.
Technical Skills or Knowledge:
- ACTFL Oral Proficiency Interview training.
- Demonstrated facility with Excel, Microsoft Office.
- Proficient with computers and standard software applications including Microsoft Office Suites, Google Docs, email and calendaring programs.
- Knowledge of and facility with test and survey/research platforms (e.g. Qualtrics).
- Knowledge of and experience with contemporary test validation theories and frameworks.
- Knowledge of another language other than English at the ACTFL.
- Expert knowledge of statistical analysis of test data using Facets/SPSS.
Preferred Competencies
- Design or assist others in the design in order to assess various language proficiencies through innovative use of multimedia.
Working Conditions
- Work occasional evenings or weekends.
Application Documents
The University of Chicago is an Affirmative Action/Equal Opportunity/Disabled/Veterans Employer and does not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national or ethnic origin, age, status as an individual with a disability, protected veteran status, genetic information, or other protected classes under the law. For additional information please see the University's Notice of Nondiscrimination.
Staff Job seekers in need of a reasonable accommodation to complete the application process should call 773-702-5800 or submit a request via the Applicant Inquiry Form.
The University of Chicago's Annual Security & Fire Safety Report (Report) provides information about University offices and programs that provide safety support, crime and fire statistics, emergency response and communications plans, and other policies and information. The Report can be accessed online at: securityreport.uchicago.edu. Paper copies of the Report are available, upon request, from the University of Chicago Police Department, 850 E. 61st Street, Chicago, IL 60637.
#J-18808-Ljbffr
