Psychometrician (Assistant or Associate Professor of Medicine)

The University of Central Florida College of Medicine (UCF-COM) is seeking a Psychometrician. This is a full-time (1.0FTE) non-tenure earning assistant professor of medicine or associate professor of medicine appointment. Your direct reporting relationship will be to the chair of the Department of Medical Education, and as part of your role in the M.D. program, you will also report to the associate dean for Academic Affairs. The psychometrician is responsible for conducting psychometric research and analysis to support the development, implementation, and maintenance of standardized testing and assessment programs across the College of Medicine. This position plays a critical role in ensuring the validity, reliability, and fairness of assessments used in various educational and clinical settings. Partnering with faculty and staff, this role will develop innovative measurement solutions and conduct deep-dive analysis where necessary to improve the reliability and validity of assessments in the context of a longitudinal program of assessment. There will be an opportunity to develop a psychometrics course within the Department of Population Health as part of a Master's in Public Health program, and opportunities to engage in original research projects. Minimum Qualifications:

• All candidates must have a Doctoral Degree in psychometrics, educational psychology, data science, educational measurements, statistics, bioinformatics, analytics, or a similar field from an accredited institution. The candidate's scholarly background and experience must be commensurate with the faculty rank for which the application is submitted.
• The candidate must have demonstrated experience with classical test theory (CTT), item response theory and generalizability theory.
• They must have proficiency in statistical software (e.g., SPSS, SAS) and programming languages and strong communication and collaboration skills.

Preferred Qualifications:

• Preference will be given to candidates who have substantial experience (3 years or more) in medical or health professions education.
• Experience with common medical education assessments.
• Experience with competency-based medical education (CBME) or programmatic assessment.
• Ability to translate psychometric findings into actionable insights for faculty and leadership.
• Knowledge of AI/LLMs and their application in education and assessment.
• Experience with platforms like ExamSoft, Canvas, SQL, and AI tools for text analysis and feedback generation.
• Experience with data visualization and dashboard development with platforms like Power BI and Tableau.
• Demonstrated proficiency in teaching psychometrics at the graduate level.

Additional Application Materials Required: UCF requires all applications and supporting documents be submitted electronically through the Human Resources employment opportunities website, https://www.ucf.edu/jobs/. In addition to the online application, interested candidates should upload: a cover letter; a current curriculum vitae; and a list with contact information for three (3) professional references. NOTE: Please have all three documents ready when applying so they can be attached at that time. Once the online submission process is finalized, the system does not allow applicants to submit additional documents later. Incomplete applications with missing documents cannot be considered. The selected candidate will be required to submit official transcripts (and, as applicable, U.S. degree equivalency evaluations) documenting the conferral of their qualifying academic credentials. Questions regarding this search may be directed to: [email protected]. Special Instructions to the Applicants: All candidates must be legally authorized to work in the United States without requiring immigration sponsorship, including but not limited to non-immigrant visas, such as H1B, STEM, or F1, now and in the future. Note to applicants: Please keep in mind that a job posted as 'Open until filled' may close at any time without notice. As such, we encourage you to submit your application and all required documentation as quickly as possible to ensure consideration for the posted position. Are you ready to unleash YOUR potential? As a next-generation public research university and Forbes-ranked top employer in Florida, we are a community of thinkers, doers, creators, innovators, healers, and leaders striving to create broader prosperity and help shape a better future. No matter what your role is, when you join Knight Nation, you'll play an integral role at one of the most impactful universities in the country. You'll be met with opportunities to connect and collaborate with talented faculty, staff, and students across 13 colleges and multiple campuses, engaging in impactful work that makes a positive difference. Your time at UCF will provide you with many meaningful opportunities to grow, you'll work alongside talented colleagues on complex projects that will challenge you and help you gain new skills and you'll have countless rewarding experiences that go well beyond a paycheck. Working at UCF has its perks! UCF offers:

• Benefit packages, including Medical, Dental, Vision, Life Insurance, Flexible Spending, and Employee Assistance Program.
• Paid time off, including annual (12-month faculty) and sick time off and paid holidays.
• Retirement savings options.
• Employee discounts, including tickets to many Orlando attractions.
• Education assistance.
• Flexible work environment.
• And more...For more benefits information, view the UCF Employee Benefits Guide click here.

Unless explicitly stated on the job posting, it is UCF's expectation that an employee of UCF will reside in Florida as of the date the employment begins. Additional Requirements related to Research Positions: Pursuant to Florida State Statute 1010.35, prior to offering employment to certain individuals in research-related positions, UCF is required to conduct additional screening. Applicants subject to additional screening include any citizen of a foreign country who is not a permanent resident of the U.S., or who is a citizen or permanent resident but is affiliated with or has had at least 1 year of education, employment, or training in China, Cuba, Iran, Russia, North Korea, Syria, or Venezuela. The additional screening requirements only apply to research-related positions, including, but not limited to faculty, graduate positions, individuals compensated by research grants or contract funds, post-doctoral positions, undergraduate positions, visiting assistant professors, and visiting research associates. Department College of Medicine (COM) - Medical Education DepartmentWork Schedule VariesType of Appointment RegularExpected Salary NegotiableAs a Florida public university, the University of Central Florida makes all application materials and selection procedures available to the public upon request. UCF is proud to be a smoke-free campus and an E-Verify employer. If an accommodation due to a disability is needed to apply for this position, please call 407-823-1336 or email [email protected]. For general application or posting questions, please email [email protected]. Your assistance with the University of Central Florida's Affirmative Action Plan implementation is appreciated. The University collects VOLUNTARY declarations of race and gender and uses the information to compile statistics on recruitment success. If you choose to assist, your demographic information will be used only for affirmative action. The University of Central Florida is an equal opportunity, equal access, and affirmative action employer.