Medical Education Evaluation Specialist

The Medical Education Evaluation Specialist is responsible for the development of programmatic evaluations and analysis for the Undergraduate Medical Education (UME) department across all Wake Forest University School of Medicine (WFUSM) campuses. This role will collaborate with the UME department and Wake Forest University School of Medicine leadership and staff, Course/Clerkship Directors, Faculty and Students in designing and reporting on student assessment outcomes from testing events, and student evaluation/measurement projects.

This position will report directly to the Director, Assessments and Evaluations. The candidate will be a team player focused on using assessment data for the greater good of the Wake Forest University School of Medicine – Undergraduate Medical Education (UME) program.  

Minimum Requirements:  

• Masters / Ph.D degree in Evaluation and Measurement, Biostatistics or Statistics required.
• At least three (3) years of experience working in an educational environment and expertise in both quantitative and qualitative assessment methods preferred.
• Experience in analyzing data using statistical package(s), SAS and SPSS.
• Ability to organize data and communicate research, evaluations and measurement or statistical concepts to non-statisticians
• Ability to analyze both quantitative and qualitative data.
• Experience with the National Board of Medical Examiners
• Experience with SACSCOC accreditation;
• Experience as a SACSCOC evaluator
• High energy, team-oriented, people-focused with a passion for excellence consistent with WFUSM’s culture and core values and operating with the utmost integrity.

Essential Functions: 

• Leads the process of developing and designing assessment methodology to achieve measurement/evaluation objectives using demonstrated skills in quantitative and qualitative statistical methodology and statistical packages (SAS, SPSS).
• Meets with each course/clerkship director(s) to review assessments/exams.
• Provides a summary of the assessments, including but not limited to, item analysis, suggestions of item revisions and corrections to improve and enhance the exam.
• Oversees updates and support faculty in revising assessment exams, including but not limited to, item revision, distractor modifications and other improvements.
• With limited assistance, provides direction regarding UME evaluation needs and designs a plan and timeline to meet the needs.
• Merges and analyzes data and prepares tables for interim and final reports related to the assessments and course evaluations for UME projects under deadline constraints.
• Maintains an active table of reporting for assessment data
• Delivers final reports to Deans within Curricular Affairs, CRESS committee, and other groups (e.g. Alpha Omega Alpha reporting, etc.)
• Develops and implements new methodology for student evaluation as needed in specific areas of the medical school curriculum.
• Provides written reports with data analysis to the Deans of UME and Directors concerning student progress, aggregate assessments, comparisons across time and compared to national average, or as directed by the objectives of the report.
  • This includes, but not limited to, the development and delivery of the MD program’s Evaluation report which will summarize key assessment and evaluation data for the MD Program annually.
  • This report is developed annually in August/September and delivered to the Deans of UME and UMECC subcommittees in September.
• Assumes leadership responsibilities in evaluations/measurement/assessment projects, e.g. serving on committees, supervision of project personnel, coordination of quality control efforts, and serving roles on accreditation teams.
• Develops and implements new innovative procedures in the areas of data collection, quality control, presentation of results, and statistical analyses.
• Manages projects related to evaluations and responsible for all outcomes associated with projects. This role will manage the work of other undergraduate medical education staff members serving on the same projects. Provide direction and guidance to support personnel.
• Provides training to faculty and staff related to online testing systems, test item question statistics, etc.
• Collaborates and leads other areas (including student affairs, admissions, and LCME/Dean’s Office) in reporting on undergraduate medical education related data.
• Ongoing review of program evaluation ensuring all accreditation standards are met for LCME and SACSCOC accreditation in collaboration with Office of Education Institutional Effectiveness and Compliance.
• Provides direction for undergraduate medical education for activities related to and/or required to maintain LCME accreditation.
• Interfaces with other departments and external organizations [such as accreditation agencies, certification organizations, National Board of Medical Examiners (NBME), Association of American Medical Colleges (AAMC)] as needed to perform job functions.
• Develops and delivers presentation of evaluation/assessment results at internal/external meetings as directed.
• Represents departmental leaders in meetings, conferences, and other affairs as needed.
• Negotiates and makes decisions in areas delegated on behalf of departmental administrators.
• Responds to student requests for assistance and to faculty requests with data and/or research needs.
• Act as a Chief proctor for UME in the testing environment
• Performs other related duties incidental to the work described herein
• Other duties as assigned.

Preferred Requirements/Core Competencies:  

Excellence: 

• Strives continuously for improvement in work performance.
• Acknowledges and takes responsibility for commitments to the university.
• Contributes to the university's success by consistently delivering quality results in the performance of job duties and responsibilities.

Respect:

• Treats others with courtesy, respect and dignity in the workplace
• Promotes cooperation through open and honest communication, considering others’ ideas, thoughts, and opinions.

Integrity

• Upholds high ethical standards of conduct in job performance.
• Takes responsibility for actions.
• Respects and complies with department and university policies, procedures.

Service Mindset

• Address our students, Deans, faculty and staff needs and expectations within the department
• Mentors and guides department/section staff, sharing knowledge and best practices.
• Maintains positive interactions with students, Deans, faculty and staff, ensuring professional conduct and consistent application of university policies and procedures and follow up on requests.
• Assumes responsibility for addressing complex and/or unusual requests.

Organizational Standard

• Foster a collaborative and productive work environment that advances the program’s operations and initiatives
• Supports the program’s procedures and work rules for compliance with regulations and university policies; leads and/or participates in the development and revision of applicable policies/procedures.
• Competently represents the program through interactions with the university community and/or external constituents.
• Possesses comprehensive knowledge and skills in a technical area.
• Effectively applies expertise to troubleshoot existing systems and develop solutions
• Competent to learn new technologies and integrate them with existing technology.
• Strives continuously for improvement in work performance.

Specific Job Duties: 

• Supports continuous academic program assessment (curricular and co-curricular activities) and improvement of student learning through consultation, data analysis, mentoring and hands-on training.
• Leads the development, organization, analysis and reporting of student learning outcomes and related activities to support planning activities.
• Promotes internal and external communication of assessment results.
• Supports the ongoing development and implementation of comprehensive outcomes assessment programs for all academic and administrative units that support the goals the university's strategic plan and Continuous Quality Improvement (CQI).
• Records, stores, manages, and disseminates confidential and sensitive assessment data, as appropriate.
• Partner with the Office of Institutional Effectiveness to implement and sustain a climate of assessment strategy and methodology.
• Demonstrate and uphold Atrium Health’s Culture Commitments:

We create a space where all Belong 

We Work as One Team to make great things happen 

We earn Trust in all we do 

We Innovate to better the now and create the future 

We drive for Excellence – always