Data Forensics Psychometrician

Description

Title: Data Forensics Psychometrician

Location: Remote-US

Salary: $93K-$95K

About PSI

We are PSI Services. We power world leading tests. Delivered with trusted science and the very best test taker experience. PSI supports test-takers on their journey to pursuing dreams and gaining certifications that are important to them. They believe that their dreams are worth working for; that their dreams are worth the effort. And we believe that too. This is our core purpose, to empower people to achieve their dreams. We do this by being the best provider of workforce solutions, which foster both technology and science to deliver the best solutions for our test takers.

We are searching for top talent to join our PSI team and help grow our products and services. We have a creative, supportive and inclusive culture where we empower people in their careers to be their authentic self and make the most of their great talent.

At PSI, we are committed to helping people meet their potential and we believe that promoting diversity, equity and inclusion is critical to our success. That's why you'll find these ideals are intrinsic to our company culture and applied throughout the employee lifecycle.

Learn more about what we do at: ***/

About the Role

The Data Forensics Psychometrician is responsible for the detection of fraudulent test taking behaviours using advanced statistical methods. The person in this role is expected to have advanced training and expertise in measurement, research methodology, and data analytics.

This is a full-time permanent role, with flexible hours around core office availability Monday to Friday. The role can be performed remotely, with occasional travel (up to 15%) required for meetings, events and workshops.

Role Responsibilities

• Design and conduct data analytics to support the security and integrity of high stakes examination programs.

• Design and conduct R&D studies to evaluate, validate, and optimize the use of secure test delivery modes and technologies (including AI), while preserving validity and fairness of assessments.

• Develop and implement frameworks for data forensic analyses to detect test fraud (cheating, IP harvesting/theft, exposure, breach, drift, and other testing anomalies).

• Support investigations of potential test fraud at the candidate, test site, school, and other aggregate levels.

• Design and generate exam program surveillance reports, summarize and interpret findings and make recommendations.

• Evaluate test items and exams to identify potential test integrity issues.

• Assess the potential impact of test security breaches, cheating, and related issues.

• Develop test scoring (rescoring) solutions to address security-related anomalies.

• Conduct ad hoc analyses to investigate test security-related issues and special inquiries.

• Comply with industry best practices, standards and guidelines for test security analytics and forensics monitoring (e.g., ATP).

• Write technical reports.

• Present findings to key stakeholders.

• Represent PSI in the professional testing community (e.g., ATP, COTS, NCME, ICE).

Knowledge, Skills and Experience Requirements

• Master's degree or Ph.D. in Educational Measurement & Statistics, Quantitative Research Methods, Industrial/Organizational Psychology, Psychometrics, or highly related discipline.

• At least 2 years' experience in test development and psychometric methods required.

• Graduate training and experience in psychometrics, measurement theory, test development, validation, item bias, standard setting.

• Skill in using statistical and data science software (R, SAS, SPSS, Python), Excel, and Word required.

• Experience in using of IRT software programs (i.e. Winsteps, Parscale, BILOG) and CTT applications strongly preferred.

• Experience with large-scale testing programs, including Certification and/or Licensure applications preferred.

• Experience with NCCA and ISO 17024 accreditation standards strongly preferred.

Benefits & Culture

At PSI, our culture is to be transparent and fair. That's why all of our roles have been benchmarked at a competitive rate against the local market they are based in. To be transparent all of our adverts now include the salary so you can see if we align with your expectations when looking for your next role.

In addition to a competitive salary, we offer a comprehensive benefits package and supportive culture when you join us. This includes:

• 401k/Pension/Retirement Plan - with country specific employer %

• Enhanced PTO/Annual Leave

• Medical insurance - country specific

• Dental, Vision, Life and Short-Term Disability for US

• Flexible Spending Accounts - for the US

• Medical Cashback plan covering vision, dental and income protection for UK

• Employee Assistance Programme

• Commitment and understanding of work/life balance

• Dedicated DE&I group that drive core people initiatives

• A culture of embracing wellness, including regular global initiatives

• Access to supportive and professional mechanisms to help you plan for your future

• Volunteer Day and a culture of giving back to our community and industry through volunteering opportunities

Equal Opportunity Employer/Protected Veterans/Individuals with Disabilities

The contractor will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. However, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with the contractor's legal duty to furnish information. 41 CFR 60-1.35(c)