The Centralised Skills Assessment and Validation Initiative (CSAVI) is a national initiative led by SIT to strengthen skills-based assessment and workforce mobility. CSAVI supports the development, validation, and scaling of robust assessment tools that enable fair, transparent, and industry-relevant skills recognition.
We are looking for a detail-oriented and research-driven Assessment Specialist to lead the design, validation, and continuous improvement of our assessment tools. This role is integral to ensuring CSAVI’s assessments are fair, reliable, and evidence-based, and meet national and international standards of rigour.
Key Responsibilities:
- Design competency-based assessment frameworks and instruments for various industry sectors and job roles.
- Lead the development and validation of assessment content (e.g., situational judgement tests, oral interactive assessments, simulations).
- Apply psychometric models to evaluate item and test performance, ensuring validity, reliability, and fairness.
- Conduct statistical analysis referencing appropriate theories (e.g., Classical Test Theory (CTT), Item Response Theory (IRT), and Generalisability Theory).
- Develop scoring rubrics, standard setting protocols, and examiner calibration tools.
- Analyse assessment data and generate technical reports for internal stakeholders, industry partners, and policy makers.
- Lead or support research studies on assessment innovations, test design, and psychometric methodologies.
- Ensure quality assurance in assessment delivery and advise on improvements based on analytics and international best practices.
- Support CSAVI leadership in end-to-end skills assessment life cycle processes to iteratively improve and optimise in-house processes.
Requirements:
- A recognised qualification in psychometrics, instructional design, educational measurement, applied statistics, psychology, or a related field.
- 3–7 years of experience in assessment development, test validation, or educational measurement, preferably within higher education, CET, or licensure/certification contexts.
- Strong statistical and psychometric expertise, with proficiency in tools such as R, Winsteps, SPSS, or similar.
- Familiarity with digital assessment platforms, test security, and large-scale assessment deployment.
- Demonstrated ability to translate complex data into actionable insights and communicate findings to non-technical stakeholders.
- Experience working with diverse teams, including subject matter experts, educators, and technology partners.
What We Offer:
- A rare opportunity to shape national-level assessment practices and psychometric standards.
- A collaborative work environment that blends education, innovation, and applied research.
- Professional development opportunities within SIT’s applied learning ecosystem.
- Competitive remuneration commensurate with experience and qualifications.