April 8 – 9, 2025
The Performance Testing Council is supported in part by our Cornerstone Member:
Day 1 / 10:00am – 10:05am CT
Welcome and Summit Kick-off
Day 1 / 10:05am – 10:35am CT
In today’s rapidly evolving job market, the demand for verifiable, industry-relevant skills is higher than ever and has led to an increasing emphasis on “Skills First” approach, especially as it applies to hiring and talent management. Microsoft’s Applied Skills credential program addresses this need by offering a way for IT professionals and developers validate their expertise through an interactive assessment designed to allow them to demonstrate their skills at solving pressing business problems that organizations are struggling to find talent to solve. This presentation will explore why Microsoft decided to add a new credential to our certification program, demonstrate the experience, and share lessons learned and key considerations for other programs as they explore a “skills first” approach to their offerings.
Learning Objectives:
Day 1 / 10:35am – 11:35am CT
This session will highlight the value of competency modeling in enhancing performance assessments beyond traditional multiple-choice testing. The session will define the value, discuss strategic considerations for credentialing leaders to consider, and how they can incorporate that into a successful performance-based assessment. In addition, attendees will learn how competency modeling provides a robust framework for identifying, defining, and measuring key KSAOs (knowledge, skills, abilities, and other characteristics) and outcomes across performance levels essential to real-world success. Discover how aligning performance assessments with competencies improves their validity, fairness, and ability to inform critical decisions in credentialing, education, hiring and employment activities, and professional development. This session will empower you to leverage competencies to drive meaningful outcomes and actionable insights.
Learning Objectives:
Day 1 / 11:40am – 12:25pm CT
The introduction of generative AI in November of 2022 caused a seismic shift in the assessment industry. Exam developers started looking for ways to understand and leverage the technology in the creation of certification exams. As more systems become enabled with AI, however, a new challenge is emerging: effectively measuring a candidate’s practical skills using systems with AI assistants built into them.
Learning Objectives:
Day 1 / 12:25pm – 12:55pm CT
This session will delve into the critical role of performance testing within the framework of ISO/IEC 17024. Attendees will gain an understanding of the specific requirements in the ISO/IEC 17024 standard that address performance testing and get an overview of proposed changes to the standard that could impact performance testing.
Since its first publication in 2003, the ISO/IEC 17024 standard, Conformity assessment — General requirements for bodies operating certification of persons, has become the global benchmark in defining the competence requirements for bodies operating certification of persons. The standard outlines requirements for independence, impartiality, and scheme development, and it requires evidence for the claim that examinations are fair, valid, and reliable.
Learning Objectives:
Day 1 / 12:55pm – 1:00pm CT
Day 1 wrap-up
Day 2 / 10:00am – 10:05am CT
Day 2 Kick-off
Day 2 / 10:05am – 10:50am CT
In this session, we will delve into the fundamental principles that underpin performance-based testing (PBT), exploring its numerous benefits such as enhanced skill measurement and real-world applicability. Additionally, we will address the challenges that practitioners often face, including the design and implementation complexities. Through this discussion, participants will gain a comprehensive understanding of how to effectively measure skills in a real-world context, ensuring that assessments are both valid and reliable. Whether you’re new to PBT or looking to refine your approach, this session will provide valuable takeaways for implementing and optimizing performance-based assessments.
Learning Objectives:
Day 2 / 10:50am – 11:20am CT
Live-in-the-application exams typically require software to be installed on the test center computers. For our IT Specialist programming exams, we wanted to be able to test candidates’ ability to write code without requiring special software on the test center computers. We also wanted a solution that would load quickly and score reliably.
We are conducting a pilot using containerization for creating a lab section in our IT Specialist Python exam. This presentation discusses our strategy for delivering and scoring items in a container, as well as lessons learned.
Learning Objectives:
Day 2 / 11:25am – 11:55am CT
Subject Matter Experts (SMEs) play a critical role in performance-based testing (PBT). As raters, they are often the sole decision makers when determining who passes or fails a PBT exam. A strong SME panel to rate the candidates’ PBT submission is an organization’s greatest strength for ensuring that future certificants meet the credential’s standards.
Building a strong rating team requires careful planning, without which the PBT exam cannot function. In this presentation, we will walk you through the four stages of the SME lifecycle: recruitment, training, go-live, and retirement. Within each stage, we will discuss the critical elements that need to be addressed in order to build a strong rating team that can produce results that are replicable and without bias.
Learning Objectives:
Day 2 / 11:55am – 12:25pm CT
Situational Judgment Tests (SJTs) are reshaping the assessment landscape, offering a unique way to evaluate decision-making, critical thinking, and professional competencies in a higher fidelity manner than typical multiple-choice formats. But where do they provide the most value? This session will explore the mechanics of SJTs, the key factors driving their increasing adoption, and the scenarios where they are the best fit. Using two brief case studies to illustrate, we’ll examine how SJTs enhance performance assessment, when they should supplement or replace traditional methods, and best practices for implementation.
Learning Objectives:
Day 2 / 12:25pm – 12:55pm CT
The testing, education, and accreditation communities have been awash in rumors and fears in the wake of President Trump’s Diversity, Equity, and Inclusion (DEI) Executive Orders (EOs) and other executive branch documents. The purpose of this presentation is to clarify for the Performance Testing Council community which provisions of President Trump’s EOs are applicable to testing bodies (both licensing and certifying bodies) and what steps they should take to minimize legal exposure.
Learning Objectives:
Day 2 / 12:55pm – 1:00pm CT
Summit Closing
We want to hear your ideas. There are many ways you can get involved today.
One of the delights of doing a tough job is sharing with others how you did it. There are plenty of people who would love to hear how you overcame obstacles to create your performance test. Tell us how you did it by presenting in one of our short webinars.
Send us a note
The PTC hosts numerous events throughout the year, from webinars to bi-annual Summits. Someone likely has already tackled the very issue you’re experiencing now. Come learn, share, and network with some of the best minds working in the field
See all events
Becoming a member of the Performance Testing Council provides valuable benefits that can elevate your testing strategies. Share performance testing resources, network with industry experts, and receive exclusive member discounts on upcoming Performance Testing Council events.
Go to application
