Frequently Asked Questions

Does growth of performance testing mean traditional tests will go away?
No. Performance testing is a new layer of value, supplementing traditional cognitive tests. Multiple choice has its place and is not going away.

Will performance testing cannibalize market for cognitive tests?
No. It will create a new market; performance testing helps to differentiate, maintain competitive offerings. The two go together: multiple choice tests can be a pre-requisite to performance tests. Traditional testing faces risks largely of its own making.

If I offer a performance test will it lower the perceived value of my traditional tests?
No. Traditional tests can be positioned to track to and pre-qualify for performance tests. People will take both.

Why should I care about standards for performance testing?
Same reason as for traditional tests: your customers deserve an independent measure of validity. Standards are coming and you want to participate in their development, even if you don't have performance testing plans right now.

Why should I invest in the Performance Testing Council?
The Performance Testing Council is where the standards will be developed, and the work of the Performance Testing Council leverages your own R&D investments

We would join but we aren't sure how to apply classical test theory to performance testing.
Yes, exactly the reason to get involved in the Performance Testing Council! That's what the Performance Testing Council investigates. Some vendors have successfully applied psychometrics to performance testing with good results. Classical test theory needs to be adapted to performance testing: this is what the Performance Testing Council will be focused on. Learn more by joining and actively participating.

We have already decided we can't do performance testing. No plans for performance testing. Why should we join the Performance Testing Council?
Evaluate performance testing on a much bigger scale, give it a fresh look, supported by experts and practitioners. Performance testing is growing, as success of many the Performance Testing Council members demonstrates. Learn about successful performance tests in a range of contexts. Invest in the future: opportunities you have not thought of yet.

We believe performance testing provides a better performance measure, but can it scale?
Yes, it can. Test delivery is a major area of the Performance Testing Council innovation, for standards and solutions. Performance testing has advantages even if not as ubiquitous as traditional testing.

Can performance testing be brought to market at competitive pricing?
Yes, it can. Major IT vendors have pushed the price of performance testing down to equal or less than cost of traditional tests. The Performance Testing Council members share information on how they do it.

Why would I share data and methods with other Regular Members at the Performance Testing Council?
Only by sharing data and methods can standards be developed. Your data and methods kept to yourself don't help you create or provide an independent measure of validity.

What are protections for confidential information and Intellectual Property?
Sharing of data or material is strictly voluntary. The Performance Testing Council Bylaws bind Members to non-disclosure between one another and the Performance Testing Council. Ownership of a Member's IP remains with that Member unless otherwise assigned in writing by that Member.

How do I insure that the standards developed at the Performance Testing Council will be appropriate and useful by my industry and company?
Join the Performance Testing Council and get involved! Participate in Practice Area Committees on issues related to your industry and company. The Performance Testing Council focus is on valid science. Proposed standards are balloted to entire voting membership, and there is an appeal process. The Performance Testing Council processes are modeled on successful standards development organizations (IEEE, ANSI, ISO).