From December 18th, 2017, (ISC)² will be changing the Certified Information Systems Security Professional (CISSP) exam from the current fixed-form, linear exam format to a Computerized Adaptive Testing (CAT) format. Even though the current CISSP exam has been computer-based since June 2012, the new CAT format will provide a remarkably different test-taking experience. The CAT exam format aims to provide a more precise evaluation of the candidate’s ability while allowing candidates to complete the exam in half the time. The new exam format will be introduced for all English CISSP exams worldwide.
1. What is Computerized Adaptive Testing (CAT)?
Computerized Adaptive Testing (CAT) is a computer-based testing format in which candidates are presented with questions that are uniquely tailored to their individual ability. While traditional linear fixed-form exams present candidates with an ordered series of questions, CAT exams adapt the difficulty of questions presented to candidates depending on their responses to previous questions. The adaptive algorithm allows the CAT exam to measure the candidate’s ability in the most efficient way possible. More information about adaptive testing can be found at the IACAT website.
2. How Does It Function?
All CISSP CAT exam candidates start with items that are below the passing standard. After a candidate has addressed an item, his/her ability is re-estimated by the candidate based on the difficulty level of all presented items and the provided answers. With the answer to each additional item, the system becomes more precise at estimating the ability of candidates – collect as many details as possible about the true ability level in a way that’s more efficient than conventional, linear exams.
The precise evaluation ensures that students can minimize the allotted exam administration time to 3 hours from 6 hours. Also, the number of items required to access the ability of the candidate is reduced from 250 items on a fixed-form linear exam to just 100 items on the CISSP CAT exam.
The passing standard and content outline for the two versions of the exam are exactly similar. The same content is used to assess all candidates, and they are required to demonstrate the same competency level regardless of the format.
Each CISSP concentration exam, as well as CISSP exams in other languages, are conducted as linear, fixed-form exams.
3. How does Computerized Adaptive Testing (CAT) work?
The CAT exam is a challenging exam in which both the number of questions and the difficulty of each question vary depending on the ability of the candidate.
Candidates are first presented with a question considered well below the difficulty standard required to pass the exam. Each time the candidate answers a question, the computer evaluates their ability to get the next question correct based upon previous submissions and the difficulty of previous questions. The computer then presents a question that the algorithm determines has a 50% chance of being answered correctly.
Put simply – the more questions the candidate answers correctly, the more difficult the test will become. As the candidate answers more and more questions, the computer’s estimate of their ability becomes more precise.
4. Why is (ISC)² changing the CISSP exam from its current format to the Computerized Adaptive Testing (CAT) format?
(ISC)² is changing the format of the CISSP exam to CAT with three main goals in mind – creating a testing system that is more efficient, more reliable and more secure.
The CAT format is considered more efficient because it will reduce the average exam time from between five and six hours down to just three hours, allowing more opportunities for examination administration.
The CAT format is considered more reliable because the adaptive format provides a more precise evaluation of a candidate’s competency.
The CAT format is considered more secure because the questions presented are continually changing, which limits the number of times individual questions are revealed.
5. Will the change in exam format affect the previously announced test change in April 2018?
The April 2018 exam update involves changes to the content of the CISSP exam. The CAT update is only a change to the format of the exam. The content presented in the CISSP CAT exam will be the same as the current CISSP exam.
6. Which (ISC)² exams will change to the Computerized Adaptive Testing (CAT) format?
From December 18th, 2017, only the English version of the CISSP exam will be available exclusively via CAT. CISSP exams conducted in languages other than English as well as all other (ISC)² certification exams will still be conducted using the previous fixed-form, linear format.
7. Will the liner, fixed-form format still apply to English CISSP exam?
No. From December 18th, 2017, the English version of the CISSP exam will no longer be offered using the previous fixed-form, linear format. It will only be available using the CAT format.
8. Will there be any change in the cost to undertake the CISSP exam?
No. The cost required to take the English CISSP CAT exam will remain the same as the non-English CISSP exams. Current pricing for all (ISC)² certification exams can be found at the ISC2 website.
9. Where can a candidate take the CISSP CAT exam?
From December 18th, 2017, (ISC)² will no longer offer exams at third-party testing facilities. CISSP CAT exams will be available exclusively through Pearson Professional Centers (PPCs) and (ISC)²-authorized Pearson VUE Select Test Centers (PVTC Selects). A current list of (ISC)²-authorized test centers can be found on the Pearson VUE website.
Format of CISSP Exam
10. How many questions will candidates have to solve on the CISSP CAT exam?
The CISSP CAT is a variable-length adaptive test, which means the number of questions presented to each candidate will change depending on their previous answers. Candidates will be presented with a maximum of 150 questions and a minimum of 100 questions.
Within the total number of questions presented, candidates will receive 25 unscored questioned that are used to evaluate future tests. To receive a pass/fail result, the candidate must answer a minimum of 75 scored questions and a maximum of 125 scored questions.
11. Will the CISSP CAT exam contain experimental questions like the previous format?
Yes. The CISSP CAT exam will contain up to 25 unscored experimental questions that are used to evaluate future tests, and will not impact the candidate’s final score.
12. Will students get section-based questions on the CISSP CAT exam?
No. The questions presented are randomly chosen from a sample which is adapted depending on previous answers. This means that content will not be presented in predetermined sections, and it is possible that candidates may not see content from certain subdomains.
13. What kind of content will be tested on the CISSP CAT exam?
The content tested on the CISSP CAT exam will remain the same as the content presented on the current CISSP exam until the proposed changes in April 2018. The current content outline is available on the (ISC)² website.
14. Can students change or review the answers on the CISSP CAT exam?
No. Because of the adaptive nature of CAT exams, candidates will not be allowed to review or change answers that have been finalized.
Scoring rules for the CISSP CAT exam
15. Will a candidate’s probably of clearing CISSP CAT exam change with the new format?
Overall, the average passing rate of the CISSP CAT exam should remain the same as the average passing rate for the previous CISSP exam. However, the change in test format may psychologically affect certain candidates, which could, in turn, affect the passing rate.
Will the CISSP CAT exam be more difficult than the current CISSP exam?
While the content presented in the new CAT exam will be the same as the content presented in the current CISSP exam, it is impossible to say that one exam is more or less difficult than the other. As the content presented to candidates’ changes depending on previous submissions, candidates with higher ability may be presented with questions that are considered harder. Candidates with lower ability may be presented with easier questions, but this is generally a sign that they are not performing well on the exam.
16. How does the CISSP CAT end and how are results determined?
The CISSP CAT exam ends in one of three ways.
Maximum Allotted Length – if the Confidence Interval Rule has not been invoked, the exam ends when the candidate has reached the maximum number of questions allowed to achieve a passing score. The computer examines the previous 75 scored questions, and if the candidate’s estimated ability remained above the passing standard for the entire time, the candidate will pass. If the candidate’s estimated ability dropped below the passing standard at any time, the candidate will fail.
The Confidence Interval Rule – the exam ends when the candidate has passed the minimum exam length (100 questions), and the computer has determined with 95% statistical confidence that the candidate has displayed a certain ability. If the computer determines that the candidate can no longer achieve a passing score based on statistical data, the candidate will fail. If the computer determines that the candidate can no longer achieve a failing score based on statistical data, the candidate will pass.
Run Out of Time – if the Confidence Interval Rule and the Maximum Length Rule have not been invoked, the exam ends when the candidate has reached the maximum allowed time for the test (three hours). The computer examines the previous 75 scored questions, and if the candidate’s estimated ability remained above the passing standard for the entire time, the candidate will pass. If the candidate’s estimated ability dropped below the passing standard at any time, the candidate will fail. If the candidate has not answered 75 scored questions, the candidate will fail.
17. Do all the questions count equally towards the final score of the CISSP CAT exam?
No. The candidate’s estimated ability is shaped significantly by early questions. If the candidate performs poorly on initial questions, the candidate’s estimated ability will drop below the passing threshold. When that happens, it will be difficult for the candidate to raise their estimated ability above a passing level.
Time limit for the CISSP CAT exam
18. Is there a time limit for the CISSP CAT exam?
The maximum allowed time for the CISSP CAT exam is three hours. There is no minimum time limit. Candidates who need extended time due to medical conditions are required to get pre-approval from (ISC)².
19. Does a more extended session mean the candidate is doing well and close to passing CISSP CAT exam?
Not necessarily. The CAT program continually adapts questions depending on the candidate’s ability, which means the length of a passing test can vary from person to person.
20. Can students take breaks during the CISSP CAT exam?
There is no limit to the number or duration of breaks the candidate may take. However, break times will be included in the three-hour CISSP CAT administration time limit, so candidates should consider this when taking a break. More information about break policy is available on the (ISC)² website.
ETA for CISSP CAT results
21. When does a candidate receive the results of the CISSP CAT exam?
The results of the CISSP CAT exam will be available immediately upon completion of the test.
22. Is it possible to re-take CISSP CAT exams?
For both the English CISSP CAT exam and other linear CISSP exams, candidates can site the test three times within a 12-month period with certain exceptions:
If a candidate is unable to pass the exam on the first try, they must wait a minimum of 30 days before re-testing.
If a candidate is unable to pass the exam on the second try, they must wait a minimum of 90 days before re-testing.
If a candidate is unable to pass the exam on the third try, they must wait a minimum of 180 days before re-testing.
23. Will a candidate see their score if they fail the CISSP CAT exam?
Yes. Just like the traditional linear CISSP exam, candidates who fail the exam will be given a printout with diagnostic feedback highlighting strengths and weaknesses in each domain. This feedback is designed to help candidates study for future tests.
Preparing for the exam
24. How should candidates prepare for the CISSP CAT exam?
The content presented in the CISSP CAT exam and the traditional linear CISSP exam is the same, so candidates should not change their preparation style for the new testing format. However, candidates should be mentally prepared for the adaptive change in the difficulty of questions, which is based on an estimation of their ability.
In CAT tests, all candidates are expected to get around 50% of the questions correct. In this style of exam, the candidate’s overall ability is measured by analyzing the difficulty of questions that are correctly answered, not the total number of questions correctly answered. This means that many candidates may believe they performed poorly when they actually performed well.
25. Where can candidates find more information about the CISSP CAT exam?
Information about current exam content, exam registration, scheduling, testing centers, and testing policy is available on the (ISC)² website.