Developing a certification examination FAQs

The FAQs on this page are related to developing our exams, program specific issues, and some additional topics related to the nature of actually sitting for an exam. For additional support items, please see our Test Candidate FAQs page.

General Topics

No. JVIDÊÓÆµ Certification exams are designed to measure candidates’ skills and abilities in this technology, not their ability to study or memorize specific questions that were on the exam. Qualified candidates will be able to pass this exam regardless of the questions asked. As a result, to protect the integrity of the certification process, JVIDÊÓÆµ does not share information about the specific questions that were missed.

-Contributed by Liberty Munson, Microsoft Psychometrician

Most JVIDÊÓÆµ certifications have an expiration date. See the Certification Expiration page for details.

For Live-in-the-Application exams (e.g. Microsoft Office Specialist, Adobe Certified Professional), you are actually working in the application to complete a task in the exam and are able to use most of the application’s features. (Exceptions may include Help, Share, New, and Open. None of these application features are needed to complete the exam.) The work performed in the application is scored directly, and for this reason, the application must be installed on the testing computer.

For Live-with-the Application exams (e.g. Autodesk Certified User), you are given a task and then use the application to determine the answer. You then enter the answer into the exam interface for scoring. The application must also be installed on the testing computer.

Our exams are designed to assess if candidates know how to accomplish a task. Unless a question designates a specific method of completion, you should be able to complete the task as if you were using the application in a non-exam setting. Our scoring is based on the end result and not on the steps used to get it.

Scoring

Each item on the certification examination is worth one point unless noted. Even a drag and drop item where you move multiple objects is worth one point unless the item indicates that you will receive partial points.

No. Each item on the certification examination is worth one point unless noted. Even a drag and drop item where you move multiple objects is worth one point unless the item indicates that you will receive partial points.

No. You either receive a point for the correct response or you do not receive a point. Entering an incorrect response only keeps you from receiving a point on that item. It will not deduct points from your score.

During the creation of a certification examination, subject matter experts define what knowledge, skills, and abilities should be assessed. These qualities are evaluated as to functional importance and broken into sections. If skills within a section are considered essential to possess, it will contain more questions than a section considered less fundamental. It will also have questions considered to require a higher degree of subject knowledge. Therefore, each section has a varied number of questions which also vary in level of difficulty.

When reviewing your score report, it is important to keep in mind that the total percentages of all sections will not equal 100%. The percentages merely indicate the percentage of questions you answered correctly within the individual section and are not a direct indication of whether you will pass or fail the certification examination as a whole. For example, you may get 100% in three sections that only had one question but get 25% in a section that had eight questions. Overall, you only answered five of eleven questions correctly so you would not pass this certification examination. Conversely, you could also get 0% in a section that only contains one question and still pass the exam with a high score.

Your score report is useful to gauge your level of knowledge of topics included in the certification examination. This can be correlated back to the Objective Domain.

During the creation of a certification examination, subject matter experts define what knowledge, skills, and abilities should be assessed. These qualities are evaluated as to functional importance and broken into sections. If skills within a section are considered essential to possess, it will contain more items than a section considered less fundamental. It will also have items considered to require a higher degree of subject knowledge. Therefore, each section has a varied number of items which also vary in level of difficulty.

Your score report is useful to gauge your level of knowledge of topics included in the certification examination. This can be correlated back to the Objective Domain for the certification examination to reference what skills are assessed in each section.

JVIDÊÓÆµ reports scaled scores so that candidates who have to retake a certification examination can determine if their performance is improving. The actual cut score (the number of items you need to answer correctly) is based on input from a group of subject matter experts who review the difficulty of the questions in relation to the expected skills of the target audience. As a result, the number of items that you have to answer correctly varies depending on the difficulty of the questions delivered when you take the exam; this ensures that regardless of which combination of items you see, the evaluation of skills is fair—if you see a more difficult set of questions, the number of correct answers needed to pass is less than if you see an easier set of questions. As a result, providing a simple percent correct wouldn't provide useful information to someone who had to take the exam multiple times and saw different combinations of questions with different levels of difficulty.

Because the number of correct answers needed to pass varies based on the difficulty of the questions delivered, if you see a difficult combination of questions, your performance may actually be higher in relation to the passing standard even though you completed fewer questions (in other words, a lower percentage) correctly than if you saw an easier set of questions. Scaled scores simplify your ability to evaluate improvements in your performance over time. This is a standard practice across the certification and licensure industry.

-Contributed by Liberty Munson, Microsoft Psychometrician

Prioritize the skills that you should practice by focusing on the content areas where your exam performance was the weakest. Additionally, you may want to review the Objective Domain for the exam.

When you are ready to retake the exam, schedule an appointment as you normally would. Note that you must pay for each exam you retake and follow the posted retake policy.

-Contributed by Liberty Munson, Microsoft Psychometrician

If you pass an exam, it simply means that you have demonstrated competence in the skill domain. In addition, scores of candidates who pass cannot be compared to determine if one candidate is more competent than another; higher passing scores do not mean higher levels of competence. The same is true of failing scores; lower failing scores do not mean lower levels of competence. If you pass the exam, you have demonstrated competence regardless of your score; if you fail, you have not demonstrated competence.

JVIDÊÓÆµ exams are designed so that the total score can be used to make a pass/fail decision (in other words, to show whether the candidate has demonstrated competence in the skill domain measured by the exam). Our exams are not designed with the intent to provide diagnostic feedback about your skills, and steps are not taken during the exam development process to support that level of reporting.

-Contributed by Liberty Munson, Microsoft Psychometrician

No. Receiving the same score on multiple attempts does not indicate that the program computing the results is in error. It is not uncommon for candidates to obtain similar or identical scores on multiple attempts of an exam. This consistent result demonstrates the reliability of the exam in evaluating skills in this content domain. If this happens on multiple attempts, you may want to reconsider how you’re preparing for the exam and seek other opportunities to learn and practice the skills measured by the exam.

-Contributed by Liberty Munson, Microsoft Psychometrician

The actual number of questions that you need to answer correctly in order to pass an exam is determined by the difficulty level of those questions that you get when you sit an exam and our expectations of the skills and abilities of the target audience. We then transform that number into a scaled score of 700. We rely on subject matter experts to help us determine the skills and abilities that we expect of qualified candidates as well as to estimate the difficulty level of each question in relationship to those expectations. We use a combination of methods (Angoff, etc) to set the passing score.

Cut scores are used to help a candidate know if they are improving. The actual number of questions you need to answer correctly is based on the difficulty of the questions that you see when you take the exam. A scaled score ensures that regardless of which combination of questions you see, the evaluation of your scales is fair. If you see a more difficult set of questions, the number of correct answers to pass is less than if you see an easier set of questions. More importantly, scaled scores let you track your progress over multiple attempts. If you see a difficult combination of questions your performance may actually be higher in relation to the passing standard even if you answered fewer questions correctly then if you saw an easier set. Scaled scores simplify your ability to evaluate improvements in your performance over time. This is a standard practice across the certification and licensure industry.

The score that you get on an exam doesn’t reflect the percent of questions you got correct on an exam. Your score is also scaled to be in relation to the passing standard that we have scaled to 700. As long as it is above 700, then we know that you have demonstrated competence in the content domain. The scaled scores range from zero to a thousand. Your score is a simple mathematical conversion of the number of questions you answered correctly to the same scale that is applied to the passing score when it is scaled to 700.

What if I score 850, does that mean I am more qualified than someone who scores a 750? Not necessarily. JVIDÊÓÆµ doesn’t set the passing score to make those types of judgements. If you pass, we are simply saying that you have demonstrated the skills and abilities needed to demonstrate competence in the technology given our target audience. Higher scores don’t necessarily equate to more or better skills. This is why we don’t report scores on your transcripts. The only person that knows your score is you.

-Contributed by Liberty Munson, Microsoft Psychometrician

Yes. Scoring is set up such that all possible correct answer combinations receive credit (except in the case of best answer where multiple answer choices might be correct but only one is best given the technical and business requirements outlined in the question). For example, if you are asked to put steps to complete a task in order but the order of two steps doesn't matter, our scoring algorithms take this into account. In other words, you will get credit if you put A before B or B before A.

-Contributed by Liberty Munson, Microsoft Psychometrician

Most JVIDÊÓÆµ certification exam scores are reported on a scale of 1 to 1000. The passing score for our certification exams is 700. The actual cut score percentage is determined by a group of subject matter experts and each certification exam is scaled such that the passing score is 700. Any score of 700 or greater is a "pass." Any score below 700 is a "fail." (Exams scaled from 1 to 100 with passing score scaled to 70.)

The actual number of items you need to answer correctly in order to pass is determined by a group of subject matter experts in conjunction with a psychometrician. The passing score is based on the knowledge and skills needed to demonstrate competence in the skill domain and the difficulty of the questions that are delivered to a candidate.

-Contributed by Liberty Munson, Microsoft Psychometrician

The JVIDÊÓÆµ content development team employs criterion-referenced standard-setting procedures for the certification pass/fail decision that have been developed based on universally-accepted psychometric practices. JVIDÊÓÆµ certification exams are designed to measure skills on an individual basis, rather than in relation to another person or group. Our commitment is to promote certification rather than use individual scores as the relevant point of comparison.

To summarize, we do not recommend using the actual exam score to indicate a final grade for your students. We create a certification examination to demonstrate a sufficient level to pass, not to differentiate the skill level between students.

 

Program specific FAQs

Adobe Certified Professional

Autodesk Certified User (ACU) 

If a question does not specify an option to use in the scenario presented, you should leave everything set to the default selection to complete the task.

Microsoft Office Specialist (MOS)

In the Microsoft Office Specialist exams, each item has a button to ‘Leave feedback after exam’. If you see exam items after your exam ends, you were taken to the review screen where you are able to give feedback about specific items in the exam. During this process, you are given 7 minutes to provide feedback. Any actions taken during that review do not affect the answers already submitted by the exam engine as your results have already been stored.

Our certification examinations use the version of Microsoft Office installed on the testing computer for all software operations and checks. As noted, a comma is used as a separator in most English versions of the Excel application, but a semi-colon is used in some other localized applications which used a comma rather than a decimal to separate values. With whichever version of the software was installed on your computer, an error message would be displayed and the formula would not be accepted if the wrong separator was used. If you did not receive such a modal error and a calculated value was displayed, any failure to score would be due to the arguments placed into the formula and not the separators used. In addition, the instructions for the Excel certifications do not display any formula prompts within the task statement.

The JVIDÊÓÆµ content development team uses industry best practices to establish the number of items included on each certification examination and the pass/fail designation.

Compared to other MOS exams, Outlook requires a higher percentage of questions answered correctly to be at the passing level, as determined by our subject matter experts, and validated by beta and continued live certification examination result analysis. So, a candidate will need to complete more items correctly as a percentage to pass the Outlook Certification Exam.

JVIDÊÓÆµ’s system is designed to recognize when the MOS Associate or Expert Certification criteria has been met. The candidate should see the MOS Associate or Expert Certification listed in their transcript. However, these designations will not show on reports for the CATC as they are not certification examination themselves.

See the Microsoft Office Specialist certification page for more details.

 

Learning materials

We encourage all of our publishing partners to create learning materials that are aligned to both the exam objectives and the software versions. JVIDÊÓÆµ only sells learning materials that have a high degree of alignment.

Both CertPREP practice tests and JVIDÊÓÆµ’s certification exams test on the content within the exam’s objective domain. GMetrix strives to dedicate the same number of test questions on an objective as does the certification exam. Practice test questions are about the same level of difficulty as the certification exam questions.

Given the exam time limits, neither the certification exam nor the practice test can possibly cover everything found in all of the objectives. For example, one objective might require that a student know skills A, B, and C. The certification exam may test on skill A. The practice test may only test on skill B. In other instances, the certification exam and practice test cover the same skills. The degree to which they correlate exactly varies and is proprietary.

A test candidate should have a strong knowledge of the entire objective domain to pass the certification exam. Passing a practice test is a valuable indicator of this knowledge, however, to increase certification success we recommend test candidates incorporate in their test preparation both JVIDÊÓÆµ Learning Materials and CertPREP Practice Tests.

Most teachers recommend that their students pass each of the CertPREP Practice Tests with an 80-90% before attempting the certification exam. There are usually at least two tests per title. It is important, however, that test candidates do not rely solely on practice tests for their only source of preparation. While obtaining a high practice test score may indicate one’s readiness to take the certification exam it does not guarantee test candidates will pass the certification exam.

The best place to start is to review the exam’s objective domain. We do have some free study guides available for some of our exams. To see our learning products, including free study guides, visit our website: Certifications > (Choose Your Program)> Learn. In addition to online courses, we may offer ebooks and printed textbooks. Your sales representative can guide you to the best learning product to fit your needs.

 

Exam prep

JVIDÊÓÆµ certification examinations are designed to measure proficiency in certain knowledge, skills and abilities of a subject. Instead of teaching to pass a certification examination, we recommend that students are taught to be proficient users of the specific technology. The objective domain for a certification examination is a comprehensive overview of those the knowledge, skills and abilities for certification.

Objective domains are a comprehensive set of specific and measurable knowledge, skills, and abilities that are the basis for the development of both the certification exams and learning products.

 

Localization


Developing a certification examination: