The examination bank is the weakest document in most certification programmes

One programme, six banks — the count people get wrong first

Firms describe the examination bank as a single object, and that framing is the root of most findings. An employer-based programme running six methods at two working levels feeds a general bank and a specific bank per method per level, a practical checkpoint set per method, and three more banks at Level III. Six methods produce dozens of distinct question sets, each tied to a different source of content and a different signature. Treating them as one file is how the specific examination ends up containing general questions.

The separation matters because the banks age at different rates. General questions track the physics and the CP-105 outline, and stay valid for years. Specific questions track your instrument fleet, your procedure revisions and the acceptance codes on your current contracts, so they expire whenever a procedure is reissued or a flaw detector is replaced. A bank that mixes the two guarantees that a procedure revision silently invalidates part of every examination you administer.

The practical examination is a third species entirely and carries no question count. SNT-TC-1A asks for a minimum of ten different checkpoints evaluating the candidate's understanding of the NDT variables and the employer's procedural requirements, exercised on approved specimens where the candidate is required to detect the specified discontinuities. Its bank is a set of specimens with documented flaw truth plus the checkpoint sheets that go with them, and it is the bank most often found to consist of one plate and a photocopy.

Where general-examination content legitimately comes from

ANSI/ASNT CP-105 is the standard that defines the body of knowledge for training, qualifying and certifying NDT personnel, published as topical outlines by method and by level. The 2024 edition is current and brought in changes including machine learning within acoustic emission and updates to computed tomography and computed radiography. It is the document your general bank should be built against, line by line, because it is also the document a training provider and an auditor will both recognise.

The method is unglamorous and effective. Take the CP-105 outline for the method and level, list every topic line, and write a target number of items against each. Physics and principles carry the most weight, equipment and technique next, then interpretation. Map each finished question back to its outline reference in a spreadsheet column, and the coverage gaps become visible instead of theoretical. That map is also the fastest possible answer when an auditor asks how you know the examination covers the syllabus.

What the general bank must not be is a photocopy of a published study guide. Those books circulate, candidates read them, and an examination assembled from them measures how recently somebody bought the book. Use published material to calibrate difficulty and phrasing, then write original items. This is the single largest quality gap we find when reviewing programmes alongside written practice development, and it is invisible until a candidate with a good memory passes an examination they cannot perform against.

The specific examination is where employer banks collapse

The specific examination addresses the equipment, operating procedures and test techniques the candidate will encounter on assignment. That is the whole point and it is also why the bank cannot be bought. A 20-question specific examination for UT Level II should name your flaw detectors, your calibration blocks, your couplant, your scanning plan, your reporting form, your acceptance code and the exact paragraph in your own procedure that sets the reference level. Nothing generic survives that test.

Most collapsed banks share one symptom: the specific paper reads like a second general paper. Questions about the velocity of sound in steel belong in the general bank. Questions about which of your four procedures governs a 12 mm carbon steel butt weld to a named client specification belong in the specific bank. When we audit programmes, we count how many specific-examination questions could be answered by a competent technician who had never seen your documents. Any answer above zero is a finding waiting to be written.

There is a maintenance obligation attached. Because specific questions cite procedure numbers, revisions and equipment models, every procedure reissue triggers a bank review. Record the procedure revision each question was written against in the bank itself, and reissuing a procedure becomes a filter query rather than a re-read. Firms that skip this discover during an audit that their current examinations test a revision withdrawn eighteen months earlier.

Practical examinations: checkpoints, specimens and flaw truth

The practical examination is assessed against a minimum of ten different checkpoints covering the NDT variables and the employer's procedural requirements. At Level I those checkpoints centre on performing the examination as directed and recording what is found. At Level II they extend to selecting the technique, performing it, and interpreting and evaluating the results against acceptance criteria. In both cases the candidate is required to detect the discontinuities the specimen holds.

That last requirement quietly demands documented flaw truth. If the specimen's flaws were never independently characterized, there is no way to state that the candidate detected them, and the grade becomes an opinion. Keep an as-built drawing or reference examination record per specimen, kept apart from the examination room, held by the administering Level III alone. This is the same discipline that governs procedure qualification by demonstration, and the same failure mode applies when it is missing.

Specimen population is the other constraint. One plate examined by every candidate for three years is a specimen whose flaw locations are common knowledge before anyone picks up a probe. Rotate specimens, keep more than the minimum, and log which specimen each candidate examined so repeat candidates get a different one. Where a firm cannot justify buying specimen sets for every method, prioritise the methods it sells most, and cover the rest through an outside examination agency.

How big a bank has to be before it is defensible

SNT-TC-1A sets examination length, never bank depth, so the sizing decision falls to you and it deserves arithmetic rather than instinct. Start from the draw ratio. A 40-question general examination drawn from 200 live items gives a five-to-one ratio, which means two candidates sitting the same examination share roughly eight questions by chance and a resitting candidate sees mostly new material. At two-to-one, a resit is close to a repeat.

Parallel forms give the second constraint. Three non-overlapping 40-question forms need 120 items before any margin, and a fourth reserve form for resits pushes it to 160. Add retirement: any item that more than 90 percent of candidates answer correctly has stopped discriminating and should be pulled, which historically removes a tenth of a bank in its first two cycles. Building to 200 live items per general examination absorbs that attrition without emergency writing sessions.

Specific banks scale differently because the population is smaller and the content is yours. A 20-question specific examination supported by 80 to 100 live items covers the same ratio logic while staying maintainable against procedure revisions. Level III banks are smaller again in item count but heavier per item, since the method examination alone needs 30 fundamentals, 15 technique-establishment and 20 code-interpretation questions before any draw ratio is applied.

Writing items that survive a Level III review

SNT-TC-1A requires that examination questions be approved by the NDT Level III, which makes item review a formal gate rather than a courtesy read. The gate is worth using properly. A reviewable item has one defensible answer, distractors that a partially-informed candidate would find plausible, no negative stems, no all-of-the-above, and a citation to the source paragraph or outline line that justifies the key. Items without a citation cannot be defended when a candidate challenges a grade.

Difficulty distribution matters more than difficulty. A bank of uniformly hard questions fails competent technicians; a bank of uniformly easy ones passes everyone and tells you nothing. A workable spread places roughly a fifth of items as straightforward recall, the bulk as application, and a fifth requiring the candidate to work through a calculation or a code table. Track the actual pass rate per item once you have a dozen sittings, and the outliers identify themselves.

Language is a quiet source of failure in international crews. Long compound stems, double negatives and idiomatic phrasing test English rather than NDT. Keep stems short, put the question in the stem rather than the options, and use the terminology your procedures use. This is worth doing before an examination is challenged, because a candidate who fails on a badly-written item has a legitimate grievance and the Level III who approved it owns the outcome.

Grading: the 70/80 arithmetic and what a composite hides

The rule is a composite grade of at least 80 percent with no individual examination scoring below 70 percent. Both halves bind. A candidate scoring 95, 95 and 68 has a composite of 86 and still fails, because one part fell below 70. A candidate scoring 79, 79 and 79 passes every part and still fails, because the composite falls short of 80. Written practices that state only one of the two conditions produce certifications an auditor can challenge on arithmetic alone.

The composite is a simple average of the parts — general, specific and practical at Level I and II; basic, method and specific at Level III. Where an outside agency examination is accepted in place of one part, common written practice records that result as 80 percent for compositing purposes, and the practice has to say so explicitly rather than leaving the grader to improvise. Write the rule down, including how a retake grade replaces the original.

What the composite hides is the practical. A candidate can average their way to 80 while barely clearing 70 on the hands-on examination, which is the part that predicts field performance. Nothing prevents an employer setting a higher internal bar than the recommended practice, and firms selling inspection services into demanding clients routinely do. Set that bar in the written practice and it becomes auditable; leave it in a manager's head and it becomes inconsistent.

Security: a bank the candidates have seen is worthless

A question bank is an asset whose entire value is confidentiality. Once circulated, it measures memory rather than competence, and every certification issued from it becomes indefensible in an incident investigation. Yet banks routinely live on shared drives, in email attachments to trainers, and in printed masters left in the examination room. Treat the bank the way you treat pricing or client drawings: access list, version control, and a named owner who is the Level III responsible for the programme.

Practical controls are cheap. Keep the live bank separate from the training material and never let the same file serve both. Print papers on demand rather than keeping a stock of prepared copies. Number every paper, issue and collect them against the number, and shred spoiled copies rather than binning them. Where examinations run at multiple sites, do not send the bank — send the assembled paper, and have it returned. Rotate a portion of items every cycle so a leak has a limited half-life.

Detection is possible and worth building in. When a group's scores jump sharply on specific items without a corresponding change in training, the bank has leaked. When candidates finish a 40-question paper in ten minutes, the bank has leaked. Log item-level results and the pattern shows up before the certifications do. Independent administration removes the largest exposure, which is why Level III examination oversight is usually the cheapest security control a small firm can buy.

Administration and proctoring in practice

SNT-TC-1A Section 8.1 makes the NDT Level III responsible for administering and grading examinations, and allows a designated representative to do so after receiving documented instruction. Paragraph 8.1.1 adds the constraint everyone eventually collides with: a certification examination is never administered by the candidate or by a subordinate of the candidate. In a firm with one Level III who reports to the owner and supervises everyone else, that sentence rules out most of the obvious arrangements.

The consequences run further than people expect. The Level III cannot administer their own Level III specific examination. A supervisor cannot proctor the Level II examination of a technician who reports to them. A quality manager who signs the written practice cannot grade the paper of someone in their own chain. Each of these turns up as a finding because the examination record carries a grader signature and the organisation chart is in the same audit pack.

Proctoring itself has no code text behind it, which means the written practice has to supply the rules. State who invigilates, whether phones leave the room, what reference material is issued, the time allowed, and what happens if a candidate is caught with unauthorised material. ANSI/ASNT CP-189 tightens several of these expectations relative to SNT-TC-1A, and firms working to that standard should read our CP-189 compliance notes alongside SNT-TC-1A before drafting.

Retention: what stays in the file after the paper is graded

SNT-TC-1A Section 9 lists what the personnel certification record holds: the individual's name; the certification level, NDT method or technique and any limitations; educational background and experience; a statement that training was completed to the written practice; current vision examination results; current examination copies or suitable evidence of successful completion; composite grades; the signature of the Level III verifying certification; and the certification and expiry dates. The retention period is whatever your written practice states.

Two of those entries carry hidden weight. Current examination copies or suitable evidence means the graded papers themselves are the default, and firms that discard papers must be able to point at the alternative evidence they kept. Limitations, if any, is the field that records a technician certified for a restricted scope, and a blank field asserts unrestricted competence in the method. Both fields are checked in audits far more often than the training hours everybody worries about.

Recertification closes the loop. SNT-TC-1A recommends a maximum interval of five years, and each cycle asks whether the individual's competence still holds. A programme with a well-maintained bank handles recertification as a normal draw; a programme without one improvises a paper the week before the certificate expires. If your bank cannot support the next five years of recertifications without repeating itself, it is undersized — and rebuilding it is one of the standard workstreams in our outsourced Level III consulting. Affordable, accessible and fully customizable: request a quote.

Request a consultation