Security Testing and Analysis
Security testing and analysis encompasses the specialized hardware, methodologies, and laboratory practice used to evaluate whether an electronic system actually delivers the protection it claims. As security becomes critical across every domain of electronics—from payment terminals to Internet of Things devices, from automotive controllers to grid infrastructure—the ability to test security features rigorously is what separates a verified product from an asserted one.
Hardware security testing differs from software testing in kind, not merely in degree. It requires instruments that probe physical characteristics, measure side-channel emissions, inject faults with nanosecond and micrometer precision, and recover information through invasive and non-invasive techniques. This category examines that ecosystem, from open-source platforms costing a few hundred dollars to focused ion beam workstations costing millions. Where hardware security foundations describes the defenses, the pages below describe the equipment and procedures used to attack them under controlled conditions.
Articles in This Category
The following pages examine specific facets of security testing hardware in depth, from the laboratory instruments that probe a device to the equipment used to certify it and the tools used to investigate it after an incident.
Why Hardware Security Testing Is Distinct
An attacker with physical access commands techniques unavailable to a remote adversary. Such an attacker can decapsulate an integrated circuit, microprobe its internal buses, observe the current it draws while computing, radiate electromagnetic pulses into its substrate, or starve it of supply voltage at a chosen instant. None of these attacks touch the mathematics of the cryptography involved; they exploit the gap between an algorithm and the physics of the circuit that runs it. Security testing hardware exists to reproduce those capabilities under controlled conditions, so that a designer learns of a weakness from a laboratory report rather than from a field incident.
Because the attack surface spans several abstraction levels, effective evaluation is layered. Protocol analysis examines what a device says on its interfaces. Cryptographic validation confirms that algorithm implementations produce correct results and handle keys correctly. Side-channel analysis measures information leaked through power, electromagnetic, and timing behavior. Fault injection tests whether error handling and tamper response hold up when the device is pushed outside its operating envelope. Invasive analysis assesses resistance to direct silicon-level manipulation. Each domain has its own instruments, its own statistics, and its own specialists.
The same equipment serves offense and defense. Red teams and vulnerability researchers use it to simulate real-world attacks and to demonstrate exploitability rather than merely assert it. Product teams and evaluation laboratories use identical instruments to verify countermeasures, to establish that a claimed protection actually reduces leakage, and to generate the evidence that certification schemes require. The distinction lies in intent and reporting, not in tooling.
Testing Methodologies and Depth of Access
Evaluations are usually characterized first by how much the tester knows. Black-box testing works from an external perspective with no design information, mirroring an opportunistic attacker. White-box testing uses complete design knowledge—source code, netlists, layout, and key provisioning procedures—to find subtle flaws that external probing would never reach. Gray-box testing sits between the two and is the common case in commercial evaluation, where a laboratory receives datasheets, sample devices, and limited design documentation under nondisclosure.
A second axis is physical invasiveness, and testing generally proceeds along it in order of increasing cost and irreversibility. Non-invasive work leaves the device intact: protocol sniffing, timing measurement, power trace capture, and near-field electromagnetic monitoring. Semi-invasive work removes packaging to expose the die but does not contact it electrically, enabling optical fault injection, photonic emission analysis, and backside laser stimulation. Fully invasive work modifies the silicon itself through microprobing, circuit edit with a focused ion beam, and layer-by-layer delayering for reverse engineering. Because invasive steps destroy samples and consume weeks of skilled labor, a well-planned evaluation exhausts the cheaper techniques first.
Certification schemes formalize how far a laboratory must go using the concept of attack potential. Rather than asking whether a device is secure in the abstract, evaluators score a demonstrated attack according to elapsed time, required expertise, knowledge of the design, sample access, and equipment cost, then rate the product against the strength of attacker it withstands. In the smart card and secure element domain, the Joint Interpretation Library maintains the rating tables used by Common Criteria evaluators for this purpose, and a target of evaluation aiming at the highest vulnerability analysis assurance component must resist attackers rated as having high attack potential. This framing keeps testing proportionate: the depth of the laboratory effort is set by the threat model and the certification objective, not by curiosity.
Side-Channel Analysis
Side-channel attacks exploit unintended information leakage through physical implementation characteristics rather than attacking cryptographic algorithms directly. A power analysis bench pairs a high-bandwidth oscilloscope or dedicated capture card with a low-noise current probe or a small shunt resistor in the target's supply or ground return, plus a trigger that aligns each acquisition to the start of the cryptographic operation. Simple Power Analysis reads structure directly from a single trace, such as the square-and-multiply pattern of a naive modular exponentiation. Differential Power Analysis and Correlation Power Analysis instead combine thousands to millions of traces statistically, correlating measured consumption against a leakage model—commonly the Hamming weight or Hamming distance of an intermediate value—to recover a key byte at a time. Because the attack is divide-and-conquer, a full AES key can fall to an effort far smaller than exhaustive search.
Electromagnetic analysis captures radiated emissions with near-field probes, low-noise amplifiers, and wideband receivers or spectrum analyzers. Simple and Differential Electromagnetic Analysis parallel their power-based counterparts, but the probe can be positioned over a specific region of the die, which improves the signal-to-noise ratio by isolating the circuitry of interest and defeats some countermeasures that only balance whole-chip current. Motorized XY scanning stages with micrometer resolution automate the mapping of emissions across a decapsulated or thinned die, producing leakage maps that localize a cryptographic accelerator or a key register.
Timing analysis targets execution time that varies with secret data. Data-dependent branches, table lookups whose cache behavior depends on a key, and non-constant-time modular arithmetic all create measurable channels. Testing requires high-resolution counters or trace timestamps, careful control of environmental noise, and statistical treatment robust to jitter. Microarchitectural side channels on general-purpose processors extend the same idea to shared caches, branch predictors, and speculative execution.
Evaluation practice increasingly favors leakage detection over full key extraction, because demonstrating a complete attack is expensive and a negative result proves little. Test Vector Leakage Assessment applies Welch's t-test to two sets of traces—typically fixed versus random inputs—and flags a statistically significant difference as evidence that secret-dependent information reaches the measurable channel. The method reports whether exploitable leakage is present without requiring the evaluator to construct a working attack, which makes it well suited to conformance testing and to regression testing of countermeasures during development.
Fault Injection Testing
Fault injection deliberately pushes a device outside its specified operating conditions to see whether the resulting errors can be turned into a security failure. The classic outcomes are a skipped comparison that bypasses a PIN or signature check, a corrupted intermediate that enables differential fault analysis of a cryptographic computation, and a disturbed instruction fetch that redirects control flow into attacker-influenced code. Because a countermeasure such as a duplicated check or an infective computation is only as good as its coverage, testing must search the parameter space systematically rather than sample it casually.
Voltage glitching drives brief undervoltage or overvoltage transients onto the supply rail, upsetting setup and hold margins in logic and memory. Clock glitching inserts a shortened cycle or an extra edge so that a pipeline stage samples before its combinational logic has settled. Both are inexpensive and require only electrical access, which makes them the usual starting point. Electromagnetic fault injection discharges a capacitor through a small coil positioned above the package, inducing localized currents without decapsulation; it trades some precision for the ability to test packaged production parts. Laser fault injection is the most spatially precise technique, focusing a pulsed beam onto a chosen region of a decapsulated die—frontside through the metal gaps, or backside through thinned silicon at near-infrared wavelengths where the substrate is transparent—and can flip a single targeted bit.
The practical difficulty is the size of the search space. Glitch amplitude, width, offset from the trigger, spatial position, and beam energy all interact, and a successful parameter set is often a narrow island in that space. Modern platforms therefore automate the sweep, classify each attempt as normal, mute, reset, or anomalous, and iterate toward the anomalous region. Combined setups close the loop with side-channel feedback, using a power or electromagnetic trace to locate the target operation in time so that the glitch lands on the instruction that matters. Open-source platforms such as ChipWhisperer have made both power analysis and glitching accessible for research and education, while commercial benches add higher bandwidth, tighter timing resolution, and the traceability that accredited laboratories require.
Protocol and Communication Security Testing
Security often fails at the interfaces rather than inside the cryptographic core. Protocol analyzers capture, decode, and replay traffic between devices to confirm that encryption is actually enabled, that authentication cannot be skipped, and that session material is fresh. Logic analyzers with deep capture memory record long sequences on wired buses such as SPI, I2C, UART, CAN, and USB, exposing debug consoles left enabled, keys transmitted in the clear, and firmware images transferred without authentication. Bus interposers allow active testing, in which the analyzer modifies messages in transit to probe error handling.
Wireless testing adds radio frequency instrumentation. Software-defined radio platforms provide wide-bandwidth capture and transmission, allowing an evaluator to record a session, analyze framing offline, and replay or modify it. Protocol-specific sniffers cover Bluetooth Low Energy, Wi-Fi, Zigbee, LoRaWAN, and cellular interfaces, while shielded chambers keep tests legal and repeatable by containing emissions. Machine-in-the-middle rigs interpose between two legitimate endpoints to exercise replay, relay, downgrade, and rollback attacks—the relay attack against keyless entry systems being a well-documented example of a protocol that is cryptographically sound yet defeated by physics.
Protocol fuzzing complements structured testing by generating malformed or unexpected messages at high volume and monitoring the target for crashes, hangs, memory corruption, or authentication bypass. Hardware-assisted fuzzing platforms add the instrumentation that embedded targets lack, using debug interfaces or on-chip trace to detect faults and to reset the device automatically between iterations.
Cryptographic Validation
Cryptographic validation confirms that implementations compute the right answers and protect key material throughout its life. Algorithm testing uses known-answer test vectors, Monte Carlo tests that chain thousands of operations to catch state-handling errors, and multi-block message tests. In the United States, the Cryptographic Algorithm Validation Program supplies this testing as a prerequisite for module validation, and its automated protocol allows a laboratory to request vectors and submit responses programmatically rather than exchanging files by hand.
Entropy source evaluation is a separate and frequently underestimated discipline. Modern practice assesses the raw noise source rather than the conditioned output, because a cryptographically strong deterministic post-processor will produce statistically perfect-looking output from almost any input, including a constant seed. NIST SP 800-90B specifies entropy estimation from raw samples together with health tests that run continuously in the field, and the German Federal Office for Information Security applies a comparable stochastic-model approach in its AIS 20/31 methodology. The older SP 800-22 statistical test suite remains widely cited, but NIST has stated its intention to revise the document specifically to reject its use for assessing cryptographic random number generators: passing a battery of general-purpose randomness tests demonstrates the absence of certain gross defects, not the presence of entropy. Testing an entropy source therefore requires access to raw digitized noise, a defensible stochastic model of the physical process, and validation across temperature, voltage, and aging corners. These questions are treated in detail under random number generation.
Key management testing evaluates generation, storage, use, and destruction. Evaluators verify that keys are derived correctly and bound to their intended purpose, that access controls and authentication gate every use, that key wrapping and transport preserve confidentiality and integrity, and that zeroization genuinely erases material rather than merely unlinking it. Practical tests include dumping accessible memory and non-volatile storage to confirm that plaintext keys never appear, exercising the interface to see whether a key can be used outside its declared role, and interrupting operations at chosen moments to look for material left behind in an intermediate buffer.
Certification and Compliance
Many markets require formal certification, and each scheme prescribes the testing that laboratories must perform. Common Criteria evaluation follows ISO/IEC 15408, whose current edition is the 2022 revision aligned with the CC:2022 release, with the companion evaluation methodology in ISO/IEC 18045. Evaluations are conducted against a protection profile or security target and yield an assurance level supported by documented vulnerability analysis, which for smart cards and secure elements includes penetration testing by an accredited laboratory using side-channel, fault injection, and invasive techniques.
FIPS 140-3 governs validation of cryptographic modules for United States and Canadian federal use. Unlike its predecessor FIPS 140-2, it adopts the international standards directly: ISO/IEC 19790 for module security requirements and ISO/IEC 24759 for the corresponding test methods, with NIST's SP 800-140 series specifying the modifications the Cryptographic Module Validation Program applies. A significant addition relative to FIPS 140-2 is the treatment of non-invasive attacks—timing analysis, power analysis, and electromagnetic emanation. ISO/IEC 19790 calls for testing against approved mitigation metrics at security levels 3 and 4, and ISO/IEC 17825 supplies the test methodology, but the Cryptographic Module Validation Program has not populated those metrics: SP 800-140F states that there are no additional requirements at this time. A FIPS 140-3 certificate therefore evidences documented mitigations rather than measured side-channel resistance, and buyers who need measured resistance turn to Common Criteria smart card evaluation instead. Payment devices follow their own tracks: EMVCo type approval covers contact and contactless card and terminal behavior, while PCI PIN Transaction Security evaluates point-of-interaction devices for tamper resistance, secure PIN entry, and key management. Automotive programs add ISO/SAE 21434 for cybersecurity engineering across the vehicle lifecycle, and industrial systems draw on the IEC 62443 series.
Accreditation matters as much as instrumentation. Testing laboratories operate under ISO/IEC 17025 or scheme-specific accreditation, maintain calibration records and controlled environments, and employ evaluators whose competence is periodically assessed. That apparatus is what allows one laboratory's result to be recognized by another jurisdiction. Beyond regulatory obligation, independent evaluation gives customers and partners evidence rather than assurances, and organizations that begin testing early in development avoid the expensive rediscovery of architectural flaws at certification time. The certification frameworks themselves are covered under security evaluation criteria.
Laboratory Infrastructure and Safety
Sensitive measurements demand a controlled environment. Side-channel signals of interest are frequently tens of millivolts or less against a background of switching noise, so laboratories use shielded enclosures to exclude ambient radio frequency energy, linear or battery supplies to avoid switching-regulator artifacts, and careful grounding to prevent loops that swamp the measurement. Temperature stability matters because both the target's leakage behavior and the instrument's baseline drift with it. Vibration isolation tables support the precision positioning stages used in microprobing and laser work, where a micrometer of drift ruins an alignment.
Calibration and documentation make results defensible. Oscilloscopes require periodic verification of vertical accuracy and time base, spectrum analyzers need frequency reference calibration, and laser injection systems need optical alignment and pulse-energy calibration. Recording instrument serial numbers, calibration dates, firmware versions, and full acquisition settings alongside every trace set is what allows a finding to be reproduced months later by a different analyst, and it is a requirement under accreditation.
Safety obligations are real and specific. Chemical decapsulation uses fuming nitric and sulfuric acids at elevated temperature and requires a fume hood, acid-resistant protective equipment, spill control, and trained handling. Laser fault injection systems present eye hazards that call for interlocks, enclosures, and wavelength-appropriate eyewear. Focused ion beam and scanning electron microscope work involves high vacuum and high voltage. Electromagnetic fault injection benches store energy in capacitors at hundreds of volts. Documented procedures and training are not bureaucratic overhead in this field; they are what makes the work repeatable as well as survivable.
Selecting Security Testing Equipment
Equipment selection follows from objectives, threat model, and available expertise rather than from a wish list. An entry-level bench built around an open-source capture and glitching platform, a mid-range oscilloscope, a logic analyzer, a software-defined radio, and a set of near-field probes is sufficient for research, teaching, and early design review, and it will find the large class of flaws that arises from unprotected implementations, exposed debug interfaces, and missing authentication.
A professional laboratory adds bandwidth and automation: high-sample-rate oscilloscopes with low-noise front ends, calibrated current probes, motorized electromagnetic scanning stages, fault injection platforms with fine timing resolution and scripted parameter sweeps, and trace-analysis software able to handle large data sets. A certification laboratory needs more still, because it must reproduce the attack methods that the scheme recognizes: decapsulation facilities, optical and infrared microscopy, microprobing stations, environmental chambers, laser injection systems, X-ray inspection, and in some cases focused ion beam and scanning electron microscopy. The step from a research bench to an accredited facility is measured in millions of dollars and years of process development, which is why most product teams contract certification testing rather than build the capability.
Expertise remains the binding constraint. Sophisticated instruments in untrained hands produce confident but meaningless results, while a skilled analyst extracts real findings from modest equipment. Trace alignment, leakage modeling, statistical significance, and the judgment to distinguish a genuine vulnerability from a measurement artifact are learned slowly. Budget planning should therefore treat training, mentoring, and time for progressively harder projects as line items alongside the hardware itself.
Emerging Challenges and Future Directions
Post-quantum cryptography is reshaping validation work. NIST finalized ML-KEM as FIPS 203, ML-DSA as FIPS 204, and SLH-DSA as FIPS 205 in August 2024; it selected HQC in March 2025 as a second key-encapsulation mechanism based on different mathematics, and a Falcon-derived signature scheme, FN-DSA, is planned as FIPS 206 but is not yet final. These algorithms bring larger keys and signatures, new arithmetic such as the number-theoretic transform and polynomial sampling, and leakage and fault profiles unlike those of RSA or elliptic-curve implementations. Rejection sampling in lattice signatures, decapsulation failure handling, and the implicit-rejection path in key encapsulation have all proved to be fertile ground for side-channel and fault attacks, so test benches, leakage models, and countermeasure evaluations are being rebuilt for them. The topic is developed under side-channel resistance in post-quantum implementations.
Supply chain integrity is a second growth area. Verifying that a delivered component is genuine and unmodified draws on X-ray and computed tomography inspection, decapsulation and optical comparison against golden samples, electrical parametric fingerprinting, and side-channel signatures compared against a reference device. Detecting a deliberately inserted modification is harder still, since a well-designed hardware trojan is dormant almost always and consumes negligible area; see hardware trojan detection for the techniques involved.
Application domains impose their own constraints. Constrained IoT devices ship in enormous volume with long field lifetimes and limited update paths, so evaluation must consider a decade of exposure rather than a product cycle. Automotive electronics must be assessed for security and functional safety together, since a fault injection countermeasure that halts a controller can itself become a safety hazard. Industrial control systems often cannot be taken offline at all, pushing evaluators toward passive monitoring, digital twins, and testbed replicas.
Methodologically, automation and machine learning are changing how the work is done. Deep-learning-based profiled attacks can succeed against implementations with misaligned traces and jittered clocks that defeat classical correlation methods, which raises the bar that countermeasures must clear and, in turn, the bar that evaluation must apply. Search algorithms optimize fault injection parameters far faster than manual sweeps. Remotely accessible testing platforms lower the barrier to expensive instruments. At the same time, machine learning accelerators have become targets in their own right, with model extraction and adversarial input attacks joining the list of properties an evaluator may be asked to assess.
Security testing is ultimately an economic argument: no device is unbreakable, and the useful question is what an attack costs relative to its reward. Instruments, methodologies, and certification schemes exist to make that cost measurable and comparable. As electronic systems take on more responsibility for safety, privacy, and money, the discipline of demonstrating security rather than declaring it will only grow in weight, and the tools described in the pages below are how that demonstration is made.