Quality Assurance and Performance Testing

Overview and Fundamentals of Quality Assurance

• Quality Assurance (QA) is a comprehensive administrative and technical program designed to guarantee the proper, accurate, and consistent operation of ultrasound imaging systems.
• The primary rationale for maintaining a mandatory QA protocol includes:
  • Preventing patient misdiagnoses caused by image artifacts, machine drift, or sub-optimal system calibration.
  • Confirming equipment reliability to ensure that structural features displayed on scans accurately represent real anatomical structures.
  • Tracking performance trends over time to determine if image degradation is occurring across long-term usage (measured over months to years).
• Core objectives and practical benefits of a structured QA program:
  • Verification of proper equipment operation across all transducers and operational modes.
  • Early detection of gradual performance degradation before catastrophic system failure occurs.
  • Minimization of total machine downtime by catching hardware or software faults early.
  • Reduction of repeat patient examinations, which directly lowers clinical costs and decreases diagnostic errors.
  • Enhancement of patient and sonographer safety by monitoring output power levels, electrical groundings, and structural housing integrity.
  • Maximization of clinical cost efficiency by extending equipment lifespan.
  • Maintenance of departmental and institutional standards of care.

Key Personnel and Responsibilities in Quality Assurance

• Quality assurance requires active collaboration among three primary professionals: the Physician, the Sonographer, and Service Personnel (comprising Biomedical Engineers and Manufacturer Representatives).

• Physician (Radiologist):

  • Serves as the overall director of the departmental Quality Assurance program.
  • Holds ultimate responsibility for assessing diagnostic image quality on clinical scans (responsible for interpreting and reading scans).

• Sonographer:

  • Acts as the front-line evaluator of daily diagnostic image quality.
  • Performs routine quality assurance testing, detailed data logging, and systematic record keeping.
  • Executes basic preventative maintenance, including routine cleaning of air/fan filters, inspection of physical cables, and visual checks of transducer faces.
  • Operates on a regular maintenance schedule classified into daily, weekly, or monthly checks.

• Service Personnel:

  • Manufacturer Field Engineers:
  • Responsible for building, delivering, and performing complex internal repairs on ultrasound systems.
  • Conduct formal Preventative Maintenance (PM) service visits $2$ to $3$ times per year while equipment is under warranty or an active service contract.
  • Biomedical Engineering Personnel:
  • Employed directly by the health service facility or hospital network.
  • Responsible for acceptance testing when a new ultrasound machine arrives on site.
  • Ensure adequate electrical power hookups, physical installation integrity, inter-system networking, and adherence to electrical safety limits prior to clinical deployment.

Preventative Maintenance Protocols and Testing Classification

• Preventative maintenance (PM) encompasses both hardware maintenance and software/performance verification.
• Routine Sonographer PM Tasks:
  • Cleaning exterior surfaces and monitor screens.
  • Cleaning acoustic coupling gel build-up from transducer handles and holders.
  • Inspection and cleaning of system fan dust filters to prevent thermal overheating.
  • Inspecting transducer housings, strain reliefs, and flexible cables for cracks, tears, or exposed wiring.
  • Verifying image recording and digital export quality. (Note: Modern digital archiving via PACS—Picture Archiving and Communication System—automates and standardizes much of the digital image storage workflow).
• Acceptance Testing:
  • Rigorous, comprehensive testing performed immediately upon installation of new equipment prior to initial patient scanning.
  • Includes quantitative measurement of acoustic output power, assessment of spatial and contrast resolution, and verification of full compatibility with department ancillary hardware/software.
• Routine Performance Testing:
  • Performed on a regular scheduled basis (typically yearly) using calibrated tissue equivalent phantoms.
  • Tracks system sensitivity, spatial resolution, dynamic range, and measurement accuracy over time.
  • Meticulous record keeping and trend logging are mandatory components of an effective QA program to detect minor drift before clinical impact.

Phantom Types and Test Objects

• Performance testing relies on standardized acoustic phantom models designed to evaluate transducer and beam former function.

• AIUM 100 mm Test Object:

  • An early design consisting of a fluid-filled plastic container containing groups of $0.75\,\text{mm}$ stainless steel rods placed at specific positions.
  • The internal fluid medium consists of a mixture of water, $9\%$ alcohol, and an algaecide, yielding a speed of sound of $1540\,\text{m/s}$.
  • Advantages: Relatively inexpensive and simple to construct.
  • Disadvantages: Does not attenuate sound like human tissue and lacks acoustic backscatter capabilities; consequently, it cannot test grayscale, dynamic range, Time Gain Compensation (TGC), or contrast resolution.

• Tissue Equivalent (TE) Phantom:

  • A phantom designed to simulate soft tissue sound interaction across all acoustic dimensions.
  • Physical Construction:
  • Enclosed in rigid outer housings made of materials such as Acrylonitrile Butadiene Styrene (ABS), Polyvinyl Chloride (PVC), or acrylic.
  • Scanning windows consist of thin acoustic films made from saran or polyurethane.
  • Internal matrix made of animal gel or synthetic rubber impregnated with fine graphite powder to generate uniform backscatter, along with embedded pin targets, solid lesions, and cystic structures.
  • Advantages: Allows complete clinical system evaluation including Grayscale display, TGC response, attenuation loss, and speed of sound accuracy.
  • Disadvantages: Significantly more expensive and requires careful environmental storage to prevent drying or biological degradation.

• Required Soft-Tissue Matching Characteristics for TE Phantoms:

  • Acoustic Attenuation Coefficient ($0.5\,\text{dB}/(\text{cm}\cdot\text{MHz})$ to $0.7\,\text{dB}/(\text{cm}\cdot\text{MHz})$).
  • Speed of Sound equal to average soft tissue ($1540\,\text{m/s}$ or $1.54\,\text{mm/}\mu\text{s}$).
  • Backscatter Coefficient and relative contrast relative to background matrix.
  • Elasticity and tissue rigidity matching standard anatomical structures.
  • Thermal properties corresponding to soft tissue absorption.

• Comparative Capability Matrix: AIUM 100 Test Object vs. TE Phantom:

Quantitative B-Mode Performance Parameters

Dead Zone

• The dead zone is the shallow region immediately adjacent to the transducer face where no useful diagnostic imaging data can be obtained.
• Cause: Acoustic ringing of the piezoelectric crystal and acoustic pulse duration length (often termed the "main bang").
• Historical Context: Older mechanical transducers exhibited very large dead zones; modern high-frequency linear arrays minimize but do not entirely eliminate this area. Turning off tissue harmonic imaging can alter dead zone appearance.
• Testing Method:
  • Scanned using a top row of closely spaced pins positioned at shallow depths (e.g., $1\,\text{mm}$, $2\,\text{mm}$, $4\,\text{mm}$, and $5\,\text{mm}$ beneath the surface).
  • The shallowest pin clearly visualized without obscuration by main bang reverberation defines the depth of the dead zone.
  • A shift or increase of less than $15\,\text{mm}$ in dead zone depth over long-term monitoring is considered clinically acceptable. An expanding dead zone (e.g., inability to resolve shallow $1\,\text{mm}$ pins previously seen) indicates transducer face detachment, lens degradation, or crystal ringing prolonged over time.

Axial Resolution

• Axial resolution defines the minimum spacing along the sound beam axis required to display two distinct reflectors as separate echoes.
• Formula Relationship:   $\text{Spatial Pulse Length (SPL)} = n \times \lambda$$\text{Axial Resolution} = \frac{1}{2} \text{SPL}$
  • A smaller numerical axial resolution represents superior spatial detail.
• Testing Method:
  • Measured by scanning pairs of closely spaced pins positioned vertically along the beam direction at varying depths.
  • The pins are slightly offset laterally to prevent acoustic shadow or "comet-tail" artifacts from shallow pins obscuring deeper pins.
  • The minimum axial separation resolved as two distinct dots is recorded and monitored over time for degradation.

Lateral Resolution

• Lateral resolution defines the minimum spacing across (perpendicular to) the beam direction required to display two side-by-side reflectors as separate entities.
• Lateral resolution is equal to the beam width at the depth of measurement and varies directly with focal spot placement and aperture size.
• Testing Method:
  • Scanned using horizontal pin groups located at varying depths.
  • Evaluates point-spreading: reflectors appear stretched horizontally if beam width is wide.
  • Minimum separable distance between horizontal pins at the focal zone and non-focal depths is documented.

Elevational Resolution (Slice Thickness)

• Elevational resolution evaluates beam width in the axis perpendicular to the 2D image plane ($Z$-axis).
• Quantitative Assessment: Requires specialized phantoms, such as a spherical void phantom or an inclined plane beam profile phantom.
• Qualitative Assessment:
  • Evaluated using standard TE phantoms containing anechoic cylindrical cysts.
  • If the elevational slice thickness is wider than the simulated cyst at the focal depth, acoustic reflections from adjacent solid phantom matrix will fill the cyst with false internal echoes (slice thickness artifact).
  • If lateral resolution is confirmed to be optimal but a cyst located at the focal zone contains fill-in echoes, poor elevational resolution is confirmed.

Distance Accuracy (Geometrical Calibration)

• Verifies that electronic calipers on the ultrasound system accurately measure real physical distances.
• Vertical Distance Accuracy: Evaluates distance measurements along the sound path by scanning vertical pin columns spaced at precise $10\,\text{mm}$ or $20\,\text{mm}$ intervals.
• Horizontal Distance Accuracy: Evaluates distance measurements perpendicular to the beam path across horizontal pin lines.
• Testing Method:
  • Caliper distance measurements are taken across long pin separations (e.g., $50\,\text{mm}$ to $100\,\text{mm}$) rather than short separations to amplify measurement accuracy and detect tiny percentage errors in sound speed calibration or timing logic.

Time Gain Compensation (TGC) Characteristics

• Evaluates the ability of the receiver gain and TGC slide pods to equalize echo brightness at increasing depths through an attenuating tissue-like medium.
• Testing Method:
  • Requires a Tissue Equivalent Phantom to provide uniform acoustic attenuation.
  • User-driven subjective test: specific slide pod profiles (e.g., flat, sloped, inverted) are set, and the resulting image brightness profile down the screen is compared against reference baseline images.

Image Uniformity

• Evaluates the consistency of image display across the entire width of a linear or curved array transducer.
• Testing Method:
  • Transducer is placed on a completely uniform section of a TE phantom.
  • The image is inspected for vertical dark streaks, shadowing, or inhomogeneous bands.
  • Vertical dark bands indicate defective or uncoupled transducer elements ("dead crystals"), dead channels in beamformer electronics, or delaminated acoustic lenses.

System Sensitivity and Maximum Depth of Penetration

• Sensitivity tests the system's capacity to detect weak acoustic reflections returning from deep structures.
• Maximum Depth of Visualization Technique:
  • System output power and overall gain are set to maximum levels.
  • Transducer scans a vertical pin column extend deep into the phantom.
  • The maximum depth at which background tissue backscatter or pin targets remain visible before fading into electronic noise is recorded using calipers and tracked over time.

Dynamic Range and Displayed Grayscale

• Dynamic range evaluates the total spectrum of echo amplitudes the system can process and display as distinct gray shades.
• Dynamic Range vs. Human Vision:
  • Modern ultrasound systems utilize an $8$-bit image memory, capable of processing $2^8 = 256$ distinct shades of gray.
  • The human eye can perceive approximately $100$ distinct shades of gray under optimal lighting conditions.
• Testing Method:
  • Subjective evaluation performed by scanning gray-scale targets of step-variable reflectivity.
  • Displayed gray shades are recorded and compared against baseline logs to detect video monitor or display processing degradation.

Contrast Resolution and Lesion Detection

• Contrast resolution measures the system's ability to distinguish between structures exhibiting subtle differences in echogenicity (differing decibel reflectivity levels).
• Testing Method:
  • Transducer scans simulated focal masses embedded within the phantom.
  • Targets include solid, cystic, hyperechoic, and hypoechoic spherical lesions of varying small diameters.
  • Minimum detectable lesion size and contrast boundary sharpness are recorded across varying dynamic range settings.

Registration Accuracy (Historical Static B-Scanners)

• Applies to legacy articulated-arm static B-scanners to confirm correct positional sensing electronics.
• Testing Method:
  • A single pin within a phantom is scanned from three distinct angles around the phantom housing.
  • If positional registration is accurate, the three resulting beam lines intersect precisely at a single point. Misalignment or star-like artifact patterns denote articulated arm joint calibration errors.

Doppler Performance Testing

• Evaluation of Doppler performance requires specific specialized phantoms capable of generating controllable, predictable Doppler frequency shifts.

• Flow Phantoms (Tissue Equivalent Flow Systems):

• Consist of a tissue-equivalent gel matrix containing embedded vessel-mimicking tubes connected to a motor-driven fluid pump and fluid reservoir.

• Propels blood-mimulating fluid containing scattering particles to generate realistic acoustic attenuation and flow profiles.

• Pros: Closely mirrors real clinical vascular examinations.

• Cons: Expensive, complex maintenance, and potential for fluid tube degradation.

  • String or Belt Phantoms:

• Utilizes a continuous string, thin belt, or monofilament loop wrapped around motor-driven pulleys moving at precise controlled speeds within a water bath.

• Pros: Highly accurate velocity calibration, affordable, simplified design.

• Cons: Water bath does not attenuate like human tissue; tests Doppler signal processing only without tissue-mimicking backscatter matrix.

  • Doppler Parameters Tested:

• Maximum depth of Doppler signal penetration.

• Sample volume gate positional accuracy relative to 2D image overlay.

• Absolute volume flow measurement accuracy and velocity calculation accuracy.

• Color Flow sensitivity and penetration depth.

• Image Congruency: Verifies whether the color Doppler overlay aligns precisely with the underlying structural B-mode anatomical boundary.

Specialty Phantoms and Advanced Applications

• Phantoms serve essential functions beyond routine QA, including sales demonstrations, student training, and clinical research & development.

• Specialized Application Phantoms:
  • Biopsy Phantoms: Designed with self-healing rubber matrix for interventional ultrasound training (e.g., breast mass biopsy, prostate seeding).
  • Mass Phantoms: Simulate specific pathological tumor tissues.
  • 3D/4D Phantoms: Complex volumetric structures (e.g., fetal face models) designed to test spatial rendering algorithms.
  • Cryosurgery Phantoms: Designed to withstand freezing cycles to evaluate ice-ball boundary growth.
  • Brachytherapy Phantoms: Used for prostate grid template alignment and radioactive seed placement verification.
  • High-Intensity Focused Ultrasound (HIFU) Phantoms: Thermally sensitive phantoms designed to measure focused ablation zones.
  • Intra-Vascular Ultrasound (IVUS) Phantoms: Miniature vessel phantom lumens designed for catheter-based high-frequency transducers.

Acoustic Output Measurement Devices

• Quantitative assessment of sound energy and acoustic power output is conducted primarily by biomedical engineers, medical physicists, and manufacturer hardware engineers using calibrated measurement instruments.

Hydrophone (Microprobe Receiver)

• Construction: A tiny piezoelectric crystal element (diameter typically $1\,\text{mm}$ or less) mounted on a needle tip or thin polyvinylidene fluoride (PVDF) plastic membrane.
• Mechanism: Produces an electrical voltage proportional to the acoustic pressure wave striking the probe tip.
• Instrument Pairings & Derived Measurements:
  • Hydrophone + X-Y Plotter: Hydrophone moves systematically through the sound field in a water tank to construct a 2D or 3D acoustic beam pressure profile.
  • Hydrophone + Oscilloscope: Displays voltage waveforms over time to determine Spatial Pulse Length (SPL), Pulse Duration (PD), Pulse Repetition Period (PRP), Pulse Repetition Frequency (PRF), and Duty Factor (DF).
  • Hydrophone + Spectrum Analyzer: Evaluates signal frequency spectrum to measure resonant operating frequency ($f$), total bandwidth, fractional bandwidth, and Quality Factor ($Q$)-factor.
• Schlieren Optical System: Uses light refraction physics (acoustic-optical effect) to visually map and photograph ultrasound beam intensity profiles in water.

Force Balance (Radiation Force Balance)

• Mechanism: A delicate analytical micro-balance positioned inside a water tank containing a target acoustic absorber.
• Measurement: When the ultrasound transducer fires at the target absorber, sound radiation pressure exerts a physical downward force. The balance measures this radiation force, which is converted to determine total acoustic power and output intensity.

Calorimeter and Thermocouple

• Calorimeter:
  • A closed, insulated fluid chamber designed to measure total acoustic beam power through thermal absorption.
  • When ultrasound energy passes into the fluid, acoustic power is converted into heat; total power is derived from measuring fluid temperature rise over time.
• Thermocouple:
  • A miniature electric thermometer constructed from two dissimilar metals.
  • Inserted into the sound beam at specific locations to measure localized temperature rise and localized intensity levels.

Future Trends in Quality Assurance

• Advances in ultrasound technology necessitate continuous updates in phantom construction, target design, and QA testing workflows.
• Phantom Innovations: Development of ultra-thin film targets and microscopic point targets to evaluate high-frequency, high-resolution modern transducers.
• Automated Machine Self-Evaluation:
  • Integration of automated software routines within modern ultrasound hardware.
  • Systems capture phantom image files and execute automated computer-vision calculations to measure pin distances, contrast values, and dead zones.
  • Eliminates human evaluator subjectivity, standardizes QA reporting, and reduces time required for routine routine testing.