Imatest Documentation

Documentation – v2020.1

Index of the Table of Contents
Offline documentation Download the website for offline view (with a web browser)
Image Quality 
IQ factors (KPIs) measured by Imatest, with links to detailed descriptions and instructions.
Sharpness  Introductions to sharpness and sharpening; comparisons of different charts; chart quality limitations & how to overcome them
Other IQ factors  Noise, SNR, Temporal noise, Dynamic Range (DR),  Chromatic Aberrations, Distortion, Veiling glare, Shannon information capacity, etc.
IQ Utilities  Image Processing, SSIM, Image Statistics, Radial geometry 
Getting started Why Imatest?, Test charts, Lighting, Image capture technique, Setting up your lab, Using Imatest software
Start using Imatest software Installation, Using Imatest, Image file formats & devices, Activation/Deactivation
General Instructions Special standards, Supported devices, Test manager, RAW files, Test lab, INI files, Pass/Fail Monitor
Troubleshooting  What to do when Imatest doesn’t work as expected
Knowledge Base highlights Links to articles for troubleshooting, activation, and general advice on operation.
Slanted-Edge sharpness modules SFR (manual ROIs), SFRplus, eSFR ISO, SFRreg, Checkerboard (auto ROI detection)
Other sharpness modules Log F-Contrast, Star, Random/Dead Leaves/Spilled coins, Wedge, Sharpness utilities & postprocessors
Tone, Color, Noise & Dynamic Range modules Color/Tone (Interactive & Auto), CCM (Color Correction Matrix), CDP, Contrast Resolution, Colorcheck, Stepchart, Measuring patches
Spatial & Uniformity modules Uniformity, Uniformity Interactive, Blemish Detect, Distortion, Dot pattern, Testing displays
Miscellaneous modules and utilities Lighting Control, Arbitrary charts, Printing & displaying charts, Rename Files, Educational Apps
Industrial Testing edition  Modules, Instructions for various interfaces (EXE, C, C++, Python, .NET), INI file reference, Pass/Fail, Operator Console, Speedup
Appendix FAQ, Versions, Troubleshooting, Change Log, INI file reference, License
 

Offline (local) documentation Updated June 29, 2020 for Imatest 2020.1 

Imatest documentation can now be viewed offline. Download this 114 MB  zip file to a convenient location, then unzip it (it requires 242 MB; may take over two minutes). The Imatest site folder will contain a mirror of the Imatest documentation website (imperfect— LaTeX equations don’t work and some images are missing — we’re working on it). Double-click on index.html to open a fully navigable mirror of this page in your web browser. To open documentation directly from Imatest Master (July 2020 or later builds), click on the Offline/Online Help button in the Help tab on the right of the Imatest main window, and follow the instructions.

Image Quality

General — Introduction to Image Quality Factors (Key Performance Indicators – KPIs)

Image quality factorsOverview and Imatest measurements

IntroductionSummary tableImage quality factorsSharpnessTextureNoiseInformation capacityTonal response – Dynamic rangeColor accuracyDistortionUniformityBlemishesExposure accuracy/ISO sensitivity – Lateral chromatic aberrationVeiling glareColor moiré – Software artifactsData compressionPrinter quality factors

Sharpness

SharpnessWhat is it and how is it measured?

IntroductionMTFMTF equationSpatial frequency unitsSummary metrics– MTF measurement matrix Slanted-Edge measurements – Why a slanted edge?ClippingNoise reductionDiffraction & Optimum apertureInterpreting MTF50 – Autofocus SpeedCalculation detailsImatest vs. ISO calculationLinks

Sharpening and Standardized Sharpening for comparing cameras

IntroductionExamples – Over/UndersharpeningExamplesUnsharp masking (USM)Links – Standardized sharpening

Slanted-edge versus Siemens StarA comparison of sensitivity to signal processing

IntroductionImagesRaw resultsSlanted-edge results – Sinusoidal (Log F-Contrast and Siemens star) resultsExtreme sharpeningSummaryConclusions

Slanted-edge versus Siemens Star, Part 2Results for four additional cameras

Slanted-edge measurement consistency and repeatability comparing different ISO speeds and ROI sizes. Incomplete, but still useful.

Validating the Imatest slanted-edge calculation

Nyquist frequency, aliasing, and Color Moire  introducing a color aliasing metric derived from hyperbolic wedges.

Display (Monitor) Sharpness – Display the chartCapture the imageAnalyze – ResultsTV LinesMonitor gammaCMS systems

LSF (Line Spread Function) correction factor for slanted-edge MTF measurements

Compensating camera MTF measurements for chart and sensor MTF

Introduction – Calculation – MTF compensation files – Applying the compensation – Lens MTF measurements

Chart Quality Calculator – determine the suitability of a chart (based on MTF measurements for specific media & print methods) for a specific application
Test chart suitability for MTF measurements – charts for determining the MTF measurement suitability of several media types (inkjet and photographic; reflective and transmissive). Based on Chart Quality Calculator results.
Chart Quality Index (CQI) – older (now deprecated) method that relates chart quality and size to MTF measurements. Replaced by Chart Quality Calculator. The Chart Finder is an interactive website for selecting chart size and media.
MTF curves and Image appearanceCorrelating measurement with appearance
Acutance and SQF (Subjective Quality Factor): perceptual sharpness measurement
 

Other Image Quality Factors

Temporal Noise comparing the two-image and multi-image measurements
Dynamic Range – a general introduction with links to Imatest modules that calculate it.
Chromatic Aberration – (Lateral Chromatic Aberration) AKA Color fringing
Shannon information capacity – information that can pass through a channel without error

The white paper, “Camera information capacity: a key performance indicator for Machine Vision and Artificial Intelligence systems“, which briefly introduces information theory, describes the camera information capacity measurement, then shows results (including the effects of artifacts) is now available for download.

 

 

Image quality utilities let you degrade, enhance, examine, or analyze any image (not just test charts)

Image Processing Simulate several image processing operations (degradations: blur and noise; enhancements: sharpen, bilateral filter, tone mapping, etc.) and observe their effects on appearance and measurements (MTF, SSIM, etc.).
SSIM: Structural Similarity Index Measure image quality degradation and artifacts from signal processing such as compression. Also, measure PSNR.

Image Statistics – Interactively observe image statistics: cross sections, means, noise, SNR, histograms, and frequency spectra.
Radial Geometry – Add or correct distortion, lateral chromatic aberration, or rotation to images.

Getting Started with Image Quality Testing

Why Imatest?     |     Test Charts     |     Lighting     |     Image Capture Technique     |     Setting up Your Lab     |     Using Imatest Software

Start Using Imatest Software

Installation – and getting started
Using Imatest – Introduction and general instructions
Activation/Deactivation – Activating Imatest and moving it from one computer to another
Knowledge base — contains several links to help solve activation issues.
 
Please note:  Each Imatest license can be activated on only one computer at a time, but the activation can be easily moved between computers, especially if they’re online. You can install Imatest– and keep it installed– on as many computers as you like (Macintosh as well as Windows– your license works for both; you never have to uninstall it). To move the activation to another computer, you’ll need to deactivate it on the old computer then activate it on the new one, following the instructions above. You may do this as often as you like.

Imatest Instructions – general

Session LoggingLog level controls for display and log files
Skype video specification support Instructions and suggestions
Autobatch – Combine several test images (from different modules) for a single device into an automatic batch run.

The Imatest Functional Interface – A simplified interface for running tests with consistent settings

The Functional InterfaceThe EditorPreparing a merge file with the INI editor  (may be deprecated in a future release)
Building a test lab – How to build a testing lab
Saving and retrieving Regions of Interest (ROIs) –  How to save and retrieve ROIs in named files for future use.

Saved settings – Imatest-v2.ini and INI files for use with Imatest IT

Pass/Fail Monitor – Realtime display and update of pass/fail results (useful with Imatest IT)
Troubleshooting – What to do when Imatest doesn’t work
 

Knowledge Base highlights Links to articles for troubleshooting, activation, and general advice on operation.

There are many more links like these on the full Knowledge Base.
 

Slanted-Edge sharpness modules

SFRBasic analysis of slanted-edges (manual ROI selection)

Using SFR Part 1 – Setting up and photographing SFR targets
Using SFR Part 2 – Running Imatest SFR
SFR results: – Chromatic Aberration, Noise, and Shannon capacity plot

SFR results: Auto-focus plot

Table of slanted-edge MTF modules with automatic region detection  (Rescharts or batch-capable fixed modules)
All feature ISO-compliant MTF (sharpness) analysis and Lateral Chromatic Aberration (LCA) calculation.
Feature SFRplus
eSFR ISO
eSFRiso_enhanced_200W
SFRreg
Optikos_Meridian_200W
Checkerboard
checkerboard_ideal_framing-200W
Sharpness map detail   High   Medium   Depends on arrangement   High
ISO-standard chart design
Color analysis   (only for SFRreg center chart)
Tonal response (OECF)   (only for SFRreg center chart)
Noise analysis   Limited   Limited   Limited
Distortion ♦ Good   Limited Best
Geometry *
Features and
recommended uses
Imatest’s original automatically-detected chart, in use since 2009. Robust and versatile. Some white space recommended above and below top and bottom bars. More spatial and distortion detail than eSFR ISO.
ISO-standard chart design. Includes wedge analysis and (optional) color patches. Supports detailed noise analysis.

Several individual charts are typically placed around the image field. For
– extreme fisheye lenses (>180º)
target projection systems
– Charts at different distances to test focus & depth of field.
– extreme high resolution cameras (>36MP)

*FoV is omitted from geometry.

Relatively insensitive to framing: can zoom in or out as long as distance is large enough so chart quality is not an issue and there are detectable corners. Well-suited for through-focus measurements. Very accurate distortion measurements.

♦ denotes strong support;  – denotes no support.

SFRplusAutomated analysis of slanted-edges

Using SFRplus Part 1 – The SFRplus chart: features and how to photograph it
Using SFRplus Part 2 – Running SFRplus
sfrplus_predistort_200WPre-distorted and special charts for Fisheye Lenses – with many applications such as automotive rear view cameras
              Includes SFRplus, eSFR ISO, and SFRreg charts.  Previewing pre-distortion


eSFRiso_enhanced_200WeSFR ISO – Automated analysis of the ISO 12233:2014 Edge SFR chart

Using eSFR ISO Part 1 – The ISO 12233:2014 E-SFR chart: features and how to photograph it


SFRreg – Automated analysis of registration mark patterns

  • Optikos_Meridian_200WTest at infinity focus with Long Range projection systems
  • Test imaging systems with ultrawide fisheye lenses (>180 degrees)
  • Test at very long camera-to-chart distances
  • Test at variable distances for Depth of Field.
Using SFRreg Part 1 – Registration mark patterns and how to photograph them
 

Checkerboard – Automated analysis of checkerboard patterns

checkerboard_ideal_framing-200WUsing Checkerboard Part 1 – Checkerboard patterns and how to photograph them
Using Checkerboard Part 2 – Running Checkerboard

Other (Rescharts) sharpness modulesLog F-Contrast, Star, Random, Wedge

Using Rescharts – Analysis of resolution-related charts
Log Frequency – Analysis of log frequency-varying charts
Log F-Contrast – Analysis of charts that vary in log frequency and contrast
Star Chart – Analysis of the Siemens star chart
Random/Dead Leaves – Scale-invariant test charts (including Imatest Spilled Coins)
           for measuring texture sharpness
Texture examples – More details of Imatest Spilled Coins texture sharpness measurements
Dead Leaves measurement issue – Illustrates challenges posed by extreme signal processing
Wedge Analysis – Analysis of hyperbolic or trapezoidal wedge patterns with the Wedge and eSFR ISO modules

Sharpness utilities & postprocessors

MTF Compare – Compare MTFs of different cameras and lenses
Image Stabilization/Sharpness Compare – SFRplus postprocessor for analyzing (Optical) Image Stabilization
          and comparing sharpness of different images
Batchview – Postprocessor for viewing summaries of SFR, SFRplus results
Find Sharpest Files – Find the sharpest files in a batch

Tone, color, and spatial modules

Tone, Color, Noise, and Dynamic Range

New Imatest Dynamic Range film chart with Dmax = base+3.4Using Color/Tone Interactive (Multicharts)Interactive analysis of color & grayscale test charts
Using Color/Tone Auto (Multitest)Fixed (batch-capable) analysis of color & grayscale test charts
Color/Tone/eSFR ISO Noiseincluding chroma, sensor (RAW), and visual noise
Contast Detetction Probability (CDP)  – Based on IEEE p2020 automotive image quality standard
Color/Tone Special ChartsAdditional charts, including ISO OECF and noise chats and circles arranged on a square
Color Correction Matrix (CCM) Calculate a matrix (usually 3×3) for correcting image colors (often from RAW images)
Nonuniformity Correction in grayscale and color chart modules for Color/Tone Auto or Setup, Stepchart, and Colorcheck
Dynamic Range – a general introduction with links to Imatest modules that calculate it.
Contrast ResolutionA special transmissive chart for measuring the visibility of low contrast features in larger fields over a wide dynamic range. Analyzed with Color/Tone Interactive or Auto.
Colorcheck/Color/Tone AppendixColor difference algorithms and reference formulas
Dynamic Range (postprocessor)Calculate Dynamic Range from several Color/Tone Auto or Stepchart images
Measuring test chart patcheswith a Spectrophotometer and one of two software packages

Spatial and Uniformity modules

Light Falloff contour plotUsing Uniformity, Part 1Measure lens vignetting and image nonuniformity
Using Uniformity, Part 2 Features in Imatest Master and IS (not in Studio)
Using Uniformity-InteractiveInteractive measurement of vignetting and sensor nonuniformity (can be used with direct image acquisition)
Using Blemish Detect – Measure visible sensor defects
Lightbox Comparison GuideComparing lightbox brightness and uniformity
Testing flat screen displayswith Imatest Blemish Detect
Using Distortion  (Checkerboard is recommended for strongly barrel-distorted (“fisheye”) lenses.)
Dot PatternAnalysis of a grid of circular dots
 

Miscellaneous modules and utilities

Lighting Control – Set up and control DMX lights (Kino Flo) and Lightboxes as well as monitor lighting conditions with an Isolight puck
Arbitrary Charts – Analyze a chart layout you have designed yourself. 
Using Test ChartsCreate test charts for high quality inkjet printers
SVG Test ChartsScalable Vector Graphics charts for MTF and other measurements
Using Screen PatternsMonitor patterns for Light Falloff, SFR, Distortion, and monitor calibration
Rename Files – using EXIF data
Image Processing Simulate several image processing operations (degradations: blur and noise; enhancements: sharpen, bilateral filter, tone mapping, etc.) and observe their effects on appearance and measurements (MTF, SSIM, etc.).
Image Statistics – Interactively observe image statistics: cross sections, means, noise, SNR, histograms, and frequency spectra.
Composite ChartCreate a synthetic test chart from several individual image files.
Educational Apps – Learning resource for image quality factors and measurements.

 

Imatest IT – Industrial Testing (non-GUI)

Imatest IT-EXE instructions – Running Imatest IT (Industrial Testing)-EXE
Imatest IT-C instructions – Running Imatest IT (Industrial Testing)-C
Imatest IT-C++ instructions – Running Imatest IT (Industrial Testing)-C++
Imatest IT-Python instructions – Running Imatest IT (Industrial Testing)-Python
Imatest IT-.NET (C#) instructions – Running Imatest IT (Industrial Testing)-.NET (C#)
Imatest IT-.NET (Visual Basic) instructions – Running Imatest IT (Industrial Testing)-.NET (Visual Basic)
Imatest IT Parallel (IT-P) – Accelerating Imatest IT by performing tests in parallel
Imatest INI file reference – Reference to INI files for IT/EXE and IT/DLL users (sections used in several modules)
Direct Read Mode – Pass image data directly into Imatest IT, without writing to a file on disk
Implementing Pass/Fail – Setting up Pass/Fail criteria and Pass/Fail Reference. For Imatest IT and GUI versions.

Pass/Fail Monitor – Realtime display and update of pass/fail results (useful with Imatest IT)
Operator Console – User interface for production environments
Imatest IT Knowledge Base – Articles about Imatest IT