Using Stepchart

Photographing the chart – Running Stepchart – Settings – Output – Temporal noise Auto-exposure – Saving – Dynamic range (DR) – DR definitions – Algorithm   Stepchart measures the tonal response, noise, dynamic range, and ISO sensitivity of digital cameras and scanners using Reflective grayscale step charts such as the Kodak Q-13 and Q-14 Gray Scales, which have a single row of patches (a linear arrangement), or charts such as the ISO-14524 or ISO-15739 charts, with non-linear (multiple rows; may be circular) patch arrangements, shown below, or Transmissive (backlit) grayscale step charts such as the Imatest 36-patch Dynamic Range or 36-patch […]

Image Processing for Image Information Metrics

  The basic premise of this work is that Information capacity is a superior metric for predicting the performance of machine vision systems. It is better than sharpness or noise, which it incorporates, and it can be used  to derive metrics for measuring object and edge detection performance and for designing electronic filters that optimize system performance. To test the premise under a variety of conditions, we use the Image Processing module to degrade the image (blur it or add noise) and/or enhance it (apply sharpening or lowpass filtering, i.e., noise reduction).   Related pages Image Information Metrics: Information Capacity and […]

Using Screen Patterns

Monitor patterns for Light Falloff, SFR, Distortion, and monitor calibration There have been some significant enhancements to Screen Patterns in Imatest 24.1: SFRreg patterns, Checkerboard patterns with adjustable contrast, and a simplified 5-row SFRplus pattern with five rows have been added. A much larger selection of patterns is now available on Test Charts, which can create extremely high quality screen displays for most Imatest test patterns.           Introduction Screen Patterns displays a variety of test patterns on monitors, preferably on LCD flat screen monitors. It may become more useful as cost-effective ultra-high resolution (4k+) monitors become […]

Using Checkerboard, Part 2: Running Checkerboard

Selecting files – Setup window – ROI selection & analysis area – Edge ID Files More settings window – Secondary Readout  – Settings area – Auto mode window Warnings – Clipping – Summary    Using Checkerboard Part 1 – Checkerboard patterns and how to photograph them Running Checkerboard (Interactive and Auto mode settings) Imatest Checkerboard performs highly automated measurements of sharpness (expressed as Spatial Frequency Response (SFR), also known as Modulation Transfer Function (MTF)), Lateral Chromatic Aberration , and optical distortion from tilted checkerboard images.The primary advantage of Checkerboard is that the field of view, i.e., the framing, does not need to be tied to the chart size (as it […]

The Imatest Pass/Fail Monitor

The Pass/Fail monitor (introduced In Imatest 4.0) provides a real-time indication of whether a device has passed or failed a test. It saves the trouble of digging through results— in figures or CSV or JSON files. Key features: It can stay open while modules run, displaying results immediately after calculations are complete. It works best on systems with a high resolution screen or dual screens. It interfaces with most Imatest analysis modules. It can be extremely valuable for developing and testing Pass/Fail criteria for Imatest IT (Industrial Testing). It can call several utilities for helping with this process. It displays […]

Texture examples

Introduction Part 1 of this page illustrates images analyzed in Random Scale-invariant & Dead Leaves. The images are not shown original size; they’ve been resized to be approximately equal in magnification with respect to the original chart image— with enough magnification to show the results of the camera optics and image processing. Part 2 demonstrates how demosaicing is the cause of a commonly observed discrepancy between Spilled Coins and slanted-edge MTF measurements. Part 1: Images used in Random / Dead Leaves Original pattern (cropped from the middle of the chart), for reference. Original pattern (reduced from file used to print […]

Texture Analysis ( Random-Cross) Method

Introduction: Starting in version 4.5, Imatest is capable of performing the cross-correlation based texture blur measurement which is under consideration for ISO 19567-2: Texture Analysis on Stochastic Pattern. This is a texture-blur-analysis method originally proposed in Description of texture loss using the dead leaves target: Current issues and a new intrinsic approach by Kirk et al at Image Engineering.  This method starts from the same principles as the so-called “Direct” method of Cao et al which is the Power Spectral Density-based method described on the Random Module page. The main difference is the Direct method makes use of assumed statistical properties […]

Test plan reference: Slanted-edge modules

This document contains reference data intended to help Imatest users implement test plans that include automatically-detected slanted-edge modules. It describes the most important JSON results, which can be used for Pass/Fail criteria, as well as the key settings needed to get these results.Settings windows and recommended settings Settings for slanted-edge modules Slanted-edge modules can be run in either Setup (interactive) or Auto (batch-capable) mode. You can make settings in Setup mode; Auto mode uses saved settings from Setup mode.  When you run one of  the four auto-detection slanted-edge SFR modules (eSFR ISO, SFRplus, Checkerboard, and SFRreg) in Setup mode, the […]

Temporal Analysis of Video Files

Overview Imatest modules can perform basic analysis of a video system’s ability to auto focus (AF), auto white balance (AWB) or auto expose an image (AE). Combined, these three tests may be referred to as AAA analysis. Currently, temporal analysis is only compatible with the following modules: Auto Focus: SFR Mean Normalized Pixel Level (Auto Exposure): Arbitrary Charts, CMP DT003, Colorchecker 24, Colorchecker SG, ColorGuage 6×5, RezChecker 6×7, Contrast-Resolution, ChromaDuMonde 28, DreamCatcher 48, EIA Grayscale, 36 Patch Dynamic Range, ISO 14524, ISO 15739, IT8.7, ITEGrayscale, OECF 20, QA-61, QA-62, QA79, QP Card, SpyderCHECKR, TE226, TE269 Exposure Error (Auto Exposure): CMP […]

SVG Test Charts

Test Charts creates test chart files for printing on high quality inkjet printers. This page focuses on Scalable Vector Graphics (SVG) charts, many of which are used for measuring sharpness (MTF) with Imatest SFR, SFRplus, eSFR ISO, Checkerboard, and SFRreg. (Bitmap charts are described elsewhere.) SVG charts can be printed any size at a printer’s maximum quality (i.e., resolution) with no limitations, and they generally require much less storage than bitmap images. The SVG charts designed for automated testing with SFRplus and eSFR ISO (based on ISO 12233:2014/2017) have numerous advantages over the familiar but obsolete ISO 12233:2000 chart. Most […]

Summary Metrics

Page Contents This page provides an overview of the summary metrics Overview Level-Based Metrics Count-Based Metrics Minimum Measurable Stray Light Maximum Measurable Stray Light Overview Similar to how MTF50 (SFR50) and MTF area provide a single number for resolution, stray light also has single number measurements for characterizing stray light performance. These summary metrics fall into two categories: Level-Based: Metrics that are about the amount (level) of the stray light Count-Based: Metrics about the number of pixels (count) that meet a criteria Level-Based Metrics Overview Level-based summary metrics describe the amount (level) of stray light in the image. They include […]

Stray Light Test Considerations

This page describes the technical considerations of stray light testing. Test Assumptions The table below describes assumptions that may be made for stray light testing, along with the associated consequences (if the assumption is not entirely true) and possible improvements to address the consequences. Light Source Collimated vs Diverging Source From a calculation perspective, stray light may be measured with either a diverging or collimated light source. However, for repeatability between test setups, a collimated light source is recommended.  Two aspects over which stray light may be measured are the angle of rays and the intersection (translation) of them relative […]

Stray Light (Flare) Documentation

Page Contents This is the landing page for Imatest’s stray light documentation. This page provides an introduction to stray light and how to test for stray light using the small, bright light source approach. It also introduces the concept of “normalized stray light metric images”. See also the Veiling Glare documentation for information about the chart-based approach to measuring veiling glare; a specific form of stray light.  Intro to stray light (flare) How to test for stray light Test environment Light source, set up, and alignment Test coverage: extent and sampling Image data Normalized stray light metric images Normalized stray […]

Star Chart

 Analyze the Siemens Star chart New in Imatest 2020.1 (Feb. 2020)  Shannon information capacity can be calculated from images of the Siemens star, with much better accuracy than slanted-edges. The old slanted-edge method has been deprecated.   The white paper, “Camera information capacity: a key performance indicator for Machine Vision and Artificial Intelligence systems“, which briefly introduces information theory, describes the camera information capacity measurement, then shows results (including the effects of artifacts) is now available for download. Imatest 5.0: Half-stars (rotated by multiples of 45º) can now be analyzed. A star-only pattern (without density patches, etc.) can be selected in […]

Spilled Coins, Dead Leaves, and Random Chart Analysis

Analysis of random scale-invariant patterns, including the Spilled Coins (Dead Leaves) Pattern, for measuring texture sharpness Introduction – Obtaining – Photographing – Running – Automatic ROI detection – Output  MTF – MTFnn, MTFnnP – Power Spectral Density – Equations & Scale-invariance Related pages:  Texture examples – Dead Leaves measurement issue – Random/Dead Leaves cross method      Introduction  Random/Dead Leaves, which runs under the interactive Rescharts interface or as a fixed (non-interactive, batch-capable) module, measures SFR (Spatial Frequency Response) or MTF (Modulation Transfer Function) from random scale-invariant (or approximately scale-invariant) test charts, including “Dead Leaves” and “Spilled Coins” charts. It is primarily used to measure the effects of signal processing on image texture. […]

Slanted-Edge versus Siemens Star, Part 2

A comparison of sensitivity to signal processing: Results for additional cameras This page contains additional Slanted-edge, Siemens Star, and Log F-Contrast results for four cameras, in support of claims in Slanted-edge versus Siemens Star that Siemens Star MTF measurements are nearly as sensitive to sharpening as low-contrast (4:1) slanted-edge measurements. The Siemens Star’s high contrast (specified at >50:1) makes it quite sensitive to saturation and to “shoulders” (regions of reduced contrast) in camera tonal response. Slanted-edge MTF measurements are stable, reliable, and more representative of perceived image sharpness under a wide range of conditions (in addition to their many well-known […]

Slanted-Edge versus Siemens Star

A comparison of sensitivity to signal processing In this page we address concerns about the sensitivity of slanted-edge patterns to signal processing, especially sharpening, and we correct the misconception that sinusoidal patterns, such as the Siemens star, are insensitive to sharpening, and hence provide more robust and stable MTF measurements. The Siemens Star is of particular interest because, along with the slanted-edge, it is included in the ISO 12233:2014 standard.  To summarize our results, we found that sinusoidal patterns are sensitive to sharpening, though often less so than low contrast (4:1) slanted-edges. The relatively high contrast of the Siemens Star […]

Skype video specification support

Instructions and comments We are updating this page for the latest Skype/Lync specification. An index of of the Skype/Lync specifications can be found on  http://technet.microsoft.com/en-us/lync/gg278181.aspx. This document contains instructions for using Imatest with the Skype Hardware Certification Specification — For all Skype Video Devices Version 5.0. It also contains comments and suggestions (some of which we hope might be adopted in a future release of the spec). The Skype spec uses only a tiny fraction of Imatest’s powerful capabilities. To learn more, see Image Quality Factors and SFRplus (which allows many factors to be measured from a single image). In […]

Skype for Business Video Specification Support

Instructions and comments Under development We are updating this page for the latest Skype for Business Video Capture Specification, December 2016. An index of of the Skype/Lync specifications can be found on https://technet.microsoft.com/en-us/office/dn788953 This document contains instructions for using Imatest with the Skype for Business Video Capture Specification, which has two versions: personal solutions (Document Number: H100693) and conferencing devices (Document Number: M1023160), published December 2016. “Skype for Business V3.0” appears on a watermark, and 3.0 is indicated in the Revision History (Section 1). It also contains comments and suggestions for running Imatest. The Skype spec uses only a tiny […]

Sharpness Comparisons for several digital cameras

Sharpness results derived from Websites Several websites publish images of ISO 12233 test charts that can be entered into Imatest SFR to obtain detailed sharpness measurements. This page contains sharpness results derived from charts downloaded from two sites: Dpreview.com (DPR)   Imaging-resource.com (IR)   The measurements in the tables below come from two areas of the ISO 12233 image, illustrated by red rectangles in the image below. First row: near the center. The rectangle just above the center of the chart (about 15% of the distance to the corners). Second row: near the corner. The rectangle in the lower right […]