Secondary Readouts – Gamma – Auto mode settings – Warnings – eSFR ISO summary
Running eSFR ISO
Imatest eSFR ISO performs highly automated measurements of several key image quality factors using one of three versions of the ISO 12233:2014 Edge SFR chart: Standard, Enhanced, or Extended. This document shows how to run eSFR ISO in Rescharts and how to save settings for automated runs. Part 1 introduced eSFR ISO and explained how to obtain and photograph the chart. Part 3 illustrates the results.
|
New in Imatest 4.0 eSFR ISO settings can be updated by clicking Settings, eSFR ISO Auto settings in the Imatest main window without having to read an image file into Rescharts eSFR ISOSetup. |
Open Imatest by double-clicking the Imatest icon 
on
- the Desktop,
- the Windows Start menu,
- the Imatest folder (typically C:\Program files\Imatest\Master (or …\Image Sensor, etc.) in English language installations).
eSFR ISO operates in two modes: interactive/setup and automatic.
To initialte an interactive/setup eSFR ISO run (in Rescharts), press or , 9. eSFR ISO. opens a dialog box for reading an eSFR ISO file; is more general; it lets you open any Rescharts module. Either of these buttons allows you to analyze an eSFR ISO image, examine detailed results interactively, and save settings for the highly automated runs (or the even more automated Imatest IT EXE or DLL versions). eSFR ISO should be run at least once interactively prior to the first run. eSFR ISO settings can also be updated by pressing Settings, eSFR ISO Auto settings from the Imatest main window.
Rescharts eSFR ISO
Selecting file(s)
The portion of the Rescharts window used for opening files is shown on the right. You can open a file by clicking on if the correct chart type is displayed, or by selecting a Chart type. One or more files may be selected, as shown below. If you select multiple files, they can be combined (averaged), and you’ll be given the option of saving the combined file.
If the folder contains meaningless camera-generated file names such as IMG_3734.jpg, IMG_3735.jpg, etc., you can change them to meaningful names that include focal length, aperture, etc., with the View/Rename Files utility, which takes advantage of EXIF data stored in each file.
The folder saved from the previous run appears in the Look in: box on the top. You are free to change it. The file name from the previous run is displayed at the bottom. You can open a single file by simply double-clicking on it. You can select multiple files for combined runs (for interactive or eSFR ISO auto runs) or for batch runs (for eSFR ISO auto-only) by the usual Windows techniques: control-click to add a file; shift-click to select a block of files. Then click . Three image files for the Canon 17-40mm L lens are highlighted. Large files can take several seconds to load.
File selection
|
| RAW files Imatest can analyze raw files from cameras (using dcraw) or from development systems (using Generalized Read Raw). The files can be demosaiced or Bayer raw: standard files (TIFF, etc.) that contain undemosaiced data. Undemosaiced files are not very useful for measuring MTF because the pixel spacing in each of the four image planes is twice that of the image as a whole; hence MTF is lower than for demosaiced files. But Chromatic aberration can be severely distorted by demosaicing, and is best measured in Bayer RAW files (and corrected during RAW conversion). Details of RAW files can be found here |
eSFR ISO setup window
When the file (or files) have been opened, the eSFR ISO setup window, shown below, appears. This window allows you to select groups of regions (ROIs; shown as violet rectangles) for analysis. It also lets you select the size of the regions, whether to analyze vertical or horizontal edges, and much more. Pressing on the left opens the eSFR ISO More settings, which allows you to select additional settings that affect the calculations and display. Pressing lets you select the output figures and files (for eSFR ISO auto mode runs).
eSFR ISO setup window; 18 regions (centers and all inner regions) selected for analysis
| eSFR ISO setup window Settings that affect run speed are shown with red background. |
|
| Settings area | |
| Gamma | Assumed Gamma (contrast) of the chart. Has a small effect on the MTF results. Default is 0.5. Overwritten if the Use for MTF checkbox (below Chart contrast) is checked. Gamma is described in more detail below. |
| Channel | Select channel to analyze: R, G, B, Y, R-only, G-only, B-only, Y-only. (Y is Luminance channel). Use one channel only to speed up calculations or where other channels are dark or may not contain valid data. Selecting one channel-only can significantly speed up calculations. |
| Chart contrast (for gamma calc.) |
Chart contrast– for the contrasty squares (i.e., most of them). Used to estimate gamma from the image. Should be set to 4 for most eSFR ISO runs. The background will be pink (as a warning) if another contrast is selected. |
| Use for MTF | (Checkbox, normally unchecked) When checked, the gamma derived from the chart is used for the MTF calculation. This may result in a small improvement in accuracy. |
| Open the eSFR ISO More settings window, shown below. | |
| Open the eSFR ISO Auto mode settings window, shown below, for controlling . | |
| ROI Selection & analysis area | |
| Region selection (Selects which regions to locate. Actual ROIs are located |
Select the regions (ROIs) to analyze. The number of regions (when Horizontal or Vertical-only is selected) is in parentheses. This is a particularly important setting. We encourage users to become familiar with the settings below. At least 9 regions are required for 3D plots. These settings are different from SFRplus (though similar in principle).
1. Ctrs and outer corners (6 or 9 ISO squares) (the default). Note that two regions are always selected for the center square and center regions are included in all region selections except for the two for Edge ID files. 2. Read EdgeID/Zone selection file. An Edge ID/Zone selection file contains a list of identifiers for slanted edge ROI locations or selection zones, one per line, similar to lists in CSV and JSON output files. There are two types of data line: for individual ROIs and for ROI selection zones. It allows you to freely select edges or zones.
Click Read EdgeID file to read the file. Then click OK. Individual edge ROI selection lines: the format is Column_Row_Side, where
Example: -2_1_L selects the left edge of the square two columns left of center and one row below center. Zone ROI selection lines: the format is Z ii nn or S ii nn, where
Example: Z 60 80 selects all edges with centers between 60 and 80% of the way between the image center and the corner. Several zones can be selected. 3. Use most recent EdgeID file.
“9 iso sqs” refers to the 9 squares from the ISO 12233:2014 specification, i.e, the squares included in the Standard E-SFR chart. “15 sqs” refers to all 15 squares in the Enhanced or Extended charts. These selections (9-14) should not be used with the Standard chart. 1, 4-8. These selections work for all charts including the Standard Chart, which has only 9 squares. 9-15. These selections work with the Enhanced or Extended charts, which have 15 squares. They should not be used with the Standard (9 square) chart. Other selections may be added on user request. |
| Vertical, Horizontal edges (or both) | Chooses between Vertical and Horizontal edges (or both). Usually Vertical, but Horizontal is useful on occasion. Use both for Lens-style MTF plots. For 3D plots it’s best to plot Horizontal or Vertical-only. |
| Step chart (checkbox) | Perform step chart analysis. Should be unchecked for charts that do not include the step chart (such as transmissive chrome-on-glass charts). Checked by default. |
| Color chart (dropdown menu) |
For the pattern above the center square: Perform color analysis, slanted-edge MTF analysis, or no analysis. Color analysis should only be checked for charts that include the optional color pattern. Be sure the correct Color reference (file name) and Color space has been entered in the Settings region of the More settings window. Unchecked by default. |
| Wedge | If checked, automatically detect the locations of the four wedge pairs and perform a wedge analysis, as described in Wedge. |
| Negative | Check this box for negative images (light squares on dark background). For some Infrared systems. |
| Speedup (checkbox) | Speed up the run by eliminating some calculations that many users don’t require, including SQF/Acutance, noise statistics and histograms. |
| ROI size | Slider that determines the size of the ROI. Use the largest value that keeps a safe distance from edges of squares. May need to be reduced when distortion is severe. |
| Allows borders to be cropped to remove interfering patterns that might otherwise be included in the image. This button is tinted pink whenever the image is cropped. | |
| ROI width (below ROI size slider) |
Width of ROI selection. Normal width for the standard rectangular ROI. Choose Wider or Widest for very fuzzy edges, for enhanced noise analysis, or for more extended low frequency response. |
| Other controls | |
| Title | Title. Defaults to file name. You can add a description. |
| Open this web page in a web browser. | |
| Display … image | Selects image for Setup window display: Original (RGB) image, R, G, or B channel |
| Save settings (for use in auto eSFR ISO), but do not continue with run. | |
| Save settings and continue with run: Calculate results for all selected region. You will be able to view results interactively. | |
| Cancel run; do not save settings | |
After you’ve finished making settings, click to save settings and continue with the run. You can Click to save the settings without continuing.
| Setting | Value(s) for fast operation | ini file for IT | Effect |
| Channel | [S] One channel (typically Y (luminance))-only | RGBY_value = 8 | Major |
| Speedup | [S] Checked (on). Turns off slow noise & histogram calculations. | speedup = 1 | Major |
| Step chart | [S] Unchecked (off, unless needed) | stepchart = 0 | Minor |
| Wedge | [S] Unchecked (off, unless needed) | Moderate | |
| Analyze color patches | [S] No color patches (unless needed) | colorchart = 0 | Minor |
| Edge roughness | Unchecked | edgerough = Min | Minor |
| Acutance analysis | Unchecked | SQF = Min | Minor |
| Noise settings | Opens Noise settings window. For speed, Noise calculations (near top) should be set to 1 or 2 (No or Elementary calculations). Visual Noise display settings should be set to 1. No Visual noise. | Major | |
| [S] means this setting is in the eSFR ISO setup window (most are also in More settings). Others are in More settings-only. | |||
| IT users: See the knowledge base post, Speeding up Imatest IT with INI File Settings. INI file settings (above) are for the [esfriso] section of the ini file. | |||
More settings window
The eSFR ISO More settings window, shown below, opens when
- is pressed in the eSFR ISO setup or Rescharts windows.
- Settings, eSFR ISO settings is pressed in the Imatest main window, then the is pressed in the eSFR ISO settings window.
Settings are read from the imatest-v2.ini file (rescharts.ini prior to Imatest 4.2), and saved to imatest-v2.ini when is pressed. Settings are similar to the settings in the SFR input dialog box.
eSFR ISO More settings window
| You can select either Expert or Simplified mode for the settings window. In Simplified mode many settings are grayed out so they can’t be set. If you press , commonly used settings (recommended for beginners) are selected. |
This window is divided into sections: Title and on top, then Display options, Settings, Optional parameters, and finally, or at the bottom.
Title defaults to the input file name. You may leave it unchanged, replace it, or add descriptive information for the camera, lens, converter settings, etc.— as you please.
opens a browser window containing a web page describing the module. The browser window sometimes opens behind other windows; you may need to check if it doesn’t pop right up.
|
Display options (below Plot) contains settings that affect the display (units, appearance, etc.). MTF plot units selects the spatial frequency units for MTF plots for for the summary plot. Cycles/pixel (C/P), Cycles/mm (lp/mm), Cycles/inch (lp/in), Line Widths per Picture Height (LW/PH), and Line Pairs per Picture Height (LP/PH) are the choices. (Note that one cycle is the same as one line pair or two line widths.) If you select Cycles per inch or Cycles/mm, you must enter a number for the pixel size— either in pixels per inch, pixels per mm, or microns per pixel. For more detail on pixel size, see the box below. Maximum MTF plot frequency selects the maximum display frequency for MTF plots. The default is 2x Nyquist (1 cycle/pixel). This works well for high quality digital cameras, not for imaging systems where the edge is spread over several pixels. In such cases, a lower maximum frequency produces a more readable plot. 1x Nyquist (0.5 cycle/pixel), 0.5x Nyquist (0.25 cycle/pixel), and 0.2x Nyquist (0.1 cycle/pixel) are available.  Secondary readout controls the secondary readout display in MTF plots. The primary readout is MTF50 (the half-contrast spatial frequency). Two secondary readouts are available with several options. The first defaults to MTF30 (the spatial frequency where MTF is 30%). The third is used only for Lens-style MTF plots. Clicking Change opens the window shown on the right. Secondary readout settings are saved between runs. Choices:
Edge plot selects the contents of the upper (edge) plot. The edge can be cropped
Wavelength (um) for diffraction-limited MTF plot. If a number is entered (0.555 um is the default for visible light systems) and pixel spacing is also entered, the diffraction-limited MTF is displayed on the MTF plot and the diffraction-limited edge or Line Spread Function (cross-section of Airy disk) is shown on the edge plot as a faint dashed line. |
|
Settings affect the results as well as the display.
Speedup Speed up calculatons by eliminating some calculations that many users don’t require, including noise statistics and histograms. Checking Speedup can significantly speed up calculations. Edge roughness Calculate edge roughness (for including in CSV output). Slows calculations slightly. Required if Edge roughness plot is to be displayed. MTF noise reduction (mod apod) Reduce noise using the modified apodization technique. Improves MTF accuracy, especially with noisy images, but not an ISO standard calculation. Generally recommended. Channel specifies the primary channel to display (all channels are analyzed). It’s normally left at it’s default value of Y for the luminance channel, Color reference and Color space are used when a color analysis is to be performed (if the image contains the color pattern and the Color chart box is checked in the eSFR ISO setup window). The Color reference dropdown menu allows you to browse for the Gamma (the average slope of log pixel levels as a function of log exposure for light through dark gray tones) is used to linearize the input data, i.e., to remove the gamma encoding applied by the camera or RAW converter. It defaults to 0.5 = 1/2, which is typical of digital cameras, but may be affected by camera or RAW converter settings. Small errors in gamma have little effect on MTF measurements (a 10% error in gamma results in a 2.5% error in MTF50 for a normal contrast target). Gamma should be set to 0.45 or 0.5 when dcraw is used to convert RAW images into sRGB or a gamma=2.2 (Adobe RGB) color space. It is typically around 1 for raw images that haven’t had a gamma curve applied. If gamma is set to less than 0.3 or greater than 0.8, the background will be changed to pink to indicate an unusual (possibly erroneous) selection. If the chart contrast is known and is ≤10:1 (gamma should always be 4:1 for eSFR ISO), you can enter the contrast in the Chart contrast (for gamma calc.) box, then check the Use for MTF checkbox. Gamma will be calculated from the chart and displayed in the Edge/MTF plot. If chart contrast is not known you should measure gamma from an image of a grayscale stepchart. A grayscale is included in eSFR ISO charts. Gamma is calculated when eSFR ISO is run and displayed in the Tonal Response/Gamma/White Bal plot. Gamma can also be calculated from any grayscale stepchart (a huge variety is available) by running Colorcheck, Stepchart , Multicharts (interactive), or Multitest. A nominal value of gamma should be entered, even if the value of gamma derived from the chart (described above) is used to calculate MTF.
Incident lux (for ISO sensitivity calculations) When a positive value of incident light level (not blank or zero) in lux is entered in this box, ISO sensitivity is calculated and displayed in the Stepchart noise detail figure. More details are on the ISO Sensitivity and Exposure Index page. Zone weights Weights of the center, part-way, and corner zones. Used for calculating weighted means of key results, displayed in the Multi-ROI and 3D plots. The defaults of 1 (center), 0.75 (part-way), and 0.5 (corners) are for typical pictorial photography; corners should probably be given more weight for technical photography. (Note: The boundary between center and part-way is 30% of the center-corner distance. The boundary between part-way and corner regions is 75%, except for eSFR ISO, where it is 68%.) Reg. mark vert. spacing in cm (Registration mark vertical spacing) is used to calculate the Field of View (FoV) when Pixel spacing (pitch) has been entered. It is optional (not normally entered). FoV is displayed in Image & Geometry and reported in the CSV output file if calculated. Lens-to-chart distance in cm is used to calculate the actual lens focal length when Pixel spacing (pitch) and Registration mark spacing have been entered. It is optional. The distance from the lens to target is most conveniently measured with a laser measuring device. Focal length is displayed in Image & Geometry and reported in the CSV output file if calculated. eSFR ISO noise settings opens the Noise and Visual Noise settings window described in Multicharts/Multinoise and eSFR ISO Noise measurements. This sets which types of noise are calculated (affects speed), the display x-axis (Density units, EV, dB, etc.), and Visual Noise viewing conditions. Standardized sharpening Three settings are available:
See SFR instructions for more detail. restores the settings in eSFR ISO More Settings to their default values. |
|||||||||||
|
Additional parameters (all optional) for Excel .CSV output contains a detailed description of the camera, lens, and test conditions. EXIF data is entered, if available, but can be overridden by manual settings. Description & settings is particularly useful for annotating the test system (it is displayed in MTF Compare).These settings are optional but can be useful when several tests are run for different lenses, focal lengths, apertures, or other settings. The settings are displayed next to the MTF plots. They are saved and reused in subsequent runs for files with the same pixel dimensions. If EXIF data is available (currently, only in JPEG files) it overrides the saved settings. The Reset button clears all entries. |
ISO standard SFR If this checkbox is checked, SFR calculations are performed according to the ISO 12233 standard, and the y-axis is labeled SFR (MTF) (ISO standard). This method is slightly less accurate than the normal Imatest calculation, which incorporates a number of refinements, including a better edge detection algorithm and a second-order polynomial fit to the average edge for a more accurate estimate of SFR in the presence of optical distortion. This box is normally left unchecked; it should only be used for comparing normal Imatest calculations to the ISO standard. The difference is typically very small.
When entries are complete, click to return control to the eSFR ISO setup window. When all entries are complete, click either , , or . saves the settings for use in automated eSFR ISO runs, which can be initiated from the button in the main Imatest window. saves the settings then calculates results for interactive viewing. A sequence of Calculating… boxes show the progress of the calculations. When calculations are complete, results are displayed interactively in the Rescharts window.
Auto mode settings window
Auto mode settings affect plots and output files for eSFR ISO Auto runs as well as Imatest IT/EXE and DLL. It does not directly affect interactive (Rescharts) eSFR ISO runs. The eSFR ISO Auto mode settings window, shown below, opens when
- Auto mode settings is pressed in the eSFR ISO setup window.
- More settings is pressed in the Rescharts window, then Switch to eSFR ISO Auto mode setup is pressed in the More settings window.
- Settings, eSFR ISO settings is pressed in the Imatest main window, then Auto more settings is selected.
eSFR ISO auto mode settings
The upper box allows you to select single and multi region figures to be plotted and saved in eSFR ISO auto output. For the most part they are self-explanatory. Note that all plotted figures are saved.
Saved figures, CSV, XML, and JSON files are given names that consist of a root file name (which defaults to the image file name) with a suffix added. Examples:
Canon_17-40_24_f8_C1_1409_YR7_cpp.png
Canon_17-40_24_f8_C1_1409_YR7_MTF.csv
When 3D plot is checked, eSFR ISO auto plots the last 3D plot displayed in Rescharts unless the button has been pressed and one or more plots has been selected. More 3D plots will be displayed in pink in this case. This allows several 3D plots to be displayed and saved by eSFR ISO auto.
Close figures after save should be checked if a large number of figures are to be displayed. It prevents a buildup of figures, which can slow processing.
Figures can be saved as PNG or FIG files. PNG files (a losslessly-compressed image file format) are the default— they require the least storage. Matlab FIG files allow the data to be manipulated– Figures can be resized, zoomed, or rotated (3D figures-only), but FIG files should rarely be used because they can be huge. PNG files are preferred if no additional manipulation is required.
A CSV summary file is saved for all runs. An XML file is saved if Save XML results is checked.
You can select either Save CSV files for individual ROIs or Save summary CSV file only (the summary file is always saved).
Save folder determines where results are stored. It can be set either to subfolder Results of the image folder or to a folder of your choice. Subfolder Results is recommended because it is easy to find if the image folder is known.
Warnings
| A Clipping warning is issued if more than 0.5% of the pixels are clipped (saturated), i.e., if dark pixels reach level 0 or light pixels reach the maximum level (255 for bit depth = 8). This warning is emphasized if over 5% of the pixels are clipped. Clipping reduces the accuracy of SFR results. It makes measured sharpness better than reality. |
 |
|
|
The percentage of clipped pixels is not a reliable index of the severity of clipping or of MTF measurement error. For example, it is possible to just barely clip a large portion of the image with little loss of accuracy. The plot on the right illustrates strong clipping, indicated by the sharp corner near the “shoulder” on the black line. The MTF measurement is better than reality. The absence of a sharp corner indicates that there is little MTF error. Clipping can usually be avoided with a correct exposure— neither too dark nor light— and by avoiding high contrast targets (like the old ISO-12233 chart). The maximum recommended edge contrast is 10:1; 4:1 contrast (recommended in the upcoming revision to the ISO-12233 standard) is even better. Low-contrast targets are more reliable overall: in addition to better exposure latitude (reduced risk of clipping), they tend to have less sharpening in cameras with variable signal processing, and MTF results are less sensitive to errors in estimating gamma. |
Clipping warnings |
eSFR ISO summary
- eSFR ISO analyzes images of Imatest’s versions of the ISO 12233:2014 Edge SFR (E-SFR) test chart. There should be few or no interfering patterns (resembling registration marks) outside the image of the chart itself.
- Lighting should be even and glare-free. Lighting and alignment recommendations are given in The Imatest test lab.
- The first time eSFR ISO is run, it should be run through Rescharts (which can be accomplished by pressing ). This allows
- parameters to be adjusted and saved for later use in the automatic version of eSFR ISO, which is opened with the button in the Imatest main window.
- results (listed above) to be examined interactively in the Rescharts window.
- The button on the main Imatest window runs eSFR ISO in full automatic mode using settings saved from the most recent Rescharts run.
Next: Using eSFR ISO Part 3: Results
Pixel sizePixel size is closely related to image quality. For very small pixels, noise, dynamic range and low light performance suffer. Pixel size is rarely given in camera spec sheets: it usually takes some math to find it. If the sensor type and the number of horizontal and vertical pixels (H and V) are available, you can find pixel size from the table on the right and the following equations. pixel size in mm = (diagonal in mm) / sqrt( H2 + V2 ) Pixel size in microns (microns per pixel) can be entered directly into the SFR settings box. Example, the cute little 5 megapixel Panasonic Lumix DMC-TZ1 has a 1/2.5 inch sensor and a maximum resolution of 2560x1980 pixels. Guessing that the diagonal is 7 mm, pixel size is 2.1875 (rounded, 2.2) microns.You can find detailed sensor specifications in pages from Sony, Panasonic, and Kodak. |
|