Imatest Instructions – Getting started

Running Imatest

Imatest is opened by

• double-clicking the Imatest icon on the Desktop,
• from Windows Start menu: Start → All Programs → Imatest  → Version →   Imatest Edition , illustrated on the right.
• or from the Imatest directory, typically C:Program Files (x86)Imatestversion (where version is Master, IS, Studio, etc.) in win64 English language installations.

After several seconds (up to a minute after the first installation or a reboot), the Imatest main window, shown below, opens. Imatest analysis modules are run by clicking on one of the buttons on the left. Utility module buttons are on the right. Instructions for the individual modules are on their own pages, listed below. Clicking Help mode (at the bottom of the window) changes the function of most buttons so they open online help. Click here for the documentation Table of contents.

Imatest main window, v. 5.0

Prior to Imatest 5.0 the Utilities (shown above) were displayed on the right side of the window. In 5.0 you can select the Utility, Data, or Help tab to display different sets of buttons. Some of the functions in the Data tab are new to 5.0. The contents of the two additional tabs are shown on the right.

SFR: New File
SFR current file	Map of the Imatest main window (for Imatest 3.9) with links to instructions.
SFRplus setup				Help guide
SFRplus auto
Rescharts
MTF Compare				View/Rename Files
Batchview				Find Sharp Files
Colorcheck				Test Charts
Multicharts	Uniformity			Screen Patterns
Stepchart	Uniformity Interactive			dcraw	Rawview
Dynamic Range	Blemish Detect				EXIF
Distortion	Dot pattern			Manage settings
Exit	Close Figures		Error reporting	Options I	Options II

 

A really early version of Imatest Imatest has several settings to adjust font and window size for the DPI scaling of different computers. To access these, click Display (on the top bar of the main window), which opens the dropdown shown (in part) on the left. Settings: Font size: set it so it appears correct in figures, i.e., not too small or large. Normal or enlarged screen (Imatest main window). Normal or enlarged figures (1.25 or 1.5x). You may need to enlarge the font for enlarged figures. Normal or enlarged interactive windows (Multicharts, Rescharts, Batchview, etc.)

The following steps are typical for most Imatest modules.

• Open the image file. A dialog box requests the name of the input image file. Supported image file formats are listed below.

Supported image file formats

See Image file formats and acquisition devices for full details. Summary: Any file type supported by the Matlab imread statement. Includes BMP — Windows Bitmap JPEG (JPG) PNG — Portable Network Graphics CUR — Cursor File JPEG 2000 (JP2, JPX) PPM — Portable Pixmap GIF — Graphics Interchange Format PBM — Portable Bitmap RAS — Sun Raster HDF4 — Hierarchical Data Format PCX — Windows Paintbrush TIFF (TIF) 8-48 bits Multi-image TIFFs are supported. ICO — Icon File PGM — Portable Graymap XWD — X Window Dump Commercial raw formats converted using dcraw. These include CR2, NEF, RW2, and many more. The dcraw link lists supported cameras rather than the extensions. New cameras are typically added to dcraw within a month or two of their introduction. The build of dcraw included with Imatest releases may be out-of-date. Check the dcraw page for recent builds. Binary files identified by extensions specified in the Generalized Read Raw window. You can set the pixel size,bit depth, demosaicing parameters, offset, etc., for the extension. TGA (Targa) Video formats, including DPX, Video DNG*, and ARI* (*converted using dcraw) CSV (a special format used in some infrared systems) HDR  High dynamic range files A large variety of image acquisition devices— too many to list here.

 

Multiple file read (batch mode)  You can select several files to read. Depending on how you respond to the multi-image dialog box (below), Files can be analyzed individually in sequence (batch mode), Files can be combined— averaged— and the mean can be analyzed (and also be saved if needed). This can reduce noise (by a factor of √N for N files), making MTF calculations more accurate. Signal averaging is also useful for measuring sensor fixed pattern noise in Stepchart, Colorcheck, Multicharts, Multitest, and Uniformity, For two input files, you can calculate temporal noise with Stepchart, Colorcheck, Multicharts, or Multitest, For 4-16 input files (8 recommended), you can calculate temporal noise with Multicharts or Multitest. The files should be in the same folder, have the same pixel dimensions (for most modules), and be framed identically (except for SFRplus and other modules that use automatic detection, where they can be any size). If you choose Combine files, you’ll have the option of saving the combined file with 16-bit TIFF format as default. Batch mode is not supported in interactive modules such as Rescharts or Multicharts. For combined files, the saved file name is the same as the first selected file name with _comb_n appended, where n is the number of combined files.

• Enter additional input data. Unless Express mode has been selected, a Settings window opens that settings data, depending on the module. Most additional data is optional (and is saved from previous runs); you only need to pay attention to settings you wish to change. Click OK to run the program or Cancel to terminate the run.
• Save results? A dialog box asks if you would like to save the results. Checkboxes in the dialog box enable you to select the Figures, CSV (Excel-readable), and JSON files to be saved. You may examine the results before deciding which, if any, to save. (The Save box is omitted in the evaluation version.) Figures can be saved as PNG (losslessly-compressed) image files or Matlab Fig files (not recommended because of their large size), which can be opened and manipulated with Open Fig file.

Three helpful buttons

Each of these buttons opens a large Help window with lots of explanations and buttons that open a variety of functions. You should familiarize yourself with them and use them whenever the need arises.

Help guide opens a window with links to some of the most useful instruction web pages as well as brief explanations of what they contain, including Registration quickstart | Imatest instructions | Image quality factors | Imatest tour | Table of Contents (site map) | FAQ | Change Log | Testing lenses | MTF Curves & Appearance | SFRplus | Troubleshooting.

Manage settings opens a window that explains some of the key functions for setting and examining the contents of imatest.ini, where settings are stored. It also displays the full path name to imatest.ini and shows how to fix bugs that can arise when imatest.ini is corrupted. Function buttons include Save settings…, Load settings…, View/Edit settings (ini file), Copy settings (ini file), Import / Merge settings, Edit / Reset Modules, and Reset Defaults (all).

Error reporting opens a window that shows what to do if you encounter an error. It includes link to the Change Log and Troubleshooting pages, buttons for Copying the current or last session to the clipboard for pasting into emails, and instructions on fixing imatest.ini when it gets corrupted.

RAW files

RAW files are the unprocessed output of digital image sensors. For Bayer sensors, each RAW pixel represents a single color in RGRGRG, GBGBGB, … sequence. To be converted into usable, standard file formats (TIFF, JPEG, etc.), raw files must be processed by a RAW converter. RAW converters perform several functions: demosaicing (converting the Bayer sequence into full color), applying a gamma curve, often with an additional tonal response curve, color correction and white balance, reducing noise, and sharpening the image. These operations can affect Imatest‘s measurements, especially SFR.

The best way to be sure an image file faithfully resembles the RAW file— that it has a pure gamma curve, no sharpening, and no noise reduction— is to read a RAW file into Imatest and convert it into a standard format (typically TIFF) using Dave Coffin’s dcraw. If you select any of the standard commercial RAW formats (CRW, NEF, etc.) or if a file that contains RAW data (e.g., Phase One TIF) is detected the dialog box on the right appears. It allows you to choose among several RAW conversion options. More detail can be found in RAW files.

Imatest can also read RAW files from manufacturer’s development systems using Generalized Read Raw, which enables you to specify file extensions and parameters for decoding them.

Miscellaneous controls and utilities

Exit closes all figures and terminates Imatest.

Close figures closes all figures. Important because the computer will slow down if too many are open. You can close figures individually by the usual Windows methods — clicking the X in the upper right or right-clicking on the figure icon on the Taskbar and selecting Close.

EXIF displays EXIF data for an image file. Most file formats supported when ExifTool is installed (instructions below). Exif data can be saved in a text file in the same folder as the image for viewing/searching with the Save Exif data button.

Exif viewer

Open Fig file opens a Matlab Fig file saved during an Imatest module run. Unlike image files, Fig files can be manipulated— most importantly, 3D Fig files can be rotated for enhanced visualization. But Fig files are not generally recommended: they should be used sparingly because they can be as large as several megabytes.

Saved settings: Imatest saves a number of settings, including Font size, folders for opening and saving images, calculation parameters, plot selection, and figures to display and save. To view or edit the settings, click the Settings menu (in the toolbar on the top of the Imatest window), then click View settings (ini file) or Edit/Reset modules. To restore these settings to their original defaults, click (in the toolbar on the top of the Imatest window), then click Reset defaults (all) in the Settings menu. The settings are stored in imatest.ini. Lots of details about saved settings— including how to fix errors that may result from corrupted ini files— can be found by clicking Manage settings on the lower-right of the Imatest main window.

---

ROI Options and Options II… (bottom-right of the Imatest main window); also in the Settings dropdown menu) opens the boxes shown below, which allow several options to be specified.

ROI Options

Options I for setting ROI options and selection method (manual/auto)

Use new ROI selection method Opens a different window for selecting regions. It allows more flexibility in selecting multiple regions (SFR and Wedge).

ROI (Region of Interest) section controls cropping options.

• SFR ROI filtering When Light filtering is checked the tests that validate the SFR ROI (region of interest) are relaxed. This can be useful when testing noisy images, rough edges, images of endoscopes or other devices with interfering patterns, but it can lead to errors if regions are selected carelessly. Normal filtering is the default.
• Stepchart ROI selection Automatic patch detection (following manual region selection) can be toggled. If it is turned off, a fixed number of patches (6-41) can be selected for Stepchart analysis. This option is useful when high noise in dark regions confuses the automatic ROI detection.
• Colorcheck, Distortion, Light Falloff Cropping options. You can select whether to ask for cropping and whether to use the last crop (for same-sized images). For Colorcheck you can also choose between traditional automatic patch detection and Multicharts-like patch detection, where all squares are shown in the fine adjustment window.

Reset restores defaults: it sets SFR ROI filtering to Normal, Stepchart ROI selection to Automatic, turns off all global folder settings, and checks Get EXIF data .

Options II

Options II for setting folder options, SFR save file suffix, etc.

Global folders The default folders for opening files and saving results can be set globally using the second group of controls. Normally (with Global folder for opening files unchecked), the default folder for opening files is changed only for the Imatest module in use: one module at a time. When it is checked, the default folder for opening files is changed for all modules. This can be convenient if project data for several modules is stored in the same file.

When either of the Global folder for saving results… radio buttons is set, the default save folder is changed for all modules whenever the input folders are changed.

EXIF data acquisition This selects the program used to read EXIF data: image file metadata that contains camera and lens settings. Selected EXIF data (important values such as aperture, exposure time, ISO speed, and focal length) is displayed in several figures and EXIF data is saved in CSV and JSON output files. There are four settings:

1	Do not get EXIF data (for rare cases of errors)	EXIF off
2	Get EXIF data from Phil harvey’s ExifTool (all file types; must download & install)	Recommended
3	Get EXIF data from ExifTool & save ALL EXIF data in csv output (LOTS)!	Detailed!
4	Get EXIF data from Matlab’s built-in function (limited)	Limited results

Recommended settings 2 and 3 (ExifTool) work with virtually any file type and capture virtually all available EXIF data. If the setting 3 (save ALL EXIF) is selected, all the EXIF data— a large amount; some quite obscure— is written to the CSV output files. Setting 4 (Matlab’s built-in function) returns limited results. Setting 1 is for rare cases that cause EXIF read to crash.

The second and third settings require ExifTool, which is included in Imatest installations, but is frequently updated. If you need a newer version,

• Go to the ExifTool home page and download the Windows standalone executable (a zip file).
• In Windows Explorer, double-click on the downloaded zip file.
• Copy the contents ( exiftool(-k).exe ) to the appropriate installation folder. To find the location in Imatest 5.0+, click Open utilities folder to the right of EXIF data acquisition. In older versions you will need to search for exiftool in C:Program FilesImatest or C:ProgramDataImatest (including subfolders). [In my (English-language) computer the location for Imatest Master 4.2 is C:Program FilesImatestv4.2Masterimatestis_mcrdependsRTDepends. The location for Imatest  Master 5.0 is C:ProgramDataImatestmcr_cache5.0MastermcrCache9.2imates0dependsRTDepends.]
• Rename exiftool(-k).exe to exiftool.exe.

EXIF color space settings can be confusing because two tags affect color space, and their relationship is not logical. Color space (where you would logically expect to find the color space) can contain either sRGB (the Windows/Internet standard) or Uncalibrated (1 or 65535). If Color space is Uncalibrated, the color space is located in the Profile Description tag, which can be interpreted as Adobe RGB, Display P3, etc. (Did I say not quite logical?) See www.exiv2.org/tags.html

Suffix for saved SFR plots and CSV and JSON files Normally the root name (input or selected file name ) is followed by the channel, ROI orientation (AL = above left (relative to the center), etc.) and distance from the center in percentage of distance to the corner. Example: rootname_YAL79_MTF.png for the Edge/MTF plot. An alternative can be selected where _ROI_ followed by the ROI number nn is used in place of the orientation and distance. Example: rootname_ROI_03_MTF.png

LARGE FILES (Light Falloff, Distortion) These two modules typically use little or no cropping. As a result, memory may sometimes overflow. This setting offers the option of cutting the image dimensions in half (1/4x in area and memory) to avoid memory problems.

Special user code enables custom features for specific users. Normally blank.

Batch run order The actual order of batch runs may differ from the order of selection in curious ways that depend on the operating system or other factors. With one of the choices in this popup menu the run and selection orders should be the same.

Luminance Calculation –

Reset restores defaults: it sets SFR ROI filtering to Normal, Stepchart ROI selection to Automatic, turns off all global folder settings, and checks Get EXIF data .

---

Help opens a relevant web page on computers connected to the Internet.

Dropdown menus

Dropdown menus are located at the top of the Imatest main window. Most items duplicate the controls elsewhere in the window, but some are unique.

File contains System command, View or Copy the Current or Previous Session for reporting errors, Clear Memory, Close Figures, and Exit. System command lets you execute a DOS call on Windows computers through Imatest. The session commands are useful for debugging, as described in Troubleshooting and in the Error handling window. Clear Memory removes the image data stored after running SFR. This may release enough memory to speed up memory-intensive modules, such as Uniformity.

Modules opens Imatest analysis modules. The entries duplicate the buttons on the left of the Imatest main window.

Utility opens Imatest utility modules. The entries duplicate many of the buttons on the right of the Imatest main window.

Settings contains functions that control various aspects of Imatest operation. Many can be accessed from the Manage settings window.

• IT options sets several options for controlling IT (Industrial Testing) runs.
• Small / Normal / Large fonts alters the font size in output figures and GUI windows. The default is Normal. The setting is saved between runs. This address problems with tiny fonts in high resolution screens (1600x1200 pixels and above) or larger than expected fonts which appear when the video card DPI setting is Large size (120 DPI) instead of Normal. The video card setting can be accessed by right-clicking on the Windows background, then clicking Properties, Settings, Advanced, General (tab). Large fonts are displayed if DPI is set to Large size (120 DPI). 96 DPI is normal. Windows may need to be rebooted before new settings take effect.
• Options I and II contain settings that affect SFR ROI (region of interest) error checking, Stepchart ROI selection, and folder names for storing results, and more.
• DOS command allows you to enter a DOS command while Imatest is running. Useful for troubleshooting, for example, for diagnosing path issues.
• When checked, Fixed sharpening radius keeps the SFR standardized sharpening radius fixed, even for edges with poor MTF where it would otherwise automatically increase.
• Enlarge hi res figs applies only to high resolution screens (1600x1200 pixels and above). When this box is checked (by default), images are enlarged so they don’t look tiny on the screen. Unchecking the box turns this feature off. Images are smaller but better suited for website presentation. The setting is saved.

INI File Settings contains operations that affect stored Imatest settings (the contents of imatest.ini and other INI files). Many can be accessed from the Manage settings window.

• Manage Settings opens the Manage settings window.
  
• Save Settings copies settings from imatest.ini (which stored the current, active settings) to a named file (with extension ini). Particularly useful for saving regions of interest (ROIs) for SFR runs and for controlling Imatest IT modules. The most recent folder used to save or retrieve settings is displayed in the file selection dialog box, but any folder may be selected.
• Load Settings retrieves settings from a named file (with extension ini) and stores them in imatest.ini. It is useful for restoring ROIs or for restoring settings after they have been reset. The most recent folder used to save or retrieve settings is displayed in the file selection dialog box, but any folder may be selected.
• View/Edit Settings displays the settings— the contents of imatest.ini— in the Notepad viewer. You can edit this file (with care!) and save it as a named file if desired. You can send us the contents of imatest.ini for help with troubleshooting. The Notepad window should be closed when you are finished viewing it: it may interfere with some Imatest operations.
• INI File Editor (formerly Edit/reset module(s)) opens a special editor that allows ini file values to be examined and entire sections to be deleted if the corresponding module crashes. Described in Troubleshooting.
• Scan & repair INI file Scans the INI file for errors that may be introduced when there are non-Latin characters (Chinese, Hebrew, etc.) in path names.
• Reset Defaults (All) restores settings to their default values by resetting imatest.ini. This sometimes clears bugs. See Troubleshooting. Use only as a last resort. It is a good idea to save settings prior to resetting them.

Help contains Online Help, Register, Register Upgrade, and About, and Welcome window. Most are included with brief explanations in the Help guide window.

• Online Help corresponds to the Help button; it opens a browser window.
• Register and Register Upgrade are used to register Imatest.
• About displays the Imatest version and user registration information.
• Check for updates opens a web page that shows the latest version.
• Welcome window displays the window that normally appears when Imatest is started in evaluation model.
• Several additional web pages, including this one, are included.

Figures

Imatest results are displayed in individual windows called Figures. A typical figure— a result of running SFR for a Canon EOS-40D— is shown on the right.

Figures may be resized, minimized, maximized, or closed using standard Windows operations. In addition, several Windows and Matlab-specific operations can be found in the toolbar at the top of the image.

The first four icons in the toolbar are standard Windows icons: New file, Open, Save, and Print. Open and Save refer to Matlab .fig figures. Imatest allows you to save figures as PNG files— an excellent format with lossless compression— or as Matlab fig files, which can be manipulated, but which require much more storage (not recommended).

Of the remaining icons, Zoom in: is particularly useful. Clicking on it highlights it and enables you to zoom in on regions of the plots. You can click and drag to create a zoom rectangle or you can click on any point to zoom in on that point. Double-clicking anywhere inside the image restores the full unzoomed image.

Data cursor example

Imatest 3.6+ includes an extremely useful function called Data Cursor, selected on by the toolbar icon. When selected, you can click on a curve and display its coordinates in a small box called a Datatip. Right-clicking on the Datatip lets you can delete it or choose additional options.

In most modules, figures can be saved as either PNG files (a standard losslessly-compressed image file format) or as Matlab FIG files, which can be opened by the Open Fig file button in the Imatest main window. Fig files can be manipulated (zoomed and rotated), but they tend to require more storage than PNG files, especially for 3D files, which can be generated by SFRplus and Light Falloff. In general, PNG files are preferred unless significant manipulation will be required at a later time— for example if you wish to rotate 3D files (which can be several megabytes).

Too many open Figures

Figures can proliferate if you do a number of runs, especially SFR runs with multiple regions,and system performance suffers if too many Figures are open. You will need to manage them. Figures can be closed individually by clicking X on the upper right of the Figure or by any of the usual Windows techniques. You can close them all by clicking Close figures in the Imatest main window.

To see Figure resource use, open the Windows Task Manager. In Windows XP, click Control-Alt-Del or right-click in the Taskbar, usually at the bottom of the screen. Click on the Processes tab, then click CPU twice so the tasks with the most CPU usage appear at the top. Imatest can be a real CPU hog when several Figures are open; CPU use appears to increase with the square of the open Figures. With Imatest 3.5.1 or earlier on my dual 1 GHz Pentium Windows XP machine, 8 open Figures use 6% of the CPU; 16 open Figures use 33%. Over 20 would seriously slow the computations.

CSV and JSON output files

Individual Imatest modules can optionally write two types of output file that contain most results.

• CSV files are most often displayed with Microsoft Excel.
• JSON files, which contain a single large JSON structure, can be read into programs written in almost any language with a single line of code using functions linked from the JSON website. They can be displayed in any text editor.

Please contact us if you have requests or suggestions about Imatest output. [Notes: These files are not saved in evaluation mode. XML files are available with some modules, but are being deprecated.]

CSV files– Excel-readable Comma-Separated Variable format. Here is an example of typical output.

Module,Colorcheck
File,Canon_EOS10d_ColorCheck_lt_small.jpg
Run date,31-Dec-2005 18:11:00
Zone,Gray,Pixel,Pixel/255,Px/255 ideal,Log(exp),Log(px/255),WB Err Deg,WB Err Mired
19, 1, 241.6, 0.9475, 0.9569, -0.050, -0.023, 163, -3.8
20, 2, 215.8, 0.8464, 0.7922, -0.230, -0.072, 491, -10.8
21, 3, 179.0, 0.7020, 0.6353, -0.440, -0.154, 450, -10.0

The same data displayed in Excel looks like this.

JSON files are somewhat human-readable text files that contain a single structure— optimized for reading into programs written in virtually any programming language.

{
      "jstruct": {
            "dateRun": "03-May-2018 12:14:03",
            "ini_time_size": "03-May-2018 12:02:35 104121B  MD5 = 6a03a447754eefcc2ada6698ec63d30e",
            "version": "Imatest 5.1.0. ALPHA  Colorcheck",
            "build": "NOT COMPILED",
            "full_path_name": "C:\imatest\Data\Colorcheck\Canon_eos10d_ColorCheck_lt.jpg",
            "file_name": "Canon_eos10d_ColorCheck_lt.jpg",
            "mean_cameraSat_Pct": [0.9888],
            "pxlLevel_graypatch": [241.67,215.9,179.27,135.26,84.58,34.63],
            "pxlLevel_norml_graypatch": [0.9477,0.8467,0.703,0.5304,0.3317,0.1358],
            "densityNominal": [0.949,0.7882,0.6314,0.4784,0.3255,0.1922],
            "logExposure": [-0.05,-0.23,-0.44,-0.7,-1.05,-1.5],
            "logNormlPxlLevel": [-0.023,-0.072,-0.153,-0.275,-0.479,-0.867],
            "whiteBalErrDegs": [157.3,478,487.1,833.4,954.2,568.3],
...
            "Mean_Delta_E_00": [5.31],
            "Max_Delta_E_00": [11.42],
            "Sigma_Delta_E_00": [5.76],
            "Mean_Delta_C_00": [3.05],
            "Mean_White_Balance_delta_C_00": [2.87],
            "Max_Delta_C_00": [7.52],
            "Sigma_Delta_C_00": [3.45],
            "Mean_Delta_C_00_Sat_corrected": [3.08],
            "Max_Delta_C_00_Sat_corrected": [7.5],
            "Sigma_Delta_C_00_Sat_corrected": [3.44],
            "passfail": {
                  "ini_time_size": "04-Jul-2017 09:31:58 1734B  MD5 = 1a759325ea50ce2c4bc826dae419feac",
                  "passFailFile": "C:\imatest\Data\ini_files\passfailtest_1.txt",
                  "started_at": "2018-05-03 12:14:03",
                  "ended_at": "2018-05-03 12:14:20",
                  "runtime": [9.135914449],
                  "INI_read_success": "[colorcheck] NOT FOUND",
                  "all_tests_passed": [1]
            }
      }
}