SFR results: Multiple ROI (Region of Interest) plot

Imatest SFR allows you to select several regions of interest (ROIs) in an image. Display options from the SFR input dialog box are shown below.

When one of the Multi-ROI plots (1D or 2D; Cycles/pixel or LW/PH) has been selected, one of the two composite multiple ROI plots shown below is produced. The 1D summary plots, which display MTF, rise distance, and chromatic aberration as a function of the distance from the image center, may be difficult to read for lenses that are poorly centered and hence have asymmetrical response. In such cases the 2D summary plots are far more readable. Starting with Imatest 2.6 (January 2008) a number of new options facilitate editing and refining multiple ROI selections. They are described here. You can also create Excel plots that summarize results from several multi-ROI runs, as shown on the right using the procedure given here.

Summary plot

2D summary plot

When one of the 2D images (Cy/Pxl or LW/PH) are selected, the image below is displayed. It shows the regions of interest (ROI) and the following parameters for each ROI.

N (ROI number): Center-corner distance in %
MTF50 Cycles/Pixel or LW/PH (displayed boldface for emphasis)
MTF20 Cycles/Piexl or LW/PH
Chromatic Aberration (area in pixels)

The dotted circles delimit the central region (up to 30% of the center-to-corner distance), the part-way region, and the corner region (over 75% of the center-to-corner distance). The New Weighted MTF50 is the weighted mean of the mean MTFs in the three areas, where the weights are 1 (Central), 0.75 (part-way), and 0.25 (corner).

Multi-ROI 2D summary plot, showing Center-corner distance,
MTF50, MTF20, and CA superimposed on image.

This display, introduced with Imatest 2.5.8 (January 2008), can be particularly useful because lenses are not always centered properly. If they were, performance would be a simple function of the distance from image center. You can quickly review the summary results, then look at the detailed results for individual regions. It was developed because about 9 regions (center, 4 - part-way out, 4 - corner) is sufficient to characterize lens performance, but not sufficient for a meaningful 2D or 3D contour plot (which requires about 20 regions). Also, contour plots can only show one parameter (e.g., MTF50), while this display shows several.

1D Summary plot showing results as a function of distance from the center

This figure contains two plots: MTF50 (upper left) and 10-90% rise distance (lower left). If Cycles/pixel is selected, units are relative to pixels; if LW/PH is selected, units are relative to image height. These figures show performance (MTF50 and rise distances without and with standardized sharpening). The Cycles/pixel Figure also plots Chromatic Aberration as a function of distance from the center of the image, scaled as the percentage of distance from center to corner (0 = center; 1 = corner).

The most important results below are shown in Bold. Illustrations are for the first figure (Cycles per pixel in this case).

Upper left: MTF50 (Half-contrast frequency)
This plot shows MTF50 (the half-contrast spatial frequency) as a function of distance from the center of the image, scaled as the percentage from center to corner (0 = center; 100 = corner). There are two vertical (y) axes. The primary axis is on the left; the secondary axis (italicized) is on the right. These alternate for the two plots. In this plot, the primary axis is in Cycles/pixel for MTF50 and Pixels for 10-90% rise distance. It can also be in Cycles/mm or Cycles/inch if specified in the SFR data window.
Black line (bold)	MTF50 (half-contrast spatial frequency) for the luminance (Y) channel. Unprocessed. This is the number to use for measuring lens sharpness.
Red line (bold, dashed)	MTF50 for the luminance (Y) channel with Standardized sharpening. This is the number to use when making general comparisons of different cameras with different degrees of sharpening.
Symbols and numbers below data points, top to bottom	Orientation: Location of region relative to image center. A = Above, B = Below, L = Left, R = Right. MTF50, Uncorrected and with Standardized sharpening, in units corresponding to the primary vertical (y) axis scale on the left. The vertical order is determined by the order of the data points, i.e., if the Uncorrected MTF50 is higher, its value is on top. MTF50, Uncorrected and with Standardized sharpening, in units corresponding to the secondary vertical (y) axis scale on the right. These numbers are italicized. The vertical order is determined by the order of the data points, i.e., if the Uncorrected MTF50 is higher, its value is on top.

Right column:  Crop, Results summary, and EXIF data Top right image Thumbnail of the entire image, showing the locations of the selected regions of interest (ROI) in red. Middle right box: Weighted MTF50 Results summary Summary of key results of multiple ROI runs: Weighted mean values for MTF50, in cycles per ... and LW/PH units, without and with standardized sharpening. The MTF value at the middle of each (sorted) line segment is weighted according to the length of the line segment and the distance from the center: the center is weighted twice as strongly as the corner. These weights are used to calculate a weighted mean. This algorithm prevents closely spaced points from being given excessive weight. Lower right text Selected EXIF data: Data recorded by the digital camera. Only for JPEG files. May include ISO speed, aperture, and other details. Thanks to Matthias Wandel for jhead.exe.

Lower left: 10-90% Edge rise distance		The Legend at the lower right of the 10-90% Rise distance plot sometimes covers data points. It can be moved by clicking  and dragging it with a mouse.
Black line (bold)	The 10-90% rise distance, uncorrected (without Standardized sharpening).
Red line (bold, dashed)	The 10-90% rise distance, with Standardized sharpening.
.Blue line (bold, dashed) with yellow circles.	Chromatic aberration (Area-based) in pixels. An indicator of the severity of CA. The area between the channels with the highest and lowest levels. In units of pixels because the x-axis is in pixels and the y-axis is normalized to 1. Explained in detail in the page on Chromatic aberration. Meaning: Under 0.5; insignificant. 0.5-1: minor; 1-1.5: moderate; 1.5 and over: serious.

When the SQF (multi) checkbox in the SFR input dialog box has been checked, a multiple ROI SQF Figure is produced.

The upper plot shows SQF without standardized sharpening (unprocessed) for picture heights from 10 to 60 cm. The lower plot shows SQF with standardized sharpening (R = 2). Weighted SQFs are shown in the table on the right. The weighting formula is the same as the one used for MTF: readings near the center are given twice the weight of readings near the edge.

Header  shows version, input file, and run date

Imatest	2.6.1	Pro	SFR multi-ROI
File	85mm_f5.6_IMG_5970.JPG
Run date	1/9/2008 10:25

Geometry & file  shows the Regions of interest (ROIs) in pixels and the CSV summary files for each location.

Geometry & file: changed with Imatest 2.5.8. Origin at upper left.
N	Distance %	Direction	X1	Y1	X2	Y2	Region	CSV summary file
1	12.1	AL	1749	922	1894	1161	Center	D:\Camera_tests\Canon_EOS-40D\17- 85_IS\Results\85mm_f5.6_IMG_5970_YAL12_MTF.csv
2	38.7	BL	1244	1839	1380	2044	Pt Way	D:\Camera_tests\Canon_EOS-40D\17- 85_IS\Results\85mm_f5.6_IMG_5970_YBL39_MTF.csv
3	38.3	AL	1221	577	1355	798	Pt Way	D:\Camera_tests\Canon_EOS-40D\17- 85_IS\Results\85mm_f5.6_IMG_5970_YAL38_MTF.csv
4	36.1	AR	2432	551	2575	781	Pt Way	D:\Camera_tests\Canon_EOS-40D\17- 85_IS\Results\85mm_f5.6_IMG_5970_YAR36_MTF.csv
5	36.2	BR	2446	1817	2576	2032	Pt Way	D:\Camera_tests\Canon_EOS-40D\17- 85_IS\Results\85mm_f5.6_IMG_5970_YBR36_MTF.csv
6	90	AL	104	52	238	279	Corner	D:\Camera_tests\Canon_EOS-40D\17- 85_IS\Results\85mm_f5.6_IMG_5970_YAL90_MTF.csv
7	89.9	BL	133	2364	273	2579	Corner	D:\Camera_tests\Canon_EOS-40D\17- 85_IS\Results\85mm_f5.6_IMG_5970_YBL90_MTF.csv
8	87.3	BR	3571	2333	3696	2544	Corner	D:\Camera_tests\Canon_EOS-40D\17- 85_IS\Results\85mm_f5.6_IMG_5970_YBR87_MTF.csv
9	87.1	AR	3550	30	3686	251	Corner	D:\Camera_tests\Canon_EOS-40D\17- 85_IS\Results\85mm_f5.6_IMG_5970_YAR87_MTF.csv

nroi – roi_mult   These four lines are used to define the regions in imatest.ini. These regions can be reused for Imatest runs by copying and pasting the four lines into imatest.ini, replacing the previous lines. Imatest.ini can be opened for editing by clicking Settings (in the Imatest main window), View settings (ini file).

Primary results, shown by region

Primary results
N	MTF50 (Cy/Pxl)	R1090 (pxl)	CA (pxl)	MTF50 (LW/PH)	R1090 (/PH)	Peak MTF	MTF50P (Cy/Pxl)	MTF50P (LW/PH)
1	0.289	1.6499	0.3439	1498.2	1571	1	0.289	1498.2
2	0.2938	1.8284	0.3155	1522.9	1417.6	1	0.2938	1522.9
3	0.2566	2.1939	0.3113	1330.1	1181.5	1	0.2566	1330.1
4	0.2821	1.7768	1.0413	1462.5	1458.8	1	0.2821	1462.5
5	0.2993	1.6187	1.0377	1551.3	1601.3	1	0.2993	1551.3
6	0.1884	2.7046	1.0397	976.5	958.4	1.0201	0.1857	962.6
7	0.1871	2.5718	1.0671	969.9	1007.8	1.0239	0.1834	950.8
8	0.2191	2.3951	1.835	1135.8	1082.2	1.0132	0.2171	1125.7
9	0.3017	1.8871	1.6025	1563.8	1373.5	1.0104	0.3004	1557

</

Summary results  The table contains summary results.  These results are repeated in a single-column at the end of the CSV file, shown below. Though it is less readable, it is much better suited for copying and pasting summary results into an Excel file that can be used to produce plots.

Summary	1/9/2008 10:25		85mm_f5.6_IMG_5970.JPG
9	Regions	1	Center	4	Part way	4	Corner
	MTF50 (Cy/Pxl)	R1090 (pxl)	CA (pxl)	MTF50 (LW/PH)	R1090 (/PH)	Peak MTF	MTF50P (Cy/Pxl)	MTF50P (LW/PH)	MTF20 (Cy/Pxl)	MTF20 (LW/PH)
Mean Ctr	0.289	1.6499	0.3439	1498.2	1571	1	0.289	1498.2	0.3598	1865.4
Mean Pt Wy	0.2829	1.8544	0.6765	1466.7	1414.8	1	0.2829	1466.7	0.3626	1879.6
Min Pt Wy	0.2566	1.6187	0.3113	1330.1	1181.5	1	0.2566	1330.1	0.343	1778.2
Mean Cor	0.2241	2.3897	1.3861	1161.5	1105.5	1.0169	0.2216	1149	0.323	1674.2
Min Cor	0.1871	1.8871	1.0397	969.9	958.4	1.0104	0.1834	950.8	0.2778	1440
Wtd mean	0.2786	1.8191	1.1495	1444.3	1454.2	1.0021	0.2783	1442.7	0.3563	1846.8

Explanation of summary results  Each of the results are presented six times— for different regions of the image and for a weighted sum of the regions, as described below.

The column in this table (rows in the single-column table below) contain the following results:

Secondary results  These include results with standardized sharpening (suffix C).

Secondary results: C denotes standardized sharpening
N	MTF50C (Cy/Pxl)	R1090C (pxl)	MTF50C (LW/PH)	R1090C (/PH)	MTF20 (Cy/Pxl)	MTF20 (LW/PH)
1	0.294	1.5689	1524.2	1652.1	0.3598	1865.4
2	0.3013	1.5304	1561.9	1693.7	0.374	1939.1
3	0.2841	1.594	1472.7	1626.1	0.343	1778.2
4	0.2977	1.5477	1543.1	1674.8	0.3604	1868.2
5	0.304	1.5129	1575.9	1713.3	0.3729	1933.1
6	0.2245	2.0172	1163.7	1285	0.2778	1440
7	0.2271	1.9317	1177.3	1341.8	0.3191	1654.4
8	0.281	1.625	1456.5	1595.1	0.316	1638
9	0.3188	1.441	1652.5	1798.7	0.379	1964.5

Miscellaneous values

Image WxH & Mpxls	3888	2592	10.1
Channel	Y
Gamma	0.5
Sharpening radius	2
Pixels per inch
Pixels per mm
um per pixel
MTF50 wtd Cy/Pxl (uncorr)	0.278
MTF50 wtd LW/PH (uncorr)	1440
MTF50 wtd Cy/Pxl (corr)	0.294
MTF50 wtd LW/PH (corr)	1525

SQF summary. SQF is the Subjective Quality Factor, described here.

SQF (Subjective Quality Factor): mean values
Print height	Viewing dist (cm)	SQF	SQF_corr
1	15	99.58	99.76
2	15	98.98	99.66
3	16.43	98.45	99.62
4	18.97	98.1	99.55
5	21.21	97.75	99.45
6	23.24	97.39	99.32

Exif data

Exif data

File:  2008:01:02 10:34:42

Make:  Canon

Model:  Canon EOS 40D

Taken: 2008:01:02 10:34:42

Res:   3888 x 2592

FL:     85.0mm

CCD:   22.25mm

Exp:    0.200 s  (1/5)

Aper:   f/5.6

ISO:    100

ExBias:  0.67

WtBal:  Auto

Creating Excel plots

The single column summary is the last table in the multi-ROI CSV file. It contains the same data as the summary results (above), but it is formatted so it can be easily copied and pasted into another Excel file for creating plots that summarize several runs. For mult-ROI batch runs, this data is combined into a CSV output file with a name of the form, filename_Y_sfrbatch.csv.

Summary plot for 6 multi-ROI runs (f/5.6-f/32) for the Canon 17-85mm IS lens on the EOS-40D (JPEG)
The Excel file was created by combining single-column summary results from the 6 runs.