Implementing Pass/Fail in Imatest

Pass/Fail settings file

Pass/Fail settings— minimum, maximum, or limit (min, max, or limits) values for individual measurements— are stored in an ini file that is separate from the main ini settings file so it can be protected from tampering, if needed. It can be in a protected folder that requires administrator access to write.

We strongly recommend that the Pass/Fail settings file contains comment lines (starting with 😉 that contain the secondary readout settings and frequency units (if applicable). It can be useful if they contain a description of the device to be tested.

It has standard ini file format with sections corresponding to Imatest modules, listed in the Pass/Fail file summary. Most entries have one of three suffixes:

There are a few settings with different formats— kept for backwards compatibility.

Here is an example. Parameters are listed in the Pass/Fail Reference, below.

[sfrplus]
MTF50P_ratio_min = .5
MTF50P_CP_weighted_mean_min = .13
Rotation_degrees_max = 1
FOV_degrees_diagonal_min = 62
Convergence_angle_max = 5
Secondary_readout_1_center_mean_min = .2
Secondary_readout_1_outer_mean_min = .2
Secondary_readout_2_center_mean_min = .2
Secondary_readout_2_outer_mean_min = .2

[blemish]
Dead_pixels_max = 10
Hot_pixels_max = 10
Optical_center_offset_max = 50
Relative_illumination_worst_corner_pct_min = 40
Uniformity_RoverG_corners_pct_max = 10
Uniformity_BoverG_corners_pct_max = 10
Blemish_size_pixels = 20 50
Blemish_maximum_count = 2 1

For example, MTF50P_ratio_min = .5 sets the minimum acceptable value for (minimum MTF50P)/(maximum MTF50P) (taken over all the selected regions) to 0.5.

The customer must update this file to meet his needs. Additional measurements will be added on request.

Overriding values set in the main ini file

There are occasions where we may want to override settings in the main ini file (C:\Imatest\projects\sfrplus\SFRplus_5_rw3.ini in the above example) at runtime, for example, when several different images are to be analyzed in sequence. This can be done with statements in the calling sequence. The three variables shown below in burgundy are currently supported. (The fields, i.e., crop_borders, lens_to_chart_diatance_cm. etc.) must be entered exactly as shown (they’re hard-coded into the program). More can be added on request.

…
jstr.serial_number = ’46-062′;
jstr.part_number = ‘X-1 Rocket Plane’;
jstr.crop_borders = [5 5 5 5]; % Crop borders ( [L R T B] )
jstr.lens_to_chart_distance_cm = 33.3;
jstr.chart_height_cm = 39.99;
jsonObj = savejson(”,jstr,[]); % Convert structure into JSON object.

Output

The available output is being expanded. It will eventually include both JSON and XML objects.

JSON output

Pass/Fail results are added at the end of the JSON object. For Blemish,

{
“blemishResults”: {
“dateRun”: “10-Apr-2012 17:59:58”,
…
“N_blemish_count”: [1],
“blemishSizePxls”: [1651],
“blemishCenter_X”: [781.5],
“blemishCenter_Y”: [644.2],
“passfail”: {
“started_at”: “2012-04-10 17:59:58”,
“part_number”: “X-1 Rocket Plane”,
“serial_number”: “46-062”,
“ended_at”: “2012-04-10 18:00:00”,
“runtime”: [1.848969517],
“Dead_pixels_max”: [10],
“Dead_pixels”: [0],
“Dead_pixels_pf”: [1],
“Dead_pixels_status”: “Passed”,
“Hot_pixels_max”: [10],
“Hot_pixels”: [0],
“Hot_pixels_pf”: [1],
“Hot_pixels_status”: “Passed”,
“Optical_center_offset_max”: [50],
“Optical_center_offset”: [-30,14],
“Optical_center_offset_pf”: [1],
“Optical_center_offset_status”: “Passed”
}
}
}

Interpretation: For Dead pixels, a maximum of 10 is allowed (specified by …_max). 0 have been detected. “…_pf”: [1] means the image passed the criteria. “…_status”: “Passed” also means that the image passed. These three lines are parsed for readability in the Pass/Fail monitor, which list failed results first. Example:

Key Blemish Detect results displayed in the Pass/Fail Monitor

For SFRplus,

{
“sfrplusResults”: {
“dateRun”: “10-Apr-2012 20:22:27”,
…
“k1_3rd_order_dist_coeff”: [0.0117],
“h1_5th_order_dist_coeff”: [-0.036],
“h2_5th_order_dist_coeff”: [0.0443],
“passfail”: {
“started_at”: “2012-04-15 16:05:10”,
“part_number”: “X-1 Rocket Plane”,
“serial_number”: “46-062”,
“ended_at”: “2012-04-15 16:05:15”,
“runtime”: [4.52085684],
“all_tests_passed”: [0],
“MTF50P_ratio_min”: [0.5],
“MTF50P_ratio”: [0.7628270592],
“MTF50P_ratio_passed”: [1],
“MTF50P_CP_weighted_mean_min”: [0.13],
“MTF50P_CP_weighted_mean”: [0.132948091],
“MTF50P_CP_weighted_mean_passed”: [1],
“Rotation_degrees_max”: [1],
“Horizontal_bars_OK_min”: [1],
“Horizontal_bars_OK”: [1],
“Horizontal_bars_OK_passed”: [1],
“All_Edge_IDs_detected”: [1],
“All_Edge_IDs_detected_OK”: [1],
“All_Edge_IDs_detected_passed”: [1],
“Mirrored_chart”: [1],
“Mirrored_chart_OK”: [1],
“Mirrored_chart_passed”: [1],
“Bayer_decode”: [1],
“Bayer_decode_OK”: [1],
“Bayer_decode_passed”: [1],
“Color_expected_detected”: [1],
“Color_expected_OK”: [0],
“Color_expected_passed”: [0],
“Stepchart_expected_detected”: [1],
“Stepchart_expected_OK”: [1],
“Stepchart_expected_passed”: [1],
“Rotation_degrees”: [-0.6021933244],
“Rotation_degrees_passed”: [1],
“FOV_degrees_diagonal_min”: [62],
“FOV_degrees_diagonal”: [103.8954245],
“FOV_passed”: [1],
“Convergence_angle_max”: [5],
“Convergence_angle_degrees_horz”: [-1.816256865],
“Convergence_angle_degrees_vert”: [-4.310448164],
“Convergence_angle_passed”: [1],
“Secondary_readout_1_center_mean_min”: [0.2],
“Secondary_readout_1_center_name”: “MTF @ .25 LP/mm”,
“Secondary_readout_1_center_mean”: [0.1525933797],
“Secondary_readout_1_center_mean_passed”: [0],
“Secondary_readout_1_outer_mean_min”: [0.2],
“Secondary_readout_1_outer_name”: “MTF @ .25 LP/mm”,
“Secondary_readout_1_outer_mean”: [0.1827151453],
“Secondary_readout_1_outer_mean_passed”: [0],
“Secondary_readout_2_center_mean_min”: [0.2],
“Secondary_readout_2_center_name”: “MTF @ .125 LP/mm”,
“Secondary_readout_2_center_mean”: [0.5577878056],
“Secondary_readout_2_center_mean_passed”: [1],
“Secondary_readout_2_outer_mean_min”: [0.2],
“Secondary_readout_2_outer_name”: “MTF @ .125 LP/mm”,
“Secondary_readout_2_outer_mean”: [0.5271610521],
“Secondary_readout_2_outer_mean_passed”: [1]
}
}
}