Televac® Vacuum Calibration Tolerances

Employee calibrating Televac®️ vacuum measurement equipment.
Download Datasheet
Televac vacuum calibration test points with tolerances
Download Tolerances PDF Request Vacuum Calibration Service Share Contact Us

1. Description

General

This document gives a description of the calibration options available from Televac® as well as the vacuum calibration test points and tolerances for various vacuum sensors, vacuum controllers, and active vacuum gauges offered by Televac®. All values are in Torr and calibrations are done in nitrogen gas unless otherwise stated. Televac® reserves the right to change vacuum test points and tolerances for any product. Any modification to any unit without approval from Televac® voids the unit’s calibration certificate or certificate of compliance. Additional custom test points are available upon request.

ISO/IEC 17025 Accredited Calibration

The Fredericks Company is ISO/IEC 17025 accredited for vacuum and pressure calibration in the range of 1E-6 Torr to 1000 Torr. Units are vacuum calibrated (on a vacuum stand) in nitrogen gas at various points (gauge dependent) against reference standards traceable to NIST, using ISO/IEC 17025 accredited systems. Units of measurement of Torr are used for all calibrations. This includes incoming (as found) data, outgoing (as left) data after calibration adjustments, the reference standard uncertainty at each point, and a statement of conformity.

Additional Notes on ISO/IEC 17025 Accredited Calibration

The Fredericks Company’s ISO/IEC 17025 accredited vacuum calibration certificates, unless explicitly requested otherwise, will by default include a statement of conformity using a simple decision rule, will by default use the order acknowledgement “ship to” address as the customer name and address, and will by default specify a 1 year recommended calibration interval.

NIST Traceable Calibration

The Fredericks Company offers NIST traceable calibration, where units are vacuum calibrated (on a vacuum stand) in nitrogen gas at various points (gauge dependent) against reference standards traceable to NIST. This includes incoming (as found) data, outgoing (as left) data after calibration adjustments, but does not include the reference standard uncertainty at each point (ISO 17025 accredited calibration does include uncertainties).

Factory Calibration

The Fredericks Company offers factory calibration, where units are electrically verified using electrical equipment only. The verification includes checking that the units provide vacuum readings within a specified tolerance when a specific electrical signal is applied. This is not a vacuum calibration, and does not guarantee that a sensor will read accurately when connected to a controller or active gauge. This is because sensor contamination and sensor to sensor mechanical variability cannot be accounted for with an electrical verification.

Back to Table of Contents

2. Comparison Table of Calibration Options

Description Factory NIST Traceable ISO 17025 Accredited
Electrical verification Yes No No
Vacuum comparison calibration to NIST traceable references No Yes Yes
Reference standard uncertainties included No No Yes
ISO 17025 accredited calibration No No Yes
Back to Table of Contents

3. 2A, 2A VacuMini, 2A NASA Mini Part 1

Applicable Controllers and Active Gauges

MX200, MM200, MC300, MV2A, Compact 2A, Vacuguard, B2A Portable, MP2AR

Factory Calibration

Test Point Lower Tolerance Upper Tolerance Tolerance
0.0E+0 -1.00E-3 1.00E-3 ±1.00E-3
1.0E-1 9.00E-2 1.10E-1 ±10%
1.0E+0 8.00E-1 1.20E+0 ±20%

NIST Traceable Calibration

Test Point Lower Tolerance Upper Tolerance Tolerance
0.0E+0 -1.00E-3 1.00E-3 ±1.00E-3
1.0E-2 9.00E-3 1.10E-2 ±10%
2.0E-2 1.80E-2 2.20E-2 ±10%
5.0E-2 4.50E-2 5.50E-2 ±10%
1.0E-1 9.00E-2 1.10E-1 ±10%
2.0E-1 1.60E-1 2.40E-1 ±20%
5.0E-1 4.00E-1 6.00E-1 ±20%
1.0E+0 8.00E-1 1.20E+0 ±20%

ISO 17025 Accredited Calibration

Test Point Lower Tolerance Upper Tolerance Tolerance
1.0E-3 0.00E+0 2.00E-3 ±1.00E-3 or ±100%
1.0E-2 9.00E-3 1.10E-2 ±10%
2.0E-2 1.80E-2 2.20E-2 ±10%
5.0E-2 4.50E-2 5.50E-2 ±10%
1.0E-1 9.00E-2 1.10E-1 ±10%
2.0E-1 1.60E-1 2.40E-1 ±20%
5.0E-1 4.00E-1 6.00E-1 ±20%
1.0E+0 8.00E-1 1.20E+0 ±20%

ISO 17025 Accredited GE Aviation Specification P10TF3 Compatible Calibration

Test Point Lower Tolerance Upper Tolerance Tolerance
1.0E-3 0.00E+0* 2.81E-3 ±0.45 decade or +182%, -65%
1.0E-2 5.00E-3 1.50E-2 ±5.00E-3 or ±50%
2.0E-2 1.50E-2 2.50E-2 ±5.00E-3 or ±25%
5.0E-2 4.25E-2 5.75E-2 ±15%
1.0E-1 8.50E-2 1.15E-1 ±15%
2.0E-1 1.70E-1 2.30E-1 ±15%
5.0E-1 4.25E-1 5.75E-1 ±15%
1.0E+0 8.50E-1 1.15E+0 ±15%

ISO 17025 Accredited AMS 2769 Compatible Calibration

Test Point Lower Tolerance Upper Tolerance Tolerance
1.0E-3 0.00E+0* 5.00E-3 ±4.00E-3 or ±400%
1.0E-2 6.00E-3 1.40E-2 ±40%
2.0E-2 1.20E-2 2.80E-2 ±40%
5.0E-2 3.00E-2 7.00E-2 ±40%
1.0E-1 6.00E-2 1.40E-1 ±40%
2.0E-1 1.20E-1 2.80E-1 ±40%
5.0E-1 3.00E-1 7.00E-1 ±40%
1.0E+0 6.00E-1 1.40E+0 ±40%

Note: The calculated limit is negative, which isn't possible for absolute pressure, or is outside the gauge's measurement or display range, so the limit shown is the gauge's minimum or maximum reading.

Back to Table of Contents

4. 2A, 2A VacuMini, 2A NASA Mini Part 2

Applicable Controllers and Active Gauges

MX2A

Factory Calibration

Test Point Lower Tolerance Upper Tolerance Tolerance
0.0E+0 0.00E+0* 1.00E-3 ±1.00E-3
1.0E+0 7.00E-1 1.30E+0 ±30%
7.6E+2 6.84E+2 8.36E+2 ±10%

NIST Traceable Calibration

Test Point Lower Tolerance Upper Tolerance Tolerance
0.0E+0 0.00E+0* 1.00E-3 ±1.00E-3
1.0E-2 9.00E-3 1.10E-2 ±10%
2.0E-2 1.80E-2 2.20E-2 ±10%
5.0E-2 4.50E-2 5.50E-2 ±10%
1.0E-1 9.00E-2 1.10E-1 ±10%
2.0E-1 1.80E-1 2.20E-1 ±10%
5.0E-1 4.50E-1 5.50E-1 ±10%
1.0E+0 7.00E-1 1.30E+0 ±30%

ISO 17025 Accredited Calibration

Test Point Lower Tolerance Upper Tolerance Tolerance
1.0E-3 0.00E+0 2.00E-3 ±1.00E-3 or ±100%
1.0E-2 9.00E-3 1.10E-2 ±10%
5.0E-2 4.50E-2 5.50E-2 ±10%
1.0E-1 9.00E-2 1.10E-1 ±10%
5.0E-1 4.50E-1 5.50E-1 ±10%
1.0E+0 7.00E-1 1.30E+0 ±30%
1.0E+1 7.00E+0 1.30E+1 ±30%
1.0E+2 7.00E+1 1.30E+2 ±30%
7.6E+2 6.84E+2 8.36E+2 ±10%

ISO 17025 Accredited GE Aviation Specification P10TF3 Compatible Calibration

Test Point Lower Tolerance Upper Tolerance Tolerance
1.0E-3 0.00E+0* 2.81E-3 ±0.45 decade or +182%, -65%
1.0E-2 5.00E-3 1.50E-2 ±5.00E-3 or ±50%
5.0E-2 4.25E-2 5.75E-2 ±15%
1.0E-1 8.50E-2 1.15E-1 ±15%
5.0E-1 4.25E-1 5.75E-1 ±15%
1.0E+0 8.50E-1 1.15E+0 ±15%
1.0E+1 9.00E+0 1.10E+1 ±10%
1.0E+2 9.00E+1 1.10E+2 ±10%
7.6E+2 6.84E+2 8.36E+2 ±10%

ISO 17025 Accredited AMS 2769 Compatible Calibration

Test Point Lower Tolerance Upper Tolerance Tolerance
1.0E-3 0.00E+0* 5.00E-3 ±4.00E-3 or ±400%
1.0E-2 6.00E-3 1.40E-2 ±40%
5.0E-2 3.00E-2 7.00E-2 ±40%
1.0E-1 6.00E-2 1.40E-1 ±40%
5.0E-1 3.00E-1 7.00E-1 ±40%
1.0E+0 6.00E-1 1.40E+0 ±40%
1.0E+1 6.00E+0 1.40E+1 ±40%
1.0E+2 6.00E+1 1.40E+2 ±40%
7.6E+2 4.56E+2 1.00E+3* ±40%

Note: The calculated limit is negative, which isn't possible for absolute pressure, or is outside the gauge's measurement or display range, so the limit shown is the gauge's minimum or maximum reading.

Back to Table of Contents

5. 4A Part 1

Applicable Controllers and Active Gauges

MX200, MX4A

Factory Calibration

Test Point Lower Tolerance Upper Tolerance Tolerance
0.0E+0 0.00E+0* 1.00E-3 ±1.00E-3
1.0E+0 9.00E-1 1.10E+0 ±10%
7.6E+2 6.84E+2 8.36E+2 ±10%

NIST Traceable Calibration

Test Point Lower Tolerance Upper Tolerance Tolerance
0.0E+0 0.00E+0* 1.00E-3 ±1.00E-3
1.0E-2 9.00E-3 1.10E-2 ±10%
5.0E-2 4.50E-2 5.50E-2 ±10%
1.0E-1 9.00E-2 1.10E-1 ±10%
5.0E-1 4.50E-1 5.50E-1 ±10%
1.0E+0 9.00E-1 1.10E+0 ±10%
1.0E+1 9.00E+0 1.10E+1 ±10%
1.0E+2 9.00E+1 1.10E+2 ±10%
7.6E+2 6.84E+2 8.36E+2 ±10%

ISO 17025 Accredited Calibration

Test Point Lower Tolerance Upper Tolerance Tolerance
1.0E-3 0.00E+0 2.00E-3 ±1.00E-3 or ±100%
1.0E-2 9.00E-3 1.10E-2 ±10%
5.0E-2 4.50E-2 5.50E-2 ±10%
1.0E-1 9.00E-2 1.10E-1 ±10%
5.0E-1 4.50E-1 5.50E-1 ±10%
1.0E+0 9.00E-1 1.10E+0 ±10%
1.0E+1 9.00E+0 1.10E+1 ±10%
1.0E+2 9.00E+1 1.10E+2 ±10%
7.6E+2 6.84E+2 8.36E+2 ±10%

ISO 17025 Accredited GE Aviation Specification P10TF3 Compatible Calibration

Test Point Lower Tolerance Upper Tolerance Tolerance
1.0E-3 0.00E+0* 2.81E-3 ±0.45 decade or +182%, -65%
1.0E-2 5.00E-3 1.50E-2 ±5.00E-3 or ±50%
5.0E-2 4.25E-2 5.75E-2 ±15%
1.0E-1 8.50E-2 1.15E-1 ±15%
5.0E-1 4.25E-1 5.75E-1 ±15%
1.0E+0 8.50E-1 1.15E+0 ±15%
1.0E+1 9.00E+0 1.10E+1 ±10%
1.0E+2 9.00E+1 1.10E+2 ±10%
7.6E+2 6.84E+2 8.36E+2 ±10%

ISO 17025 Accredited AMS 2769 Compatible Calibration

Test Point Lower Tolerance Upper Tolerance Tolerance
1.0E-3 0.00E+0* 5.00E-3 ±4.00E-3 or ±400%
1.0E-2 6.00E-3 1.40E-2 ±40%
5.0E-2 3.00E-2 7.00E-2 ±40%
1.0E-1 6.00E-2 1.40E-1 ±40%
5.0E-1 3.00E-1 7.00E-1 ±40%
1.0E+0 6.00E-1 1.40E+0 ±40%
1.0E+1 6.00E+0 1.40E+1 ±40%
1.0E+2 6.00E+1 1.40E+2 ±40%
7.6E+2 4.56E+2 1.00E+3* ±40%

Note: The calculated limit is negative, which isn't possible for absolute pressure, or is outside the gauge's measurement or display range, so the limit shown is the gauge's minimum or maximum reading.

Back to Table of Contents

6. 4A Part 2

Applicable Controllers and Active Gauges

MM200, MC300, MP4AR

Factory Calibration

Test Point Lower Tolerance Upper Tolerance Tolerance
0.0E+0 -1.00E-3 1.00E-3 ±1.00E-3
1.0E+0 9.00E-1 1.10E+0 ±10%
7.6E+2 6.84E+2 8.36E+2 ±10%

NIST Traceable Calibration

Test Point Lower Tolerance Upper Tolerance Tolerance
0.0E+0 -1.00E-3 1.00E-3 ±1.00E-3
1.0E-2 9.00E-3 1.10E-2 ±10%
5.0E-2 4.50E-2 5.50E-2 ±10%
1.0E-1 9.00E-2 1.10E-1 ±10%
5.0E-1 4.50E-1 5.50E-1 ±10%
1.0E+0 9.00E-1 1.10E+0 ±10%
1.0E+1 8.00E+0 1.20E+1 ±20%
1.0E+2 8.00E+1 1.20E+2 ±20%
7.6E+2 6.84E+2 8.36E+2 ±10%

ISO 17025 Accredited Calibration

Test Point Lower Tolerance Upper Tolerance Tolerance
1.0E-3 0.00E+0 2.00E-3 ±1.00E-3 or ±100%
1.0E-2 9.00E-3 1.10E-2 ±10%
5.0E-2 4.50E-2 5.50E-2 ±10%
1.0E-1 9.00E-2 1.10E-1 ±10%
5.0E-1 4.50E-1 5.50E-1 ±10%
1.0E+0 9.00E-1 1.10E+0 ±10%
1.0E+1 8.00E+0 1.20E+1 ±20%
1.0E+2 8.00E+1 1.20E+2 ±20%
7.6E+2 6.84E+2 8.36E+2 ±10%

ISO 17025 Accredited GE Aviation Specification P10TF3 Compatible Calibration

Test Point Lower Tolerance Upper Tolerance Tolerance
1.0E-3 0.00E+0* 2.81E-3 ±0.45 decade or +182%, -65%
1.0E-2 5.00E-3 1.50E-2 ±5.00E-3 or ±50%
5.0E-2 4.25E-2 5.75E-2 ±15%
1.0E-1 8.50E-2 1.15E-1 ±15%
5.0E-1 4.25E-1 5.75E-1 ±15%
1.0E+0 8.50E-1 1.15E+0 ±15%
1.0E+1 9.00E+0 1.10E+1 ±10%
1.0E+2 9.00E+1 1.10E+2 ±10%
7.6E+2 6.84E+2 8.36E+2 ±10%

ISO 17025 Accredited AMS 2769 Compatible Calibration

Test Point Lower Tolerance Upper Tolerance Tolerance
1.0E-3 0.00E+0* 5.00E-3 ±4.00E-3 or ±400%
1.0E-2 6.00E-3 1.40E-2 ±40%
5.0E-2 3.00E-2 7.00E-2 ±40%
1.0E-1 6.00E-2 1.40E-1 ±40%
5.0E-1 3.00E-1 7.00E-1 ±40%
1.0E+0 6.00E-1 1.40E+0 ±40%
1.0E+1 6.00E+0 1.40E+1 ±40%
1.0E+2 6.00E+1 1.40E+2 ±40%
7.6E+2 4.56E+2 1.00E+3* ±40%

Note: The calculated limit is negative, which isn't possible for absolute pressure, or is outside the gauge's measurement or display range, so the limit shown is the gauge's minimum or maximum reading.

Back to Table of Contents

7. 7B, 7E, 7M, 7F, 7FC, 7FCS Part 1

Applicable Controllers and Active Gauges

MX200, MM200, MC300, MP7ER, MP7FR

Factory Calibration

Test Point Lower Tolerance Upper Tolerance Tolerance
1.0E-5 6.31E-6 1.58E-5 ±0.2 decade or -37%, +58%
1.0E-4 6.31E-5 1.58E-4 ±0.2 decade or -37%, +58%

NIST Traceable Calibration

Test Point Lower Tolerance Upper Tolerance Tolerance
1.0E-6 6.31E-7* 1.58E-6 ±0.2 decade or -37%, +58%
5.0E-6 3.16E-6 7.92E-6 ±0.2 decade or -37%, +58%
1.0E-5 6.31E-6 1.58E-5 ±0.2 decade or -37%, +58%
5.0E-5 3.16E-5 7.92E-5 ±0.2 decade or -37%, +58%
1.0E-4 6.31E-5 1.58E-4 ±0.2 decade or -37%, +58%

ISO 17025 Accredited Calibration

Test Point Lower Tolerance Upper Tolerance Tolerance
1.0E-6 6.31E-7* 1.58E-6 ±0.2 decade or -37%, +58%
5.0E-6 3.16E-6 7.92E-6 ±0.2 decade or -37%, +58%
1.0E-5 6.31E-6 1.58E-5 ±0.2 decade or -37%, +58%
5.0E-5 3.16E-5 7.92E-5 ±0.2 decade or -37%, +58%
1.0E-4 6.31E-5 1.58E-4 ±0.2 decade or -37%, +58%

ISO 17025 Accredited GE Aviation Specification P10TF3 Compatible Calibration

Test Point Lower Tolerance Upper Tolerance Tolerance
1.0E-6 3.55E-7 2.81E-6 ±0.45 decade or +182%, -65%
5.0E-6 1.78E-6 1.40E-5 ±0.45 decade or +182%, -65%
1.0E-5 3.55E-6 2.81E-5 ±0.45 decade or +182%, -65%
5.0E-5 1.78E-5 1.40E-4 ±0.45 decade or +182%, -65%
1.0E-4 3.55E-5 2.81E-4 ±0.45 decade or +182%, -65%

ISO 17025 Accredited AMS 2769 Compatible Calibration

Test Point Lower Tolerance Upper Tolerance Tolerance
1.0E-6 3.17E-7 3.16E-6 ±0.5 decade or +216%, -68%
5.0E-6 1.59E-6 1.58E-5 ±0.5 decade or +216%, -68%
1.0E-5 3.17E-6 3.16E-5 ±0.5 decade or +216%, -68%
5.0E-5 1.59E-5 1.58E-4 ±0.5 decade or +216%, -68%
1.0E-4 3.17E-5 3.16E-4 ±0.5 decade or +216%, -68%

Note: MM200 and MC300 tolerance at these points is 6.0E-7.

Back to Table of Contents

8. 7B, 7E, 7M, 7F, 7FC, 7FCS Part 2

Applicable Controllers and Active Gauges

MX7B, MX7M

Factory Calibration

Test Point Lower Tolerance Upper Tolerance Tolerance
1.0E-5 7.00E-6 1.30E-5 ±30%
1.0E-4 7.00E-5 1.30E-4 ±30%

NIST Traceable Calibration

Test Point Lower Tolerance Upper Tolerance Tolerance
1.0E-6 7.00E-7 1.30E-6 ±30%
5.0E-6 3.50E-6 6.50E-6 ±30%
1.0E-5 7.00E-6 1.30E-5 ±30%
5.0E-5 3.50E-5 6.50E-5 ±30%
1.0E-4 7.00E-5 1.30E-4 ±30%

ISO 17025 Accredited Calibration

Test Point Lower Tolerance Upper Tolerance Tolerance
1.0E-6 7.00E-7 1.30E-6 ±30%
5.0E-6 3.50E-6 6.50E-6 ±30%
1.0E-5 7.00E-6 1.30E-5 ±30%
5.0E-5 3.50E-5 6.50E-5 ±30%
1.0E-4 7.00E-5 1.30E-4 ±30%

ISO 17025 Accredited GE Aviation Specification P10TF3 Compatible Calibration

Test Point Lower Tolerance Upper Tolerance Tolerance
1.0E-6 3.55E-7 2.81E-6 ±0.45 decade or +182%, -65%
5.0E-6 1.78E-6 1.40E-5 ±0.45 decade or +182%, -65%
1.0E-5 3.55E-6 2.81E-5 ±0.45 decade or +182%, -65%
5.0E-5 1.78E-5 1.40E-4 ±0.45 decade or +182%, -65%
1.0E-4 3.55E-5 2.81E-4 ±0.45 decade or +182%, -65%

ISO 17025 Accredited AMS 2769 Compatible Calibration

Test Point Lower Tolerance Upper Tolerance Tolerance
1.0E-6 3.17E-7 3.16E-6 ±0.5 decade or +216%, -68%
5.0E-6 1.59E-6 1.58E-5 ±0.5 decade or +216%, -68%
1.0E-5 3.17E-6 3.16E-5 ±0.5 decade or +216%, -68%
5.0E-5 1.59E-5 1.58E-4 ±0.5 decade or +216%, -68%
1.0E-4 3.17E-5 3.16E-4 ±0.5 decade or +216%, -68%
Back to Table of Contents

9. CC-10

Applicable Controllers and Active Gauges

CC-10

Factory Calibration

Test Point Lower Tolerance Upper Tolerance Tolerance
1.0E-5 6.31E-6 1.58E-5 ±0.2 decade or -37%, +58%
1.0E+0 8.50E-1 1.15E+0 ±15%
7.6E+2 7.22E+2 7.98E+2 ±5%

NIST Traceable Calibration

Test Point Lower Tolerance Upper Tolerance Tolerance
1.0E-6 6.31E-7 1.58E-6 ±0.2 decade or -37%, +58%
5.0E-6 3.16E-6 7.92E-6 ±0.2 decade or -37%, +58%
1.0E-5 6.31E-6 1.58E-5 ±0.2 decade or -37%, +58%
5.0E-5 3.16E-5 7.92E-5 ±0.2 decade or -37%, +58%
1.0E-4 6.31E-5 1.58E-4 ±0.2 decade or -37%, +58%
1.0E-3 6.31E-4 1.58E-3 ±0.2 decade or -37%, +58%
1.0E-2 6.31E-3 1.58E-2 ±0.2 decade or -37%, +58%
1.0E-1 8.50E-2 1.15E-1 ±15%
1.0E+0 8.50E-1 1.15E+0 ±15%
1.0E+1 8.50E+0 1.15E+1 ±15%
1.0E+2 8.50E+1 1.15E+2 ±15%
7.6E+2 7.22E+2 7.98E+2 ±5%

ISO 17025 Accredited Calibration

Test Point Lower Tolerance Upper Tolerance Tolerance
1.0E-6 6.31E-7 1.58E-6 ±0.2 decade or -37%, +58%
5.0E-6 3.16E-6 7.92E-6 ±0.2 decade or -37%, +58%
1.0E-5 6.31E-6 1.58E-5 ±0.2 decade or -37%, +58%
5.0E-5 3.16E-5 7.92E-5 ±0.2 decade or -37%, +58%
1.0E-4 6.31E-5 1.58E-4 ±0.2 decade or -37%, +58%
1.0E-3 6.31E-4 1.58E-3 ±0.2 decade or -37%, +58%
1.0E-2 6.31E-3 1.58E-2 ±0.2 decade or -37%, +58%
1.0E-1 8.50E-2 1.15E-1 ±15%
1.0E+0 8.50E-1 1.15E+0 ±15%
1.0E+1 8.50E+0 1.15E+1 ±15%
1.0E+2 8.50E+1 1.15E+2 ±15%
7.6E+2 7.22E+2 7.98E+2 ±5%

ISO 17025 Accredited GE Aviation Specification P10TF3 Compatible Calibration

Test Point Lower Tolerance Upper Tolerance Tolerance
1.0E-6 3.55E-7 2.81E-6 ±0.45 decade or +182%, -65%
5.0E-6 1.78E-6 1.40E-5 ±0.45 decade or +182%, -65%
1.0E-5 3.55E-6 2.81E-5 ±0.45 decade or +182%, -65%
5.0E-5 1.78E-5 1.40E-4 ±0.45 decade or +182%, -65%
1.0E-4 3.55E-5 2.81E-4 ±0.45 decade or +182%, -65%
1.0E-3 3.55E-4 2.81E-3 ±0.45 decade or +182%, -65%
1.0E-2 5.00E-3 1.50E-2 ±5.00E-3 or ±50%
1.0E-1 8.50E-2 1.15E-1 ±15%
1.0E+0 8.50E-1 1.15E+0 ±15%
1.0E+1 9.00E+0 1.10E+1 ±10%
1.0E+2 9.00E+1 1.10E+2 ±10%
7.6E+2 6.84E+2 8.36E+2 ±10%

ISO 17025 Accredited AMS 2769 Compatible Calibration

Test Point Lower Tolerance Upper Tolerance Tolerance
1.0E-6 3.17E-7 3.16E-6 ±0.5 decade or +216%, -68%
5.0E-6 1.59E-6 1.58E-5 ±0.5 decade or +216%, -68%
1.0E-5 3.17E-6 3.16E-5 ±0.5 decade or +216%, -68%
5.0E-5 1.59E-5 1.58E-4 ±0.5 decade or +216%, -68%
1.0E-4 3.17E-5 3.16E-4 ±0.5 decade or +216%, -68%
1.0E-3 1.00E-9* 5.00E-3 ±4.00E-3 or ±400%
1.0E-2 6.00E-3 1.40E-2 ±40%
1.0E-1 6.00E-2 1.40E-1 ±40%
1.0E+0 6.00E-1 1.40E+0 ±40%
1.0E+1 6.00E+0 1.40E+1 ±40%
1.0E+2 6.00E+1 1.40E+2 ±40%
7.6E+2 4.56E+2 1.00E+3* ±40%

Note: The calculated limit is negative, which isn't possible for absolute pressure, or is outside the gauge's measurement or display range, so the limit shown is the gauge's minimum or maximum reading.

Back to Table of Contents

10. 1E

Applicable Controllers and Active Gauges

MX200, MM200

Factory Calibration

Test Point Lower Tolerance Upper Tolerance Tolerance
5.0E+0 4.00E+0 6.00E+0 ±1.00E+0 or ±20%
1.0E+2 9.00E+1 1.10E+2 ±10%
7.6E+2 7.22E+2 7.98E+2 ±5%

NIST Traceable Calibration

Test Point Lower Tolerance Upper Tolerance Tolerance
5.0E+0 4.00E+0 6.00E+0 ±1.00E+0 or ±20%
1.0E+2 9.00E+1 1.10E+2 ±10%
4.0E+2 3.80E+2 4.20E+2 ±5%
7.6E+2 7.22E+2 7.98E+2 ±5%

ISO 17025 Accredited Calibration

Test Point Lower Tolerance Upper Tolerance Tolerance
1.0E+0 0.00E+0 2.00E+0 ±1.00E+0 or ±100%
1.0E+1 9.00E+0 1.10E+1 ±10%
1.0E+2 9.00E+1 1.10E+2 ±10%
4.0E+2 3.80E+2 4.20E+2 ±5%
7.6E+2 7.22E+2 7.98E+2 ±5%

ISO 17025 Accredited GE Aviation Specification P10TF3 Compatible Calibration

Test Point Lower Tolerance Upper Tolerance Tolerance
1.0E+0 8.50E-1 1.15E+0 ±15%
1.0E+1 9.00E+0 1.10E+1 ±10%
1.0E+2 9.00E+1 1.10E+2 ±10%
4.0E+2 3.60E+2 4.40E+2 ±10%
7.6E+2 6.84E+2 8.36E+2 ±10%

ISO 17025 Accredited AMS 2769 Compatible Calibration

Test Point Lower Tolerance Upper Tolerance Tolerance
1.0E+0 6.00E-1 1.40E+0 ±40%
1.0E+1 6.00E+0 1.40E+1 ±40%
1.0E+2 6.00E+1 1.40E+2 ±40%
4.0E+2 2.40E+2 5.60E+2 ±40%
7.6E+2 4.56E+2 1.00E+3* ±40%

Note: The calculated limit is negative, which isn't possible for absolute pressure, or is outside the gauge's measurement or display range, so the limit shown is the gauge's minimum or maximum reading.

Back to Table of Contents

11. 1F

Applicable Controllers and Active Gauges

MX200, MM200

Factory Calibration

Test Point Lower Tolerance Upper Tolerance Tolerance
1.0E+1 0.00E+0 2.00E+1 ±1.00E+1 or ±100%
1.0E+2 9.00E+1 1.10E+2 ±10%
7.6E+2 6.84E+2 8.36E+2 ±10%

NIST Traceable Calibration

Test Point Lower Tolerance Upper Tolerance Tolerance
1.0E+1 0.00E+0 2.00E+1 ±1.00E+1 or ±100%
1.0E+2 9.00E+1 1.10E+2 ±10%
4.0E+2 3.60E+2 4.40E+2 ±10%
7.6E+2 6.84E+2 8.36E+2 ±10%

ISO 17025 Accredited Calibration

Test Point Lower Tolerance Upper Tolerance Tolerance
1.0E+1 0.00E+0 2.00E+1 ±1.00E+1 or ±100%
1.0E+2 9.00E+1 1.10E+2 ±10%
4.0E+2 3.60E+2 4.40E+2 ±10%
7.6E+2 6.84E+2 8.36E+2 ±10%

ISO 17025 Accredited GE Aviation Specification P10TF3 Compatible Calibration

Test Point Lower Tolerance Upper Tolerance Tolerance
1.0E+1 9.00E+0 1.10E+1 ±10%
1.0E+2 9.00E+1 1.10E+2 ±10%
4.0E+2 3.60E+2 4.40E+2 ±10%
7.6E+2 6.84E+2 8.36E+2 ±10%

ISO 17025 Accredited AMS 2769 Compatible Calibration

Test Point Lower Tolerance Upper Tolerance Tolerance
1.0E+1 6.00E+0 1.40E+1 ±40%
1.0E+2 6.00E+1 1.40E+2 ±40%
4.0E+2 2.40E+2 5.60E+2 ±40%
7.6E+2 4.56E+2 1.00E+3* ±40%

Note: The calculated limit is negative, which isn't possible for absolute pressure, or is outside the gauge's measurement or display range, so the limit shown is the gauge's minimum or maximum reading.

Back to Table of Contents

12. CDG (Capacitance Diaphragm Gauge, Capacitance Manometer)

Applicable Controllers and Active Gauges

MX200, MM200

Notes

FS indicates the full-scale range of the CDG (typically 0.1, 1, 10, 100, or 1000 Torr).

Factory Calibration

Test Point Lower Tolerance Upper Tolerance Tolerance
0.1*FS (0.1*FS) - 2% (0.1*FS) + 2% ±2%
0.5*FS (0.5*FS) - 2% (0.5*FS) + 2% ±2%
FS FS - 2% FS + 2% ±2%

NIST Traceable Calibration

Test Point Lower Tolerance Upper Tolerance Tolerance
0.01*FS (0.01*FS) - 10% (0.01*FS) + 10% ±10%
0.1*FS (0.1*FS) - 2% (0.1*FS) + 2% ±2%
0.2*FS (0.2*FS) - 2% (0.2*FS) + 2% ±2%
0.3*FS (0.3*FS) - 2% (0.3*FS) + 2% ±2%
0.4*FS (0.4*FS) - 2% (0.4*FS) + 2% ±2%
0.5*FS (0.5*FS) - 2% (0.5*FS) + 2% ±2%
0.6*FS (0.6*FS) - 2% (0.6*FS) + 2% ±2%
0.7*FS (0.7*FS) - 2% (0.7*FS) + 2% ±2%
0.8*FS (0.8*FS) - 2% (0.8*FS) + 2% ±2%
0.9*FS (0.9*FS) - 2% (0.9*FS) + 2% ±2%
FS FS - 2% FS + 2% ±2%

ISO 17025 Accredited Calibration

Test Point Lower Tolerance Upper Tolerance Tolerance
0.01*FS (0.01*FS) - 10% (0.01*FS) + 10% ±10%
0.1*FS (0.1*FS) - 2% (0.1*FS) + 2% ±2%
0.2*FS (0.2*FS) - 2% (0.2*FS) + 2% ±2%
0.3*FS (0.3*FS) - 2% (0.3*FS) + 2% ±2%
0.4*FS (0.4*FS) - 2% (0.4*FS) + 2% ±2%
0.5*FS (0.5*FS) - 2% (0.5*FS) + 2% ±2%
0.6*FS (0.6*FS) - 2% (0.6*FS) + 2% ±2%
0.7*FS (0.7*FS) - 2% (0.7*FS) + 2% ±2%
0.8*FS (0.8*FS) - 2% (0.8*FS) + 2% ±2%
0.9*FS (0.9*FS) - 2% (0.9*FS) + 2% ±2%
FS FS - 2% FS + 2% ±2%

ISO 17025 Accredited GE Aviation Specification P10TF3 Compatible Calibration

Test Point Tolerance
1.0E-6 ≤ Test Point < 1.0E-2 ±0.45 decade or +182%, -65%
1.0E-2 ≤ Test Point < 1.0E+1 Greater of ±5.00E-3 or ±15%
1.0E+1 ≤ Test Point ≤ 7.6E+2 ±10%
7.6E+2 < Test Point ≤ 1.0E+3 ±5%

ISO 17025 Accredited AMS 2769 Compatible Calibration

Test Point Tolerance
1.0E-6 ≤ Test Point < 1.0E-3 ±0.5 decade or +216%, -68%
1.0E-3 ≤ Test Point ≤ 1.0E+3 Greater of ±4.00E-3 or ±40%
Back to Table of Contents