Training Sample Measurement Systems MTB16 EN
Training Sample Measurement Systems MTB16 EN
Objectives
• Determine the adequacy of measurement systems.
• Calculate statistics to assess the linearity and bias of a measurement system.
Gage Studies for Continuous Data Copyright © 2010 Minitab Inc. All rights reserved. Rel16 Ver 1.0 TRMEM160.SQA 1-1
Contents
Contents
Examples and Exercises Purpose Page
Assessing Measurement System Variation
Example 1 Assess how the precision of a measurement system 1-3
Fuel Injector Nozzle Diameters affects the variability of a measurement using a crossed
gage R&R study.
Example 2 Design a gage R&R study to identify problems in a 1-22
Muffler Pipe Thickness measurement system using a crossed gage R&R
analysis and a gage run chart.
Exercise A Identify problems in a measurement system using a 1-35
Assessing Consistency in Color Readings crossed gage R&R study.
Exercise B Determine the adequacy of a measurement system with 1-36
Paper Breaking Strength measurements obtained from a destructive test using a
crossed gage R&R study.
Nested Gage R&R (destructive tests with small
batch sizes)
Example 3 Determine the adequacy of a measurement system with 1-37
Impact Testing of Stainless Steel measurements obtained from a destructive test using a
nested gage R&R study.
Exercise C Determine the adequacy of a measurement system with 1-47
Improving the Measuring System measurements obtained from a destructive test using a
nested gage R&R study.
Gage Linearity and Bias Study
Example 4 Determine the linearity and bias of a measurement 1-48
Floor Tile Flatness system using a gage linearity and bias study.
Gage Studies for Continuous Data Copyright © 2010 Minitab Inc. All rights reserved. Rel16 Ver 1.0 TRMEM160.SQA 1-2
Assessing Measurement System Variation
Problem Tools
A manufacturer of fuel injector nozzles installs a new digital • Gage R&R Study (Crossed)
measuring system. Investigators want to determine how well
the new system measures the nozzles.
Gage Studies for Continuous Data Copyright © 2010 Minitab Inc. All rights reserved. Rel16 Ver 1.0 TRMEM160.SQA 1-3
Assessing Measurement System Variation
Measurement systems analysis
Gage Studies for Continuous Data Copyright © 2010 Minitab Inc. All rights reserved. Rel16 Ver 1.0 TRMEM160.SQA 1-4
Assessing Measurement System Variation
Gage R&R study (crossed)
What is a gage R&R study (crossed) Why use a gage R&R study (crossed)
A crossed gage R&R study estimates how much total process This study compares measurement system variation to total
variation is caused by the measurement system. Total process process variation or tolerance. If the measurement system
variation consists of part-to-part variation plus measurement variation is large in proportion to total variation, the system
system variation. Measurement system variation consists of: may not adequately distinguish between parts.
• Repeatability—variation due to the measuring device, or A crossed gage R&R study can answer questions such as:
the variation observed when the same operator measures
the same part repeatedly with the same device • Is the variability of a measurement system small
compared with the manufacturing process variability?
• Reproducibility—variation due to the measuring system,
or the variation observed when different operators • Is the variability of a measurement system small
measure the same part using the same device compared with the process specification limits?
• How much variability in a measurement system is caused
When you estimate repeatability, each operator measures by differences between operators?
each part at least twice. When you estimate reproducibility,
at least two operators must measure the parts. Operators • Is a measurement system capable of discriminating
measure the parts in random order, and the selected parts between parts?
represent the possible range of measurements.
For example:
When to use a gage R&R study (crossed) • How much of the variability in the measured diameter of a
bearing is caused by the caliper?
• Use gage R&R to evaluate a measurement system before • How much of the variability in the measured diameter of a
using it to monitor or improve a process. bearing is caused by the operator?
• Use the crossed analysis when each operator measures • Can the measurement system discriminate between
each part (or batch, for a destructive test) multiple times. bearings of different size?
Gage Studies for Continuous Data Copyright © 2010 Minitab Inc. All rights reserved. Rel16 Ver 1.0 TRMEM160.SQA 1-5
Assessing Measurement System Variation
Measurement system error
Measurement system errors can be classified into two Accuracy
categories:
The accuracy of a measurement system has three
• Accuracy—the difference between the part’s measured components:
and actual value
• Bias—a measure of the inaccuracy in the measurement
• Precision—the variation when the same part is measured system; the difference between the observed average
repeatedly with the same device measurement and a master value
Errors of one or both of these categories may occur within • Linearity—a measure of how the size of the part affects
any measurement system. For example, a device may the bias of the measurement system; the difference in the
measure parts precisely (little variation in the measurements) observed bias values through the expected range of
but not accurately. Or a device may be accurate (the average measurements
of the measurements is very close to the master value), but • Stability—a measure of how well the system performs
not precise (the measurements have large variance). Or a over time; the total variation obtained with a particular
device may be neither accurate nor precise. device, on the same part, when measuring a single
characteristic over time
Precision
Gage Studies for Continuous Data Copyright © 2010 Minitab Inc. All rights reserved. Rel16 Ver 1.0 TRMEM160.SQA 1-6
Assessing Measurement System Variation
Assessing the measurement system
Use a Gage R&R study (crossed) to assess: Gage R&R Study (Crossed)
• How well the measuring system can distinguish between 1 Choose Stat ➤ Quality Tools ➤ Gage Study ➤ Gage R&R
parts Study (Crossed).
• Whether the operators measure consistently 2 Complete the dialog box as shown below.
Tolerance
The specification limits for the nozzle diameters are 9012 ± 4
microns. In other words, the nozzle diameter is allowed to
vary by as much as 4 microns in either direction. The
tolerance is the difference between the specification limits:
9016 – 9008 = 8 microns.
By entering a value in Process tolerance, you can estimate
what proportion of the tolerance is taken up by the variation
in the measurement system.
3 Click Options.
4 Under Process tolerance, choose Upper spec - Lower
spec and type 8.
5 Check Draw graphs on separate graphs, one graph per
page.
6 Click OK in each dialog box.
Gage Studies for Continuous Data Copyright © 2010 Minitab Inc. All rights reserved. Rel16 Ver 1.0 TRMEM160.SQA 1-7
Assessing Measurement System Variation
Interpreting your results
Gage Studies for Continuous Data Copyright © 2010 Minitab Inc. All rights reserved. Rel16 Ver 1.0 TRMEM160.SQA 1-8
Assessing Measurement System Variation
Interpreting your results
Gage Studies for Continuous Data Copyright © 2010 Minitab Inc. All rights reserved. Rel16 Ver 1.0 TRMEM160.SQA 1-9
Assessing Measurement System Variation
Interpreting your results
Therefore, 99.2% of the total variation in the measurements Study Var %Study Var %Tolerance
Source StdDev (SD) (6 * SD) (%SV) (SV/Toler)
is due to the differences between parts. This high Total Gage R&R 0.10801 0.64807 8.97 8.10
%Contribution is considered very good. When Repeatability 0.10000 0.60000 8.30 7.50
%Contribution for Part-to-Part is high, the system can Reproducibility 0.04082 0.24495 3.39 3.06
distinguish between parts. Operator 0.04082 0.24495 3.39 3.06
Part-To-Part 1.19986 7.19913 99.60 89.99
Total Variation 1.20471 7.22824 100.00 90.35
Using variance versus standard deviation
Number of Distinct Categories = 15
Because %Contribution is based on the total variance, the
column of values adds up to 100%.
Minitab also displays columns with percentages based on the
standard deviation (or square root of variance) of each term.
These columns, labeled %StudyVar and %Tolerance,
typically do not add up to 100%. Because the standard
deviation uses the same units as the part measurements and
the tolerance, it allows for meaningful comparisons.
Note Minitab displays the column %Process if you enter a historical
standard deviation in Options.
Gage Studies for Continuous Data Copyright © 2010 Minitab Inc. All rights reserved. Rel16 Ver 1.0 TRMEM160.SQA 1-10
Assessing Measurement System Variation
Interpreting your results
6s process variation
Typically, process variation is defined as 6s, where s is the
standard deviation, as an estimate of σ. When data are
normally distributed, approximately 99.73% of the data fall
within 6 standard deviations (± 3 standard deviations from
the mean), and approximately 99% of the data fall within
5.15 standard deviations (± 2.575 standard deviations from
the mean).
Note The Automotive Industry Action Group (AIAG) recommends the use
of 6s in gage R&R studies.
Gage Studies for Continuous Data Copyright © 2010 Minitab Inc. All rights reserved. Rel16 Ver 1.0 TRMEM160.SQA 1-11
Assessing Measurement System Variation
Interpreting your results
Note If you do not enter a tolerance, the %Tolerance column does not Number of Distinct Categories = 15
appear in the output. If your measurement specification is
single-sided, you do not have a tolerance range for the analysis.
Gage Studies for Continuous Data Copyright © 2010 Minitab Inc. All rights reserved. Rel16 Ver 1.0 TRMEM160.SQA 1-12
Assessing Measurement System Variation
Interpreting your results
• %Tolerance—8.10
Remember that Minitab uses different divisors to calculate
%Tolerance and %Study Var. Because the range for tolerance
(8) is greater than the total study variation (7.22824) in this
example, the %Tolerance is lower.
Gage Studies for Continuous Data Copyright © 2010 Minitab Inc. All rights reserved. Rel16 Ver 1.0 TRMEM160.SQA 1-13
Assessing Measurement System Variation
Interpreting your results
Minitab truncates this value to the integer except when the Study Var %Study Var %Tolerance
Source StdDev (SD) (6 * SD) (%SV) (SV/Toler)
value calculated is less than 1. In that case, Minitab sets the Total Gage R&R 0.10801 0.64807 8.97 8.10
number of distinct categories equal to 1. Repeatability 0.10000 0.60000 8.30 7.50
Reproducibility 0.04082 0.24495 3.39 3.06
Number of Operator 0.04082 0.24495 3.39 3.06
categories Means… Part-To-Part 1.19986 7.19913 99.60 89.99
Total Variation 1.20471 7.22824 100.00 90.35
<2 The system cannot discriminate between
parts. Number of Distinct Categories = 15
Gage Studies for Continuous Data Copyright © 2010 Minitab Inc. All rights reserved. Rel16 Ver 1.0 TRMEM160.SQA 1-14
Assessing Measurement System Variation
Interpreting your results
Components of variation
The Components of Variation chart graphically represents
the gage R&R table in the Session window output.
Note In the Options subdialog box, you can choose to display these
graphs on separate pages.
Gage Studies for Continuous Data Copyright © 2010 Minitab Inc. All rights reserved. Rel16 Ver 1.0 TRMEM160.SQA 1-15
Assessing Measurement System Variation
Interpreting your results
R chart
The R chart is a control chart of ranges that graphically
displays operator consistency. An R chart consists of:
• Plotted points, which represent, for each operator, the
difference between the largest and smallest measurements
of each part. If the measurements are the same, the
range = 0. Minitab plots the points by operator so that you
can compare the consistency of each operator.
• Center line, which is the grand average of the ranges (the
average of all the subgroup ranges).
• Control limits (UCL and LCL) for the subgroup ranges.
Minitab uses the within-subgroup variation to calculate
these limits.
If any points on the R-chart fall above the upper control limit
(UCL), the operator is not consistently measuring the parts.
The UCL takes into account the number of times each
operator measures a part. If operators measure consistently,
the ranges are small relative to the data and the points fall
within the control limits.
Note Minitab displays an R chart when the number of replicates is less
than 9; otherwise, Minitab displays an S chart.
Gage Studies for Continuous Data Copyright © 2010 Minitab Inc. All rights reserved. Rel16 Ver 1.0 TRMEM160.SQA 1-16
Assessing Measurement System Variation
Interpreting your results
Xbar chart
The Xbar chart compares the part-to-part variation to the
repeatability component. The Xbar chart consists of:
• Plotted points, which represent, for each operator, the
average measurement of each part.
• Center line, which is the overall average for all part
measurements by all operators.
• Control limits (UCL and LCL), which are based on the
number of measurements in each average and the
repeatability estimate.
Because the parts chosen for a Gage R&R study should
represent the entire range of possible parts, this graph ideally
shows lack-of-control. It is desirable to observe more
variation between part averages than what is expected from
repeatability variation alone.
For these data, many points are above or below the control
limits. These results indicate that part-to-part variation is
much greater than measurement device variation.
Gage Studies for Continuous Data Copyright © 2010 Minitab Inc. All rights reserved. Rel16 Ver 1.0 TRMEM160.SQA 1-17
Assessing Measurement System Variation
Interpreting your results
Gage Studies for Continuous Data Copyright © 2010 Minitab Inc. All rights reserved. Rel16 Ver 1.0 TRMEM160.SQA 1-18
Assessing Measurement System Variation
Interpreting your results
Measurements by operator
The By Operator plot can help you to determine whether
measurements and variability are consistent across operators.
The By Operator graph shows all of the study measurements,
arranged by operator. When there are nine or fewer
measurements for each operator, dots represent the
measurements. When there are more than nine measurements
for each operator, Minitab displays a boxplot. For both types
of graphs, black circles represent the means, and a line
connects them. Asterisks indicate potential outliers.
If the line is… Then…
Parallel to the x-axis The operators are measuring the
parts similarly, on average.
Not parallel to the x-axis The operators are measuring the
parts differently, on average.
Gage Studies for Continuous Data Copyright © 2010 Minitab Inc. All rights reserved. Rel16 Ver 1.0 TRMEM160.SQA 1-19
Assessing Measurement System Variation
Interpreting your results
Measurements by part
The By Nozzle plot shows all of the measurements in the
study arranged by part. Minitab represents the measurements
by empty circles and the means by solid circles. The line
connects the average measurements for each part.
Ideally:
• Multiple measurements for each part show little variation
(the empty circles for each part are close together).
• Averages vary enough so that differences between parts
are clear.
Gage Studies for Continuous Data Copyright © 2010 Minitab Inc. All rights reserved. Rel16 Ver 1.0 TRMEM160.SQA 1-20
Assessing Measurement System Variation
Final considerations
Summary and conclusions AIAG guidelines for the gage R&R table are:
The nozzle measuring system contributes very little to the %Tolerance,
overall variation, as confirmed by both the gage R&R table %StudyVar
and graphs. %Process System is…
Under 10% Acceptable
The variation that is due to the measuring system, either as a
percent of study variation or as a percent of tolerance, is less 10% to 30% Potentially acceptable (depends
than 10%. According to AIAG guidelines, this system is on the criticality of the
acceptable. measurement, costs, risks, etc.)
Over 30% Not acceptable
Additional considerations Source: [1] in the reference list.
Graph patterns that show low measuring-system variation: Gage R&R (crossed) studies, like other measurement
Graph Pattern
systems analysis (MSA) procedures, are designed
experiments. For valid results, randomization and
R-bar Small average range representative sampling are essential.
Xbar chart Narrow control limits and many points
out of control
By part Very similar measurements for each
part across all operators, and clear
differences between parts
By operator Straight horizontal line
Operator by part Overlaid lines
Gage Studies for Continuous Data Copyright © 2010 Minitab Inc. All rights reserved. Rel16 Ver 1.0 TRMEM160.SQA 1-21