Sampling Economy and Process Capability Decisions
Using The Sequential Test Method For Process Capability Decisions Can Result In 50% Sampling Savings

Applying Wald's Sequential Test Method To Process Capability Decisions
A process is defined as capable when the determined statistical control limits are at least equal to or within the specification limits and deemed incapable whenever the control limits lie outside of the specification limits. The capability index

By convention, if C_P < 1, the process is deemed incapable; if C_P = 1 or C_P > 1, the process is considered marginally or definitively capable (Ex: C_P >= 1.33). Hence, for a selected USL-LSL specification range, any sampling decision on whether a process is capable is dependent upon the process standard deviations s₀ (C_P > 1 ) s₁ (C_P < 1 ) and corresponding Type I a and Type II b errors for hypothesis acceptance or rejection. With the exception of double sampling, most accept/reject inspection decisions assume that the observational numbers are independent of the results and require a predetermined sample size. Sequential test or inspection plan sample sizes are dependent on the outcome of the observations and require three decisions: (1) Accept the test hypothesis, (2) Take another observation, (3) Reject the test hypothesis.

Historically, Sequential Testing results from the theory of Sequential Analysis that was created by WALD² in 1943 for war time military equipment development and inspections. Numerous examples of the theory's practical applications and sampling saving economies were later published1 by the Statistical Research Group of Columbia University. Examples of the mentioned 50% sampling economy can be found in the document. The basis for Wald's Sequential Test are the Probability inequality ratios:

As an example of test principle usage, consider the sequence of observations X₁...X_N from a normally distributed process with a known mean m and unknown standard deviation s, where the test hypothesis is s <= s₀ and the alternate s >= s₁. For each value of N, the probability ratio P_1N/P_ON is calculated. Thus, the test hypothesis s <= s₀ is accepted when (1) P_1N/P_ON <= b/(1-a) and the alternate s >= s₁ when (3) P_1N/P_ON >= (1-b)/a. The test is continued when (2) b/(1-a) < P_1N/P_ON < (1-b)/a. The expansion of Inequality (2) results in expression (4) below:

and further simplification results in the straight line forms that are used to create the table (Table 2) and/or graph (Figure 1) of a Wald Sequential Test Procedure for Process Variability:

Accept Standard Deviation s₀ at step N if the summed observations * S (X_i - m)² satisfy

and continue sampling if

where:

*Note: In the cases where the mean m is unknown the sum of squares is replaced by the squares of the deviations from the sample mean and the limit N is replaced by N-1. Five useful points of both the Operating Characteristic Pa(s) and Average Sample Number ASN(s) curves can be calculated from the formulas in Table 1.

Table 1: Five Useful Points

The Average Sample Number ASN(s) estimates the average number of samples required for a decision at a specified standard deviation s since the exact number is not known beforehand.

A Process Capability Application Example¹
A textile customer specifies an average burst strength and tolerance of 120 pounds +/- 50 pounds for each patch of manufactured cloth and further requires a minimum Process Capability Cp of 1.33. The specification range (USL-LSL) in this case is 100 pounds and the maximum allowable process standard deviation calculates as 100/(6 x 1.33) = 12.5 pounds. The cloth manufacturer accepts the customer's specification based on a standard deviation comparison of New Machine A with the historical results obtained for older equipment. The sequential sampling parameters s₀=12.5, s₁=24.3, a=0.001, and b=0.001 are chosen for the study. The Excel spreadsheet outputs are illustrated in Table 2, Figure 1, and Table 3. Table 3 lists an Average Sample Number of 23 for this test at the desired standard deviation level of 12.5. The test was terminated after 15 cumulative samples were taken. This is indicated by the asterisk in the immediate left column of the calculated Accept STD1 (12.5) Criteria Sums in Table 2 and Figure 1 chart. The manufacturer has decided to produce the customer's orders on New Machine A (Cp >= 1.33) since the older equipment is not capable (Cp <= 0.69) of meeting the customer's specification.

Table 2: Sequential Sampling Process Capability Determination

Figure 1: Sequential Sampling Process Capability Plot, New Machine A

Table 3: New Machine A

Variance Sampling Economy
When a classical test of significance is applied to question of whether the sample variance s² differs significantly from the desired population variance s₀, a Chi-square test X² is usually applied. The test hypothesis H₀ specifies the population variance as H₀: s² = s₀² and the alternate hypothesis H₁: s₁² > s₀². If H₀ is correct, then X²/f is the distribution for s²/s₀² for f degrees of freedom. Thus, a rejection of the test hypothesis H₀ occurs at some chosen significance level a such that

The test's sample size can be estimated from the power of the discriminating test³ needed to distinguish between the population variances s₁² and s₀² at f degrees of freedom:

Method Limitations Versus Advantages
A limitation⁴ of the Sequential Method is that compensations are not made for the effects of sample grouping on Type I, Type II errors, ASN and OC curve values. When compared with single item sequential plans, grouping by sample increments results in an increase in the number of items inspected and advantageously lower Type I and Type II errors. If the process is evaluated is very good or bad, expeditious decisions occur. However, these accept or reject decisions are dependent upon the closeness of the standard deviation parameters s₀, s₁ and the degree of risk a, b that the manufacturer or organization is willing to accept. Borderline processes often require indefinite sample sizes and a truncation point leading to an increased a or b risk has to be agreed upon. The method does not exempt the manufacturer or organization from continuous monitoring since processes do change in time. Also, the example discussed is based on the assumption of a centered normally distributed process.

Aside from sampling economy, the major advantage in the use of Wald's Sequential Probability Ratio Test (SPRT)⁵ arises from the ease at which it can be automated, enhanced and extended to the Binomial, Poisson and Reliability Test areas. Algorithms can be devised that require only computer familiarity and data entry skills on the part of the user. Additionally, hardware as simple as a programmable pocket calculator can be used for many of the applications.

About The Author
John J. Hickey is a MS Chemist and Quality professional with extensive experience in the areas of Analytical Chemistry, QA, Safety, Regulatory Affairs, Management and Training. He currently divides his time between scientific research and the technical training of disadvantaged youth.

References
1. Statistical Research Group, Columbia University (1945). "Sequential Analysis of Statistical Data: Applications", Columbia University Press, New York, NY. The exhibit data from section 6.216 was used to validate output from Excel Spreadsheet formulas. The standard deviation and type I, II error input parameters were varied for example purposes.
2. Wald , A (1947), Sequential Analysis, John Wiley & Sons, New York, NY.
3. Hald, A (1952), Statistical Theory with Engineering Applications, John Wiley & Sons, New York, NY.
4. D. R. Garrison, J. J. Hickey, Journal of Quality Technology, Vol 16, No. 3 July 1984, "Wald Sequential Sampling for Attribute Inspection".
5. Additional SPRT citations can be found at http://citeseer.nj.nec.com/context/78315/0 and Internet Interactive Wald Sequential Sampling Tables for Attributes can be generated at http://home.clara.net/sisa/sprthlp.htm.