Six Sigma Quality Resources for Achieving Six Sigma Results
Innovation Training & Workshops from BMG Air Academy Six Sigma Certifications from Villanova University Click To Learn More About PremiumLinks
 Home > Tools & Templates  > Design Of Experiments (DOE) Search:
 
 for    
 Highlights: iSixSigma Merchandise |Buy BooksBuy Six Sigma eBooks|Six Sigma Blog | Quality Events and Training Calendar | Quality Dictionary | Six Sigma Quality Discussion Forum | Find Six Sigma Jobs Post Six Sigma Jobs | Six Sigma News and Press Releases | Free Six Sigma Newsletter | Calculate Your Process Sigma| Online Surveys
iSixSigma Magazine Signup
iSixSigma Live!
 Free Newsletters!  
  Sign Up Now!
  Manage Subscriptions
  New To Six Sigma?
  Six Sigma Q&A
  Cert. Practice Test
  Problem Solving Wizard
  ISSSP Info
  Ldrshp. Conf. Arizona
ISSSP Is The Official Six Sigma Society of iSixSigma
 Channels 
  Europe
  Financial Services
  Healthcare
  Military
  Software / IT
  Innovation
  Outsourcing/Offshoring
  Business Process Mgt
 Quality Directory 
  Best Practices
  Certifications/Awards
  Consultants
  Culture Evolution
  Methodologies
  News & Events
  Organizations
  Statistics & Analysis
  Tools & Templates
   DOE
   FMEA
   Glossary
   Histogram
   Pareto
   Poka Yoke
   SIPOC
   Software
  Voice of the Customer
  Free Whitepapers
 Quick Access 
  Help
  Search
  Advertise Here
  Article Archives
  Newsletter Archives
 User Feedback 
  Please suggest site
  improvements.
 
  [ larger form ]

Importance of Test Plans/Test Protocol (with a Template)

Bookmark This Page Bookmark This Page
Email This Page Email This Page
Format for Printing Format for Printing
Cite This Article Cite This Article
Submit an Article Submit an Article
Six Sigma Article Archive Read More Articles
Related Tools & Articles
  • Discussion Forum
    "Is there such a thing as experimental design when we build a logisitc regression model and all predictors are catogorical? ...We need to test various combinations of envelope color, size and font and find out which one gives the highest response rate."

    Contribute to this Discussion

    B
    New from iSixSigmaCSSBB Preparation Pack

    Certified Lean Six Sigma Black Belt Assessment Exam

    Certified Lean Six Sigma Green Belt Assessment Exam
    y Kim Niles

    Test plans, also called test protocol, are formal documents that typically outline requirements, activities, resources, documentation and schedules to be completed. Some form of test plan should be developed prior to any test.   

    The key reasons for developing test plans are:  

    • Preparation: To assure that all reasonable aspects of running a test have been considered.
    • Communication and Training: To train those who need to assist with the test.
    • Effectiveness: To provide a mechanism for outlining test needs, limitations (listing assumptions), and justification for purposes of setting expectations, acquiring resources, investigating unexpected results, assuring normalcy and effectiveness.
    • Legal and Regulatory Prudence: To enable replication and protection of discoveries made, to mitigate potential litigation costs from use of those discoveries, and to help provide evidence to show regulatory bodies of efficacy.

    Test Plan Content

    Titles and order of sections within a test plan vary significantly from company to company, given differences in test types, strategy, scope and industry. Examples of tests which should have plans or protocol written for them include medical, non-medical, field, lab or production studies, design of experiments (DOE), problem solving, reliability or software regression tests, and design assurance, evaluation or validation tests.

    Beginning of the Plan (typically background-related information) – Suggested considerations for information to be included in the beginning of the plan are header information, title, date, author, file code, project number, product/device/model description, sub-components of that product actually being tested, to whom the report is written, test number and revision, and references to other related documents. References might include industry standards, brainstorm documents (fishbone diagrams, FMEA/FTA/FMECA studies, related V&V protocols and reports, field history or rejection reports, company procedures, related website links, etc.). Cover pages and a table of contents should be considered for large plans. Most plans contain an explanation of what the test is about (i.e. summary, introduction, abstract, background, purpose, history, etc.). Some plans also include test type and strategy information, definitions, important terms or key words, approval signatures, return on investment and/or other justification information.  

    Template for Test Plan

    A free Word template for a test plan with common sections already setup accompanies this article. Using details from previous test plans, statistical software, company or project logos, and other materials, you can cut and paste in the template and shorten your test plan development time. Or save yourself and your company even more time, money, risk and related trouble by using the template to assist you in developing your own test plan format. Of course, you will want to remove sections that do not fit the way you do business.

    Middle of the Plan (typically scope-related information) – Suggested considerations for information to be included in the middle of the plan are a data collection or sampling plan (including sample size, confidence acceptance levels and sampling techniques), test conditions or setup instructions, a test procedure specifying exact measurements to be taken, test monitoring requirements, and resources (equipment and personnel) to be used including responsibilities. Most plans contain some form of flow chart, process or value stream maps, assumptions that need to be made and why (including statistical distribution related as applicable), a work breakdown structure or schedule, and/or how the test factors (response Ys and control Xs) were selected. Some plans include special customer or site-related requests or considerations, measurement system capability information, and how test-related problems are to be reported and corrected (i.e. failure reporting and corrective action system). Also include unresolved issue reporting.

    End of the Plan (typically analysis-related information) – Suggested considerations for information to be included in the end of the plan are statistical techniques to be used, the hypothesis to be tested, the power of the test matrix and/or why it was chosen (for DOE) and a definition for test success (pass/fail criteria as possible). Most plans include how the data is to be analyzed, contingencies for how to handle different types of preliminary or insufficient results, how the conclusions are to be reported or summarized (i.e. significance with confidence, pass/fail, etc.). Some plans also include references and/or a bibliography, appendices that might be needed, and copyright or proprietary information messages as applicable.

    Generic Test Plan Advice

    • Make Them Context Rich: Context-rich test plans contain seemingly unimportant details that often do help reduce confusion, document test details that might be needed, and/or help explain any unexplained results.
    • Use Hypertext: It's often helpful to add links to other parts of the same document (i.e. "jump to conclusion," "see details," "see references").
    • Add Key Assumptions: Listing key assumptions in the plan can be important for setting reader expectations, influencing approval, assuring management that the test is well thought out, explaining unexpected results, and providing direction for future tests. Example assumptions are as follows:
      • "Results are assumed to contain an even distribution of errors."
      • "Temperature change stabilization times selected are assumed to be sufficient."
    • Convert Test Plan into a Test Report as Possible: Test plans can often be converted into test reports. Some sections only change in tense. Other sections can be reused exactly as they were written.
    • Take Extra Data-Related Precautions: Ensure sampling is representative of the population (random and unbiased), personally observe data collection, and make sure the measurement system is capable.
    • Develop Test Libraries: Standard tests and/or test results from prior tests (especially reliability tests) should be easily accessed and re-used as applicable and possible.

    Conclusion: Test Plans a Sensible Step

    It is easy to see how test plans are an important and sensible part of performing an experiment. They save time and money, assist in getting the best results and can facilitate speedy test report writing.

    About the Author

    Kim Niles has more than 17 years process control and improvement experience working with San Diego manufacturing companies in a wide range of industries and disciplines. Currently an officer in three professional societies, Mr. Niles has a master's degree in quality science with an emphasis in Six Sigma from California State University Dominguez Hills. He has a bachelor's degree from San Diego State University through the industrial technology department. He can be reached at kim.niles@cox.net.

     
    Rate This Article:  Current Rating: 3.77
      Poor    Excellent     
              1    2    3     4    5
    Copyright © 2000-2008 iSixSigma LLC – All Rights Reserved
    Reproduction Without Permission Is Strictly Prohibited – Copyright Requests


    Publish an Article: Do you have a Six Sigma tip, learning or case study?
    Share it with the largest community of Six Sigma professionals, and be recognized by your peers.
    It's a great way to promote your expertise and/or build your resume. Read more about submitting an article.


    "The Bottom Line" Links
    BMG
    CERTIFICATION
    Enhance Your Career With Lean Six Sigma Skills

    Green Belt or Black Belt - May 12 :: Atlanta, GA
    Green Belt to Black Belt Upgrade - July 7 :: Atlanta, GA
    VILLANOVA
    UNIVERSITY
      Earn Your Lean, Green or Black Belt Six Sigma Master Certificate Online
    BOOST YOUR SALARY! *$38k more than uncertified counterparts. Learn From Industry Leaders!
      START NOW

    SIGMAPRO

    MBB, Lean Sigma, & DFSS

     

    when experience matters most...

    M O T O R O L A
    U N I V E R S I T Y
    Learn from the most experienced
    practitioners of Six Sigma in the world

    Public Training & Certification
    Click here to take a free Six Sigma Lesson
    J

    URΛN

     
    Lean Six Sigma Public Workshop
    Upgrade to Black Belt- May 2008
    Become one of your organization's 'vital few'. Get Juran Certified.
     
    .
    ISSSP
    Follow the Leaders to Arizona!
    9th Annual Six Sigma Leadership Conference
    May 19th-22nd, 2008 • Scottsdale, AZ
    Click Here: More information & REGISTRATION
    .
    HOWARD UNIVERSITY

    4 weeks + 1 cost saving project + 1 mentor + 1 caring instructor = 1 Marketable Certified Lean Six Sigma Black Belt
    WINSTON SALEM
    STATE UNIVERSITY
    4 weeks + 1 cost saving project + 1 mentor + 1 caring instructor = 1 Marketable Certified Lean Six Sigma Black Belt
    THE UNIVERSITY OF
    TEXAS
    AT AUSTIN

    2 weeks + 1 project = Black Belt Certification
    .
    Find us on LinkedIn
    Join the iSixSigma Network
    and Connect with Other Six Sigma Pros
    .


    Download the iSixSigma Toolbar for 1-Click access. Search Your Way. Everyday. Without Delay.
    Get 1-Click iSixSigma access. Search Your Way. Everyday. Without Delay.

    BEST SELLING PRODUCTS (iSixSigma Publications)
    1. 2008 VERSION! Six Sigma DMAIC Training Slides
      The OSSS Six Sigma DMAIC course is comprised of:1,176 slides, Instructor notes, Slide explanations, 37 data sets, 20 sup...
    2. Certified Lean Six Sigma Green Belt Assessment Exam
      This assessment exam is useful for students interested in assessing their knowledge of Lean Six Sigma on the Green Belt ...
    3. NEW VERSION! Process Management Training Slides
      The OSSS Process Management course is designed in two phases comprised of:352 Powerpoint slidesInstructor notesSlide exp...
    4. Certified Lean Six Sigma Black Belt Assessment Exam
      This test is useful for students interested in assessing their knowledge of Lean Six Sigma on the Black Belt level. It c...
    5. 5th Annual iSixSigma Global Salary Survey Research Report
      The 5th Annual iSixSigma Global Salary Survey report is based on the responses of 2,142 Six Sigma professionals currentl...
    6. Gage R&R Excel Template
      Gage Repeatability and Reproducibility (R&R) studies measure the amount of measurement variation that is attributabl...
    7. Wave Solder Process Improvement Project Example
      In today’s high-tech world, almost any household gadget has some basic electronics circuitry built into it – refrigerato...
     

    Six Sigma AdLinks
    Rath & Strong
    Quality Companion 2: Improve your quality project execution
    SBTI Public Offerings, World Class MBB, Lean Enterprise
    SigmaXL: User Friendly Excel Add-ins for Statistical and Graphical Analysis
    Smarter Solutions Makes Lean Six Sigma Easier
    SigmaWorks: A complete toolbox for LSS & DFSS
    @RISK for Six Sigma
    E6 Sigma - The Real Six Sigma
    AdLinks Information


    Google AdWords
     
    Home | Discussion Forum | Event Calendar | Job Shop
    Link To iSixSigma | Rate This Page | Report A Problem | Free Content For Your Site | Submit Article For Publishing
     Terms of Service. ©2000-2008 iSixSigma LLC, CTQ Media LLC. All rights reserved. v3.0lb, 1.2-A-244
    About iSixSigma · Contact Us · Privacy Policy · Site Map
    nogeo