Six Sigma Quality Resources for Achieving Six Sigma Results
Online Training from BMG University Air Academy Six Sigma Certifications from Villanova University Click To Learn More About PremiumLinks
 Home > Tools & Templates  > Design Of Experiments (DOE) Search:
 
 for    
Publications
Marketplace
| iSixSigma
Stuff
| iSixSigma
Blogosphere
| Events
Calendar
| The
Dictionary
| Discussion
Forum
| Find
a Job
| Post
a Job
| Industry
News
| Newsletter
Signup
| Sigma
Calculator
| Online
Surveys
2008 Version! DMAIC Training Slides: 1,176 Slides + Instructor Notes and More for $99.95
iSixSigma Magazine Signup
 iSixSigma Live!  
  iSixSigma Live! Summit
  Agenda
  Registration Info
  Breakthrough Awards
 Free Newsletters!  
  Sign Up Now!
  Manage Subscriptions
  New To Six Sigma?
  Six Sigma Q&A
  Cert. Practice Test
  Problem Solving Wizard
  ISSSP Info
ISSSP Is The Official Six Sigma Society of iSixSigma
 Channels 
  Europe
  Financial Services
  Healthcare
  Military
  Software / IT
 Quality Directory 
  Best Practices
  Certifications/Awards
  Consultants
  Culture Evolution
  Methodologies
  News & Events
  Organizations
  Product/Service Guides
  Statistics & Analysis
  Tools & Templates
   DOE
   FMEA
   Glossary
   Histogram
   Pareto
   Poka Yoke
   SIPOC
   Software
  Voice of the Customer
  Free Whitepapers
 Related Topics 
  Innovation
  Outsourcing/Offshoring
  Business Process Mgt
 Quick Access 
  Help
  Search
  Advertise Here
  Article Archives
  Newsletter Archives
 User Feedback 
  Please suggest site
  improvements.
 
  [ larger form ]

Role for Design of Experiments in Financial Operations

Bookmark This Page Bookmark This Page
Email This Page Email This Page
Format for Printing Format for Printing
Cite This Article Cite This Article
Submit an Article Submit an Article
Six Sigma Article Archive Read More Articles
Related Tools & Articles
  • Discussion Forum
    "Six Sigma was a perfect fit for manufacuturing, an environment with a large volume of process data. When it comes to applying that same methodology to the commercial side the fit is less than perfect...how would you even apply DOE?"

    Contribute to this Discussion

    B
    Download Products
    y Kimberly Watson-Hemphill and Bill Kastle

    Most Master Black Belts would probably cite design of experiments (DOE) as the most underused statistical tool in financial services. Yet, designed experiments are a favorite tool of statisticians and Six Sigma practitioners working in general business environments because they are an extremely efficient way of identifying what matters in a process and what does not. That means businesses can focus their energies on the factors that really make a difference in effectiveness (quality, cost, customer satisfaction) and efficiency (speed).

    What distinguishes design of experiments is that:

    • Multiple factors are tested simultaneously for greatest efficiency. (Compare that to the traditional change-only-one-thing-at-a-time approach taught in most grade schools.)
    • The results can pick up interactions between factors (how one factor influences another), something that is difficult to detect by other means.
    • The experiment can provide a model of the process which can be used to conduct trade-off studies and reach an optimum solution.

    The reason grade school science experiments were limited to only one variable at a time is because in those experiments there is no way to isolate the effects of one factor from those of another. DOE resolves that issue by using a particular kind of statistical analysis that allows differentiation among changes caused by different factors – even when all the factors are changed at the same time.

    A typical designed experiment will involve anywhere from three to eight factors, each of which are tested in a specific combination at two setting, or "levels." (Some designs allow more factors and more levels, but these are used less frequently.)

    Setting Up the Experiment

    As an example of DOE in use, here is how a designed experiment helped a financial services company improve its application process. The bank was experiencing a 60 percent reprocessing (rework) rate on applications due to incomplete information provided by the customer. The project team trying to solve this processing problem suspected that three factors might affect whether an application was complete:

    • The type of application
    • How much detail was provided in the instructions
    • Whether additional examples were provided

    The team decided to study the application process in two locations, so in all there were five factors included in the experiment, each of which had two levels:

    A = Application Type: Loan versus Lease
    B = Region: Midwest versus Northeast
    C = Description: Current versus Enhanced (additional explanation provided)
    D = Example: Current versus Enhanced (additional examples added)
    E = Neg. Example: None versus Yes (example added of what not to put in the blanks)

    The experiment involved 16 trials, or runs, each with a different combination of factor settings. As shown in the table below, for example, the first run tested Loan applications in the Midwest, with the current level of description and a negative example provided. The 12th run looked at Lease applications in the Northeast with the current level of description, additional examples, but not negative examples. The response (y) measured by the team was the percent complete of each application. The table shows both the experiment design and the results (the "Avg. % Complete" column).

    Run
    Order

    App.
    Type


    Region


    Description


    Example

    Neg.
    Example

    Avg. %
    Complete

    Std.
    Dev.

    1

    Loan

    Midwest

    Current

    Current

    Yes

    46.5

    8.4

    2

    Lease

    Midwest

    Current

    Current

    None

    47.2

    9.2

    3

    Loan

    Northeast

    Current

    Current

    None

    40.5

    5.9

    4

    Lease

    Northeast

    Current

    Current

    Yes

    49.8

    6.2

    5

    Loan

    Midwest

    Enhanced

    Current

    None

    60.2

    8.6

    6

    Lease

    Midwest

    Enhanced

    Current

    Yes

    65.8

    8.9

    7

    Loan

    Northeast

    Enhanced

    Current

    Yes

    58.5

    5.8

    8

    Lease

    Northeast

    Enhanced

    Current

    None

    57.2

    6.1

    9

    Loan

    Midwest

    Current

    Enhanced

    None

    88.7

    8.7

    10

    Lease

    Midwest

    Current

    Enhanced

    Yes

    81.4

    8.5

    11

    Loan

    Northeast

    Current

    Enhanced

    Yes

    83.9

    6.3

    12

    Lease

    Northeast

    Current

    Enhanced

    None

    79.3

    5.7

    13

    Loan

    Midwest

    Enhanced

    Enhanced

    Yes

    91.6

    8.4

    14

    Lease

    Midwest

    Enhanced

    Enhanced

    None

    99.3

    8.6

    15

    Loan

    Northeast

    Enhanced

    Enhanced

    None

    96.3

    5.8

    16

    Lease

    Northeast

    Enhanced

    Enhanced

    Yes

    94.2

    5.9

    Results of the Experiment

    Of the five factors originally studied, only two of them proved to influence the percent complete:

    • Whether an example was provided (Factor D)
    • How much description was provided (Factor C)

    What did not matter was Region (the completion rate was the same in both the Northeast and Midwest); Application Type (the completion rate was the same for both loans and leases); and Neg. Example (showing people what not to do did not affect completion rate).

    These results are captured in Figure 1, where the steepness of the lines indicates the strength of the relationship. The lines for Description and Example change a lot, while the lines for the other three factors are nearly flat.

     Figure 1

    As noted above, the DOE also reveals interactions between factors – that is, whether one factor affects another. Look at Figure 2, for example. What it shows is that having a negative example made things worse in the Midwest but improved rates in the Northeast. (In statistical terms, this means there is an interaction between Neg. Example and Region.)

     Figure 2

    From these results, the team concluded that for both types of applications:

    • The same forms and process would be used in both regions, since the results were the same.
    • It would help to provide enhanced descriptions and examples for certain fields.

    By studying the results of the interactions closely, the team determined that negative examples did not help significantly when there were positive examples. And since the team had decided to use the positive examples, it would not pay to also develop negative examples.

    The new forms increased the application completeness from 60 percent to more than 95 percent, virtually eliminating reprocessing and significantly reducing the cycle time for the loan and lease application process. The additional capacity that was made available as a result of the improved process allowed the business to generate additional revenue without increasing headcount.

    Conclusion: Give DOE a Try

    Many companies avoid using design of experiments in part because it sounds complicated. Actually, the example shows that the basic setup is straightforward. All that is needed is to select the factors to test and identify different levels for those factors. It is advisable to work with a Black Belt or Master Black Belt trained in DOE to help pick out the factors and levels. That expertise will make sure the company gets the most from its investment of time and effort. A Black Belt also can help analyze and interpret the results – a process which can go quickly with statistical analysis software that is readily available.

    Most people who use DOE once become instant converts because the results usually have immediate practical application. It shows which process or design factors have the biggest impact on quality, speed, performance or delivery. That translates into better decisions.

    About the Authors: Kimberly Watson-Hemphill is a Master Black Belt with George Group and lead author of their Design for Lean Six Sigma curriculum. She has trained and coached hundreds of Black Belts and Master Black Belts throughout North America and Europe. She has a background in all areas of Lean Six Sigma, new product development and project management, and has worked with Fortune 500 companies in both service and manufacturing industries. She can be reached at kwatson@georgegroup.com. Bill Kastle is a vice president at George Group and has helped guide Lean Six Sigma initiatives at major corporations. He is co-author of the book What Is Lean Six Sigma? He has conducted executive training at Fortune 500 companies such as Alcan, Geico, Xerox, ITT Industries and DuPont-Merck. For more than 15 years, he has helped teams at all levels apply Lean and Six Sigma tools to respond to their customer needs. Mr. Kastle can be reached at bkastle@georgegroup.com.

     
    Rate This Article:  Current Rating: 4.42
      Poor    Excellent     
              1    2    3     4    5
    Copyright © 2000-2008 iSixSigma – All Rights Reserved
    Reproduction Without Permission Is Strictly Prohibited – Copyright Requests


    Publish an Article: Do you have a Six Sigma tip, learning or case study?
    Share it with the largest community of Six Sigma professionals, and be recognized by your peers.
    It's a great way to promote your expertise and/or build your resume. Read more about submitting an article.


    "The Bottom Line" Links

    1BMG
    UNIVERSITY
    .
    I
    I
    Lean Six Sigma
    Online
    I
    I
    Reduce Travel Costs
    Maximize Training Budget

    VILLANOVA
    UNIVERSITY
      Earn Your Lean, Green or Black Belt Six Sigma Master Certificate Online
    BOOST YOUR SALARY! *$38k more than uncertified counterparts. Learn From Industry Leaders!
      START NOW

    SIGMAPRO

    MBB, Lean Sigma, & DFSS

     

    when experience matters most...

    M O T O R O L A
    U N I V E R S I T Y
    Learn from the most experienced
    practitioners of Six Sigma in the world

    Public Training & Certification
    Click here to take a free Six Sigma Lesson

    JURΛN

    2009 Lean Six Sigma Public Workshops - SPECIAL OFFER!
    Register for any course before December 31st and receive 50% off any additional registrations, plus receive free consulting support! Call 800-338-7726 to register.

    LodeStar Institute

    |

    Live Lean Six Sigma Training

    Starting at $660

     WHY SETTLE FOR ONLINE? GET LIVE TRAINING AND PROJECT MENTORING FOR ONLINE PRICES.
    Finding that key person for your
    team is just a click away . . .
       
    TheJobShop

    jobs.isixsigma.com
         
    THE UNIVERSITY OF
    TEXAS
    AT AUSTIN

    2 weeks + 1 project = Black Belt Certification
    .
    Find us on LinkedIn
    Join the iSixSigma Network
    and Connect with Other Six Sigma Pros
    .
    .
    iSixSigma Live! Summit & Awards
    Jan 13-16, 2009 • Miami, FL
    Save up to $200.00 • Click Here!
    Space is Limited! Hurry!
    .

    BEST SELLING PRODUCTS (iSixSigma Publications)
    1. Certified Lean Six Sigma Green Belt Assessment Exam
      This assessment exam is useful for students interested in assessing their knowledge of Lean Six Sigma on the Green Belt ...
    2. Certified Lean Six Sigma Black Belt Assessment Exam
      Interested in assessing your knowledge of Lean Six Sigma? Preparing for certifications? Testing your students and traine...
    3. 5S Training Course
      One of the key fundamental tools of process improvement is 5S. 5S is a methodology for organizing and minimizing item...
    4. Six Sigma Black Belt (DMAIC) Training Slides
      The 2008 Six Sigma Black Belt course is comprised of: 1,176 PowerPoint slides, Instructor notes, Slide explanations, 37 ...
    5. Six Sigma DMAIC Training Slides
      The complete 2008 Lean Six Sigma DMAIC course prepares participants to perform the role of a LSS Black Belt; covering wh...
    6. Gage R&R Excel Template
      Gage Repeatability and Reproducibility (R&R) studies measure the amount of measurement variation that is attributabl...
    7. CSSBB Preparation Pack
      The CSSBB Preparation Pack includes materials for passing the Certified Six Sigma Black Belt (CSSBB) exam. This CSSBB Pr...
     
    Six Sigma AdLinks
    Rath & Strong
    Learn statistics online with Quality Trainer by Minitab
    SBTI Public Offerings, World Class MBB, Lean Enterprise
    SigmaXL: User Friendly Excel Add-ins for Statistical and Graphical Analysis
    Smarter Solutions Makes Lean Six Sigma Easier
    SigmaWorks: A complete toolbox for LSS & DFSS
    Michigan Engineering - Six Sigma Certifications
    @RISK for Six Sigma and quality analysis
    AdLinks Information


    Google AdWords
     
    Home | Discussion Forum | Event Calendar | Job Shop
    Link To iSixSigma | Rate This Page | Report A Problem | Free Content For Your Site | Submit Article For Publishing
     Terms of Service. ©2000-2008 iSixSigma. All rights reserved. v3.0lb, 2.7-C-246
    About iSixSigma · Contact Us · Privacy Policy · Site Map
    nogeo