Is Auditing BOTS a Good Idea?

@karthikdharmalingam Auditing is a waste of time and money if you have automation. If it is actually at 99% anything less than 100% audit (which isn’t an audit it is sorting). Anytime you are under about 10% defective you are pretty much wasting time with a sample.

You should have never bought off on 99%. You are operating at a Cpk less than 1.0. That has been passed for about the past 20 years. I would get the robot people in and tell them you need at least a Cpk of 1.5.

Hi Karthik, deciding whether 99% is good enough or not can be difficult. I’m not familiar with the acronyms you’ve used, I’m guessing UAT is unit acceptance test and BOTS are SW bots? Anyway, some kind of automation (whether a robot or a SW bot the issue remains the same.) In hindsight, you seem to be saying that the 1% customer escalation rate initiates a technical support “damage control” activity- 100% inspection. I’ve heard it said that 100% inspection is 80% effective… whether true or not, it illustrates the point that service or product quality cannot be inspected in. It takes some effort, but you can assess the total cost of quality of the 1% customer escalation rate and it’s effect both on customer satisfication and the lost productivity resulting from efforts to contain a problem that may or may not be there. A key consideration is that SW defects don’t occur randomly, but are the result of specific combinations of inputs. The difficulty is in presenting enough variation in the inputs to determine whether the BOTS can be made to be robust to this variation and deliver the desired input. It’d be great to hear more about your application and I hope that some of this is close to the mark.