QA Calibration Variance

Six Sigma – iSixSigma Forums Operations Call Centers QA Calibration Variance

Viewing 5 posts - 1 through 5 (of 5 total)
• Author
Posts
• #250349

Ons
Participant

How do we compute the variance per question and not the overall score?

Facilitator     Evaluator1
Score             Score
Item1       10                   0
Item2       0                 10
Total        10                 10

They seem calibrated as they have the same total but looking closely, but items 1 and 2 are both answered differently.

Thank you

0
#250350

Robert Butler
Participant

It’s just the sums of the squares of the deviation from the mean divided by the total count minus 1.

So, for a single item the average is  (10 + 0)/2 = 5

The deviations from the mean are

10 – 5 = 5

0-5 = -5

The squares of those deviations are

5^2 = 25

(-5)^2 = 25

there are two observations so  2 – 1 = 1

Therefore the variance per item is (25 + 25)/1 = 50  and the standard deviation is the square root of 50 = 7.07

If this were a real situation, my first reaction would be: why bother with any calculations – better to find out why two different individuals are coming up with ratings that are the exact opposite of one another. As presented, if the two raters are the system, then there is no calibration whatsoever.

0
#250501

Chris Seider
Participant

@rbutler you are kind to help with homework. :)

Stay safe and hope your family stays well!

0
#250505

Robert Butler
Participant

Things are fine on my end @cseider – hope all is well with you too.  As for the homework – it’s pretty quiet around these parts and I was feeling generous…    :-)

0
#250524

Strayer
Participant

This is off topic but I insist that we distinguish between QA and QC.  The main reason is that we can easily overlook QA when it’s conflated with QC.  Quality Control is testing, inspection, and analysis to verify that a product conforms to specifications, plus the related actions to handle nonconformance.  Quality Assurance is the systematic monitoring and evaluation of the various aspects of a project, service, or facility to ensure that standards of quality are being met.

0
Viewing 5 posts - 1 through 5 (of 5 total)

You must be logged in to reply to this topic.