Kappa一致性检验:远没那么简单

2016-10-26 精鼎数据分析联盟 精鼎秦老师 精鼎数据分析联盟

Kappa一致性检验在诊断试验中,研究者希望考察不同的诊断方法在诊断结果上是否具有一致性。如:评价两种诊断试验方法对同一个样本或研究对象的化验结果的一致性。此时,Kappa值可以作为评价判断的一致性程度的指标。实践证明,它是一个描述一致性较为理想的指标。因此在医学、社会学等领域中得到广泛的应用。Kappa 系数的计算方法有两种:1、简单Kappa系数(Simple Kappa Coefficien

Kappa一致性检验


在诊断试验中,研究者希望考察不同的诊断方法在诊断结果上是否具有一致性。如:评价两种诊断试验方法对同一个样本或研究对象的化验结果的一致性。此时,Kappa值可以作为评价判断的一致性程度的指标。实践证明,它是一个描述一致性较为理想的指标。因此在医学、社会学等领域中得到广泛的应用。

Kappa 系数的计算方法有两种:1、简单Kappa系数(Simple Kappa Coefficient),这是我们经常运用的方法,两种诊断结果的分级数目相同时使用;2、加权Kappa系数(Weighted Kappa Coefficient),这种方法在两种诊断结果的分级数目不一样时使用。

评价A、B两种检测方法对同一批样品的检验结果(轻度、中度、重度)的一致性,模拟以下两种情况的数据。

情况1:结果的分级数相同的情况

分析:该种情况就是A法和B法的检验结果的分级相同,都是3个类别。这是我们常见的情况。该方法的SPSS操作大家非常熟悉,在此不在赘述。主要看下面这种情况。

情况2:结果的分级数不同的情况

分析:该种情况就是A法和B法的检验结果的分级不相同。A法有三种检测结果,而B法只有轻度和中度的两种结果,因为重度的频数为0。此种情况,要计算加权Kappa系数

至此大家估计还不明白为什么以上两种情况要采用不同的Kappa检验方法。大家经常使用SPSS交叉表里的Kappa分析就能计算Kappa值。但是,你知道它的运算结果到底是简单Kappa值还是加权Kappa值吗?

下面用事实说话:
(情况2的数据在SPSS交叉表操作里也能算出Kappa值,但是不是正确的!下面将用SAS运行的加权Kappa值与之对比)

SPSS操作如下:


SPSS运行结果如下:


下面运用SAS计算其加权Kappa系数:

程序如下

data kappa;
input A B freq;
datalines;
1 1 6
1 2 8
1 3 0
2 1 5
2 2 2
2 3 0
3 1 8
3 2 4
3 3 0
;
run;
proc freq data= kappa;
  tables A*B;
  test kappa;
  weight freq / zeros;
run;

运行结果如下:




由SAS结果可以看出加权Kappa系数的值与简单Kappa系数的值还是有差别的。情况2(两种方法的结果分级不相同)应该采用加权Kappa系数值。

并且将SPSS的Kappa检验结果与以上结果对比发现,SPSS的Kappa检验结果是简单Kappa系数,只适用于情况1(两种方法的结果分级相同的情况)。


松哥:Kappa一致性检验看似很简单,在SPSS中也非常容易实现。但是,有多少人知道SPSS交叉表操作的Kappa值是简单Kappa系数呢?这种操作只适用于部分情况呢?Kappa一致性检验远没你想的那么简单。

版权声明:
本网站所有内容来源注明为“梅斯医学”或“MedSci原创”的文字、图片和音视频资料,版权均属于梅斯医学所有。非经授权,任何媒体、网站或个人不得转载,授权转载时须注明来源为“梅斯医学”。其它来源的文章系转载文章,或“梅斯号”自媒体发布的文章,仅系出于传递更多信息之目的,本站仅负责审核内容合规,其内容不代表本站立场,本站不负责内容的准确性和版权。如果存在侵权、或不希望被转载的媒体或个人可与我们联系,我们将立即进行删除处理。
在此留言
评论区 (4)
#插入话题
  1. [GetPortalCommentsPageByObjectIdResponse(id=1906833, encodeId=7a6919068336e, content=<a href='/topic/show?id=d91e1943441' target=_blank style='color:#2F92EE;'>#一致性#</a>, beContent=null, objectType=article, channel=null, level=null, likeNumber=23, replyNumber=0, topicName=null, topicId=null, topicList=[TopicDto(id=19434, encryptionId=d91e1943441, topicName=一致性)], attachment=null, authenticateStatus=null, createdAvatar=, createdBy=3138208, createdName=zhanfl, createdTime=Thu Aug 31 05:25:00 CST 2017, time=2017-08-31, status=1, ipAttribution=), GetPortalCommentsPageByObjectIdResponse(id=186323, encodeId=798318632313, content= 对一致性检验有了新的认识, beContent=null, objectType=article, channel=null, level=null, likeNumber=1, replyNumber=0, topicName=null, topicId=null, topicList=[], attachment=null, authenticateStatus=null, createdAvatar=https://wx.qlogo.cn/mmopen/Pw2csslt7CukWiabqiblnQAU2wVkTeANBK9R3rSMa9LcU72r7swR61YTJ7oZWL1MzhnJhRqMIsPZvCgHPwqmpYhDYKYK7dcwibS/0, createdBy=0cab1623974, createdName=hanchunhee, createdTime=Mon Apr 10 06:33:53 CST 2017, time=2017-04-10, status=1, ipAttribution=), GetPortalCommentsPageByObjectIdResponse(id=160455, encodeId=0326160455ad, content=以前确实不清楚还有简单与加权Kappa之分,学习了, beContent=null, objectType=article, channel=null, level=null, likeNumber=44, replyNumber=0, topicName=null, topicId=null, topicList=[], attachment=null, authenticateStatus=null, createdAvatar=, createdBy=f3b31651532, createdName=sunshine1104, createdTime=Mon Dec 05 16:11:12 CST 2016, time=2016-12-05, status=1, ipAttribution=), GetPortalCommentsPageByObjectIdResponse(id=157329, encodeId=0a1b15e3296a, content=涨知识了。, beContent=null, objectType=article, channel=null, level=null, likeNumber=53, replyNumber=0, topicName=null, topicId=null, topicList=[], attachment=null, authenticateStatus=null, createdAvatar=, createdBy=9b2a1732571, createdName= gospel007, createdTime=Mon Nov 21 21:49:49 CST 2016, time=2016-11-21, status=1, ipAttribution=)]
    2017-08-31 zhanfl
  2. [GetPortalCommentsPageByObjectIdResponse(id=1906833, encodeId=7a6919068336e, content=<a href='/topic/show?id=d91e1943441' target=_blank style='color:#2F92EE;'>#一致性#</a>, beContent=null, objectType=article, channel=null, level=null, likeNumber=23, replyNumber=0, topicName=null, topicId=null, topicList=[TopicDto(id=19434, encryptionId=d91e1943441, topicName=一致性)], attachment=null, authenticateStatus=null, createdAvatar=, createdBy=3138208, createdName=zhanfl, createdTime=Thu Aug 31 05:25:00 CST 2017, time=2017-08-31, status=1, ipAttribution=), GetPortalCommentsPageByObjectIdResponse(id=186323, encodeId=798318632313, content= 对一致性检验有了新的认识, beContent=null, objectType=article, channel=null, level=null, likeNumber=1, replyNumber=0, topicName=null, topicId=null, topicList=[], attachment=null, authenticateStatus=null, createdAvatar=https://wx.qlogo.cn/mmopen/Pw2csslt7CukWiabqiblnQAU2wVkTeANBK9R3rSMa9LcU72r7swR61YTJ7oZWL1MzhnJhRqMIsPZvCgHPwqmpYhDYKYK7dcwibS/0, createdBy=0cab1623974, createdName=hanchunhee, createdTime=Mon Apr 10 06:33:53 CST 2017, time=2017-04-10, status=1, ipAttribution=), GetPortalCommentsPageByObjectIdResponse(id=160455, encodeId=0326160455ad, content=以前确实不清楚还有简单与加权Kappa之分,学习了, beContent=null, objectType=article, channel=null, level=null, likeNumber=44, replyNumber=0, topicName=null, topicId=null, topicList=[], attachment=null, authenticateStatus=null, createdAvatar=, createdBy=f3b31651532, createdName=sunshine1104, createdTime=Mon Dec 05 16:11:12 CST 2016, time=2016-12-05, status=1, ipAttribution=), GetPortalCommentsPageByObjectIdResponse(id=157329, encodeId=0a1b15e3296a, content=涨知识了。, beContent=null, objectType=article, channel=null, level=null, likeNumber=53, replyNumber=0, topicName=null, topicId=null, topicList=[], attachment=null, authenticateStatus=null, createdAvatar=, createdBy=9b2a1732571, createdName= gospel007, createdTime=Mon Nov 21 21:49:49 CST 2016, time=2016-11-21, status=1, ipAttribution=)]
    2017-04-10 hanchunhee

    对一致性检验有了新的认识

    0

  3. [GetPortalCommentsPageByObjectIdResponse(id=1906833, encodeId=7a6919068336e, content=<a href='/topic/show?id=d91e1943441' target=_blank style='color:#2F92EE;'>#一致性#</a>, beContent=null, objectType=article, channel=null, level=null, likeNumber=23, replyNumber=0, topicName=null, topicId=null, topicList=[TopicDto(id=19434, encryptionId=d91e1943441, topicName=一致性)], attachment=null, authenticateStatus=null, createdAvatar=, createdBy=3138208, createdName=zhanfl, createdTime=Thu Aug 31 05:25:00 CST 2017, time=2017-08-31, status=1, ipAttribution=), GetPortalCommentsPageByObjectIdResponse(id=186323, encodeId=798318632313, content= 对一致性检验有了新的认识, beContent=null, objectType=article, channel=null, level=null, likeNumber=1, replyNumber=0, topicName=null, topicId=null, topicList=[], attachment=null, authenticateStatus=null, createdAvatar=https://wx.qlogo.cn/mmopen/Pw2csslt7CukWiabqiblnQAU2wVkTeANBK9R3rSMa9LcU72r7swR61YTJ7oZWL1MzhnJhRqMIsPZvCgHPwqmpYhDYKYK7dcwibS/0, createdBy=0cab1623974, createdName=hanchunhee, createdTime=Mon Apr 10 06:33:53 CST 2017, time=2017-04-10, status=1, ipAttribution=), GetPortalCommentsPageByObjectIdResponse(id=160455, encodeId=0326160455ad, content=以前确实不清楚还有简单与加权Kappa之分,学习了, beContent=null, objectType=article, channel=null, level=null, likeNumber=44, replyNumber=0, topicName=null, topicId=null, topicList=[], attachment=null, authenticateStatus=null, createdAvatar=, createdBy=f3b31651532, createdName=sunshine1104, createdTime=Mon Dec 05 16:11:12 CST 2016, time=2016-12-05, status=1, ipAttribution=), GetPortalCommentsPageByObjectIdResponse(id=157329, encodeId=0a1b15e3296a, content=涨知识了。, beContent=null, objectType=article, channel=null, level=null, likeNumber=53, replyNumber=0, topicName=null, topicId=null, topicList=[], attachment=null, authenticateStatus=null, createdAvatar=, createdBy=9b2a1732571, createdName= gospel007, createdTime=Mon Nov 21 21:49:49 CST 2016, time=2016-11-21, status=1, ipAttribution=)]
    2016-12-05 sunshine1104

    以前确实不清楚还有简单与加权Kappa之分,学习了

    0

  4. [GetPortalCommentsPageByObjectIdResponse(id=1906833, encodeId=7a6919068336e, content=<a href='/topic/show?id=d91e1943441' target=_blank style='color:#2F92EE;'>#一致性#</a>, beContent=null, objectType=article, channel=null, level=null, likeNumber=23, replyNumber=0, topicName=null, topicId=null, topicList=[TopicDto(id=19434, encryptionId=d91e1943441, topicName=一致性)], attachment=null, authenticateStatus=null, createdAvatar=, createdBy=3138208, createdName=zhanfl, createdTime=Thu Aug 31 05:25:00 CST 2017, time=2017-08-31, status=1, ipAttribution=), GetPortalCommentsPageByObjectIdResponse(id=186323, encodeId=798318632313, content= 对一致性检验有了新的认识, beContent=null, objectType=article, channel=null, level=null, likeNumber=1, replyNumber=0, topicName=null, topicId=null, topicList=[], attachment=null, authenticateStatus=null, createdAvatar=https://wx.qlogo.cn/mmopen/Pw2csslt7CukWiabqiblnQAU2wVkTeANBK9R3rSMa9LcU72r7swR61YTJ7oZWL1MzhnJhRqMIsPZvCgHPwqmpYhDYKYK7dcwibS/0, createdBy=0cab1623974, createdName=hanchunhee, createdTime=Mon Apr 10 06:33:53 CST 2017, time=2017-04-10, status=1, ipAttribution=), GetPortalCommentsPageByObjectIdResponse(id=160455, encodeId=0326160455ad, content=以前确实不清楚还有简单与加权Kappa之分,学习了, beContent=null, objectType=article, channel=null, level=null, likeNumber=44, replyNumber=0, topicName=null, topicId=null, topicList=[], attachment=null, authenticateStatus=null, createdAvatar=, createdBy=f3b31651532, createdName=sunshine1104, createdTime=Mon Dec 05 16:11:12 CST 2016, time=2016-12-05, status=1, ipAttribution=), GetPortalCommentsPageByObjectIdResponse(id=157329, encodeId=0a1b15e3296a, content=涨知识了。, beContent=null, objectType=article, channel=null, level=null, likeNumber=53, replyNumber=0, topicName=null, topicId=null, topicList=[], attachment=null, authenticateStatus=null, createdAvatar=, createdBy=9b2a1732571, createdName= gospel007, createdTime=Mon Nov 21 21:49:49 CST 2016, time=2016-11-21, status=1, ipAttribution=)]
    2016-11-21 gospel007

    涨知识了。

    0