Kappa Calculation

There are three steps to calculate a Kappa coefficient:

Step one, rater sheets should be filled out for each rater.  In the example rater sheet below, there are three excerpts and four themes.  Enter 1 in the corresponding cell if the rater thought the theme was present in that excerpt; enter 0 if the rater thought the theme was absent.

request a consultation

Discover How We Assist to Edit Your Dissertation Chapters

Aligning theoretical framework, gathering articles, synthesizing gaps, articulating a clear methodology and data plan, and writing about the theoretical and practical implications of your research are part of our comprehensive dissertation editing services.

  • Bring dissertation editing expertise to chapters 1-5 in timely manner.
  • Track all changes, then work with you to bring about scholarly writing.
  • Ongoing support to address committee feedback, reducing revisions.

Rater Sheet: RATER 1

Excerpt #Theme(1=Present    0=Absent)
 Theme WTheme XTheme YTheme Z
Excerpt 11111
Excerpt 20101
Excerpt 30111
Excerpt 41001
Excerpt 51111

Rater Sheet: RATER 2

Excerpt #Theme(1=Present    0=Absent)
 Theme WTheme XTheme YTheme Z
Excerpt 11100
Excerpt 20011
Excerpt 31111
Excerpt 41001
Excerpt 51111

Step two, you will need to fill out a matrix for each theme.  For theme W for example, Rater 1 and Rater 2 agreed 3 times that theme W was present in the excerpts, so enter 3 in box A of the matrix.  One time Rater 1 thought theme W was absent and Rater 2 thought theme W was present, so enter 1 in box B.  Rater 1 never thought a theme was present that Rater 2 thought was absent, so enter 0 in box C.  One time Rater 1 and Rater 2 agreed that theme W was absent, so enter 1 in box D.

Key

 Rater 1
PresentAbsent
Rater 2PresentAB
AbsentCD

Theme W

 Rater 1
PresentAbsent
Rater 2Present31
Absent01

Theme X

 Rater 1
PresentAbsent
Rater 2Present30
Absent11

Theme Y

 Rater 1
PresentAbsent
Rater 2Present21
Absent11

Theme Z

 Rater 1
PresentAbsent
Rater 2Present40
Absent10

Enter your theme matrix values in the calculator to determine your kappa values.

ThemeABCDObservedExpectedKappa
W31010.80.560.00
X30110.80.560.00
Y21110.60.520.00
Z40100.80.80.00

Click here to calculate your Kappa Coefficients