Free Tools › ICC Calculator (Intraclass Correlation)

ICC Calculator: Intraclass Correlation for Reliability

Measure inter-rater or test-retest reliability. Paste ratings (subjects in rows, raters in columns) to get all six ICC forms with 95% confidence intervals, F tests and a plain-language interpretation.

FreeNo account neededYour data stays in your browser

Your dataOne row per subject (target) and one column per rater or measurement occasion.
TypeDescriptionICC95% CIFdfp
ICC1Single rater, absolute agreement, one-way random0.9350.83 to 0.9844.349, 20< 0.001
ICC2Single rater, absolute agreement, two-way random0.9360.82 to 0.9854.029, 18< 0.001
ICC3Single rater, consistency, two-way mixed0.9460.85 to 0.9954.029, 18< 0.001
ICC1kMean of k raters, absolute agreement, one-way random0.9770.94 to 0.9944.349, 20< 0.001
ICC2kMean of k raters, absolute agreement, two-way random0.9780.93 to 0.9954.029, 18< 0.001
ICC3kMean of k raters, consistency, two-way mixed0.9810.95 to 0.9954.029, 18< 0.001

ICC2 = 0.94 (95% CI 0.82 to 0.98). Using Koo and Li's guideline, which is applied to the 95% CI, reliability is between good and excellent.

Choosing the form: use a two-way random-effects model (ICC2) when raters are a sample of a wider population of raters, two-way mixed (ICC3) when these are the only raters of interest, and one-way (ICC1) when each subject is rated by different raters. Use "single" if in practice one rater's score will be used, and "mean of k" if the average will be used.

Get new free research tools firstOccasional emails when we add tools and guides. No spam.

We only use your email to send these updates, never share it, and you can unsubscribe by replying to any email or writing to info@timelyscholar.com. Privacy Policy

How to Use the ICC Calculator (Intraclass Correlation)

  1. 1

    Paste your data

    Copy the columns from Excel or Google Sheets, with names in the first row.

  2. 2

    Choose the variables

    The results update instantly in your browser.

  3. 3

    Copy the table

    Paste straight into Word, or download a CSV.

Choosing and interpreting the ICC

The intraclass correlation measures how strongly measurements of the same subject agree. Different forms suit different designs: one-way or two-way models, absolute agreement or consistency, and single or averaged measurements.

Report the model, type and form you used. Koo and Li suggest interpreting the 95% confidence interval: below 0.5 poor, 0.5 to 0.75 moderate, 0.75 to 0.9 good and above 0.9 excellent reliability.

How it is calculated

Sources

ICC Calculator (Intraclass Correlation): FAQ

Which ICC should I report?

For inter-rater reliability where raters are a sample of possible raters, ICC2 (two-way random, absolute agreement) is common; use the average-measures form only if the mean of several raters will be used in practice.

ICC or Cohen's kappa?

Use the ICC for continuous measurements and kappa for categorical ratings.

Related Free Tools