Foster and Cone (1986) pointed out that chance agreement changes as the base rate or prevalence of behavior changes.
When this occurs, chance agreement will equal 100% and the denominator of the kappa equation will resolve to zero (Foster & Cone, 1986).
On the compensation for chance agreement
in image classification accuracy assessment.
The system can then manage such actions as verbal and written warnings, last chance agreements
and suspensions or terminations.
These papers include easy-to-use forms such as a Consent to Testing and Last Chance Agreements
, which can be customized to meet the needs of a particular company.
The main advantage of the Kappa statistic is that it takes chance agreements
into account (Kazdin, 1982).