Observer agreement calculations

By the use of momentary time‐sampling data obtained from a pair of observers, various indices of observer agreement were computed. An analysis of the results showed that conflicting claims could be made for the adequacy of the observers’ agreement levels depending upon which indices were used. By contrast, visual inspection of the primary data in contingency tables was seen to reveal full information without introducing any in‐built assumptions. As a consequence, it is suggested that reports which include observer agreement in their results should include contingency tables which show numbers of agreements and disagreements on occurrences and non‐occurrences of behaviour

Agreement · Contingency · Contingency table · Contrast (vision) · Econometrics · Observer (physics) · Physics · Statistics · Artificial Intelligence · Computer Science · Insect Pheromone Research and Control · Mathematics · Multi-Criteria Decision Making · Psychology · Reliability and Agreement in Measurement