Analyzing Rater Agreement : Manifest Variable Methods

Agreement among raters is of great importance in many domains.

Divided into five sections, this text describes methods of analysis of agreement data that come in the usual agreement table or in the form of raw data.

Part I introduces readers to coefficients of rater agreement and discusses their characteristics.

Part II describes a family of log-linear models that allow one to test specific hypotheses about the agreement table, including hypotheses of general agreement and those about trends in raters' judgments.

The next two sections present methods for the exploration of rater agreement and for the analysis of correlation matrices from different groups of raters.

Part V illustrates the use of computer programs, such as SPSS, SYSTAT, Lem, CFA2000, PAW95, and LISREL.

One or more complete run is presented for each program, as well as sample input and output files.

This book is intended as a reference for researchers and practitioners who describe and evaluate objects and behavior in a number of fields, including the social and behavioral sciences, statistics, medicine, business, and education.It will also serve as a useful text for graduate-level methods or assessment classes found in departments of psychology, education, epidemiology, biostatistics, public health, communication, advertising and marketing, and sociology.