VIEW ARTICLE    DOI: 10.1094/ASBCJ-44-0023

Statistical Evaluation of Sensory Judges. D. M. Malek, J. H. Munroe, D. J. Schmitt, Miller Brewing Co., Milwaukee, WI53201; and B. Korth, Oak Park, IL 60304. J. Am. Soc. Brew. Chem. 44:0023, 1986.

A system for statistical evaluation of the performance of individual sensory judges is described. Analysis of variance F ratios were computed to provide measures of each judge's ability to discriminate between beer products. Correlation coefficients were computed to provide measures of each judge's agreement with the entire panel. The evaluation procedure was applied to five sets of panel data each covering about four months of testing. The eight most frequently tasted brands were used for the evaluation. Both measures can be used individually or in combination to identify judges for retraining or to eliminate judges from specific tests for which they are not suited. Consistency in overall panel performance and judge performance could be observed from time trends in the F ratios and correlation coefficients. With each measure it was possible to determine differences in the value or usefulness of the various attribute scales for detecting differences between the brands tested. The potential for improving the panel's ability to discriminate among brands by selection of judges based on correlation coefficients was demonstrated. Improved panel performance was not observed when selection of judges was made based on F ratios.

Keywords: Beer, Descriptive analysis, Judge performance, Panel performance, Scale performance, Sensory evaluation