by Ken Fox on Sat Sep 18, 2010 12:38 am
If you have never participated in a blind tasting type experiment, it is an enormous eye-opener, no matter what it is that you are tasting.
Before the various espresso blind tasting experiments were even conceived, which have looked at the differences between espresso machine pumps (vibratory vs. rotary) and previously frozen vs. never frozen coffee, I had the benefit of two prior sets of experiences. The least important was exposure to carefully designed experiments tested with statistics in college, and the more significant was a year and a half spent on a tasting panel for a wine publication back in the early 1980s when I lived in San Diego. Although the latter experience was more informal and not statistically analyzed, it was composed of a group of about 16 people (about 12 of whom would show up on any given weekly or more frequent) tasting session, all of whom collected fine wines and by definition had at least somewhat of a wine palate.
The publication was the California Grapevine, which to my knowledge is still being published. Back in its day it actually had a following like Parker's Wine Advocate has today, but I'd imagine it has since fallen into obscurity. The publisher/owner would have 12 wines each night that he'd pre-selected, that were usually of the same type, from the same area, however he often threw in a "ringer" or two. A "ringer" in this parlance is, for example, a bottle of a red Bordeaux thrown into a tasting of California Cabernets, to see if the blind tasters could tell the difference. Often we knew that there was a ringer, and in any case, even if we didn't know the presence of ringers was so frequent that people got used to presuming their presence even if it was not pre-announced. The wines were camouflaged in brown paper bags and known to us tasters as #s 1 to 12. They were only identified later, after we had discussed them as a group, which was preceded by written "ballots" being passed in right after the blind tastings.
It was quite an education doing this blind tasting gig about 6x a month, over an 18 month span, watching both my own behavior and that of the others in the group. Again, this was an experienced group of wine drinkers all of whom had wine cellars and who were serious wine collectors. Every tasting at least one person (often more) would very seriously embarrass themselves, proclaiming they had found a "ringer" and it was XXX wine and it was this and that from this and that other location than the other wines came from. Occasionally the person was right, and it was really impressive, but more often the person or persons just made fools out of themselves. You could also easily embarrass yourself by preferring what should have been an obviously inferior wine to one considered to be "top of class." And I'd be lying if I said that I wasn't shown to be a fool in this enterprise more times than I would like to remember.
Don't ever overestimate your own tasting ability. Don't ever imagine that you are immune from this sort of potential embarrassment. If whatever it is that is being compared is not compared blinded, in a test design that doesn't prejudice what you will think when you judge something, then the results are totally meaningless. And I don't care what someone thinks of their own tasting abilities. I don't care if someone thinks they are experienced in what they are tasting. I don't care if they think they are "supertasters." Very few people will not be humbled by a real, extensive, experience with blind tasting.
ken
What, me worry?
Alfred E. Neuman, 1955