Test Strategy
Given the limited time for our panel, we chose a very simple single elimination strategy, what we called "pick the loser." Each round the tasters would pick the sample that would be eliminated; the rest would advance to the next round. That is:
- Round 1, Flight 1: coffees 1, 2, and 3
Round 1, Flight 2: coffees 4, 5, and 6
Round 2, Flight 1: two coffees from Round 1, Flight 1
Round 2, Flight 2: two coffees from Round 1, Flight 2
Final round: winner of Round 2, Flight 1 versus winner of Round 2, Flight 2.
For each sample, we prepared three cups and cupped them using Counter Culture's standard form (fragrance, aroma, break, brightness, flavor, body, aftertaste). In addition to taste notes, each taster selected a "loser" for each round.
Results:
Round 1, Flight 1: coffees 1, 2, and 3
We expected this taste test to be difficult, but it proved otherwise. From samples 1, 2, and 3, only 2 advanced to the next round by unanimous vote. My own notes for the losers included damning terms like earthy, flat, bitter, wet hay... not a good start.
Round 1, Flight 2: coffees 4, 5, and 6
While not as bad as the other flight, it was nearly unanimous that only sample 5 should advance. Sample 4 garnered one vote, so the others grudgingly agreed to advance it to the next round.
Round 2, Flight 1: coffee 2
No need to repeat since its competitors were eliminated by clear majority vote.
Round 2, Flight 2: coffees 4 and 5
Since there was only three competitors remaining and time was running out, we decided to advance both of these without another taste test.
Final round: coffees 2, 4, and 5
At last a close call! Originally there were six tasters, but as we were running late, one of the attendees for the public Friday cupping arrived. Thus the seven tasters sampled the coffees and there was a near split decision for the winner:
- 3 votes for coffee 2
4 votes for coffee 5
0 votes for coffee 4
I believe our hosts felt a short moment of trepidation as we checked if their roasted coffee was among the finalists. With a sigh of relief, indeed coffee 2 was their sample. We only had a few minutes to discuss the rationale behind our votes. I was among the tasters that picked the Behmor sample #5 over Counter Culture's sample #2. It was a lighter roast and I thought it captured the varietal characteristics of a Yirgacheffe. Others preferred the higher body and superior balance of Counter Culture's rendition.
Closing Comments:
I expected it would be difficult to discern the different roasts, but it turned out to be easy: Of the five samples from the Behmor, only two were drinkable. I will defer to Mike for an explanation of how the samples were roasted.
), I would have tossed two of the roasts as being way too grassy and thin for me. The rest would have been acceptable. One disclaimer though, I am an espresso drinker. Tasting coffee's without being squeezed through a portafilter is pretty new ground for me.
