OK, so here are the results.
I'll adopt a simple addition of the 3 preferences, lowest score determines rank
#1: B (12oz load) 1, 2, 2 5 pts [1c 14:00, 2c 18:10] 39 / 52 (13)
#2: A (8oz load) 2, 4, 1 7 pts [1c 11:00, 2c 14:25] 37 / 48 (11)
#3 (tie): C (4oz load) 3, 3, 3 9 pts [1c 8:25, 2c 10:25] 35 / 47 (12)
#3 (tie): D (16oz load) 4, 1, 4 9 pts [1c 16:00, 2c 19:55] 37 / 48 (11)
At least from order of preference, we see some consistency with what has been reported anecdotally: 4oz and 16oz loads are less suitable for this roaster, and can have taste defects. It may be that the 4oz loads roast too fast, and the 16oz loads roast too slow. With only one outlier, both samples were consistently rated in the bottom half of the four samples.
Which leaves the 8 and 12 oz loads. Inversely, with only one outlier, both samples were consistently rated in the top half of the four samples.
I didn't see anything very interesting in the Agtron readings, except that I would have expected more of a spread difference between the shorter and longer roasts. Perhaps this has something to do with the nature of the radiant heaters.
As a point of interpretation, I can say that this Yirg bean was a little challenging, apparently harder than most of the other beans I roast. It may be that other varietals may roast better as an 8oz load, and some at 12oz. Also, we purposely chose a darker roast than normal in order to try to hit a consistent roast finish level. As is evidenced by the Agtron readings, this was achieved, and at least by visible indications was significantly more consistent than taste test 1.
I think this has been able to confirm what has been anecdotally reported: the sweet spot of this roaster is 8-12oz, and that smaller and larger load sizes may be problematic and need to be approached with caution.
It may be worth rerunning this test at a later date with a greater sample size of tasters, but I believe the conclusions are probably solid.
From here it may be interesting to run some 10oz loads through P1, P2 and one of the stepped profiles, and taste test those to see if we can hone in on any significant differences between the profiles.
HB wrote:The turnout was small last week, so the cupping was me and Counter Culture employees Mark and Nathan. We all agreed the samples were roasted darker than we preferred, but none of the roasts were rejected as was the first test go-around. Sample "B" garnered one 1st place and two 2nd place votes and was the overall winner:
- Table:
Sample Rank
------ -------
A 2, 4, 1
B 1, 2, 2
C 3, 3, 3
D 4, 1, 4
We had enough left over to run an Agtron:
- Table:
Sample Low/High
------ --------
A 37 / 48
B 39 / 52
C 35 / 47
D 37 / 48
(The first measurement is prior to grinding). I neglected to collect cupping notes. Positive comments from memory included "good chocolates and high body." Negative comments included "ashy aftertaste" and "the varietal character was lost in the roast."