barry wrote:At least as far as drip coffee goes, you could talk to Carl Staub, since he used to play with these ideas a few years ago. He'd take a batch of underextracted coffee and mix it with a batch of overextracted coffee to come up with "correct" coffee that tasted bad.

As for espresso, I think you could taste the results in a mildly channeled shot, where part is overextracted and part underextracted.

So the refractometer would not compensate for drip extraction in which water poured copiously through the center of the coffee, but failed to extract around the edges, kind of like if one pours through a cone without stirring?

I'd say that the same would be true of gravimetrically determined extraction ratios as well. The shortcoming of all of the techniques we're discussing is that the results that they provide are based on the assumption that the extraction is uniform throughout the sample. We can make good arguments that this is not true. But that doesn't mean they are not useful techniques in the hands of a competent person who makes an effort to keep extraction flaws under control.

-Greg

barry wrote:I don't think talking about uneven extraction and its impact on a measurement system really qualifies as "weird theoretical situations". The question that I think Nick is getting to is "how does the system hold up in the real world?" instead of how it has performed under controlled testing. If Barista Jane pulls a 25-second 30ml shot which has suffered transient channeling, how will that compare in measurement to a 25-second 30ml shot which doesn't channel, recognizing that there will probably be subtle changes in dose, tamp, and/or grind between shots?

Do we have to assume competence here? I think it's a case of not throwing out the baby wid da bathwarder. Get what you can out of the technique and recognize that there are pitfalls in blind reliance on numbers. Use some good judgement.

In know, that's asking a lot, but that's the way the measurement world works.

Now my question is how good is the precision in the answer returned by the refractometer over a bunch of measurements, how good is the precision of a bunch of refractometers, and how stable are they over time. Gravimetric measurements are really cool because they are very fundamental (by mass, so first-principles). But they are time-consuming and not practical for quality control systems.

-Greg

Exactly my point! Thanks, brother Barry!

gscace wrote:The shortcoming of all of the techniques we're discussing is that the results that they provide are based on the assumption that the extraction is uniform throughout the sample. We can make good arguments that this is not true. But that doesn't mean they are not useful techniques in the hands of a competent person who makes an effort to keep extraction flaws under control.

I'm not disputing the usefulness of these techniques as an analytical tool, I'm reiterating Nick's question about "how does it taste" in relation to the analysis (which I don't find to be an unreasonable question at all), and pondering the utility of the tool in "real world" conditions. As I mentioned to you as we passed the booth in Atlanta, "those who can understand the information probably don't need the specialized software, while those who need it probably don't understand it enough to use it properly."

Conductivity meters, hydrometers, and refractometers are all useful tools in the analysis of coffee, but one must investigate and recognize where the limits of utility might be. You know that I'm not against gizmos and tools and the such, but I caution against developing a blind allegiance to "the numbers", where the attitude of "it must be good because the meter says it is" replaces "damn, this tastes great!"

Well I think that the correlation of "how does it taste" to the measurement is the whole crux of the deal. If they ain't related, then what's the point?

-Greg

In a sound system, 'perfect alignment' according to the sound software may occasionally differ from 'what sound good'. Seeing as we're gonna want to listen to the show as opposed to watch how it lines up perfectly on the laptop, I go with the latter.
The human brain is so danged complicated and sensitive that the numbers will get you to the neighborhood, but the flavor will guide you to the right place.
The same thing (sort of) applies to Sweetmaria's crema guide, and 'puckology'. All of these things may tell you something about the cup, but all of them may or may not be telling the whole story.
"It depends", is a phrase that comes up a lot when I'm training someone new...

I don't think anyone is seriously suggesting replacing taste with blind allegiance to numbers. That said I wish people had perhaps looked a little bit more at the numbers to explain why many cups of coffee brewed in an updosed fashion on various brewers started well, but cooled and ended up more than a little disappointing.

What interests and excites me about measurement and the data you could get is the potential for insight into the process, and better understanding where changes in the coffee that come with an altered variable actually come from.

I might be very happy with how my espresso tastes, but closer analysis may suggest possibilities that may improve it further that I might not have been nudged and guided towards without cold, emotionless data suggesting so.

There are so many interesting experiments in all this that could produce data that could help us all better understand how to diagnose bad shots better and to achieve frustratingly elusive espresso.

barry wrote:"those who can understand the information probably don't need the specialized software, while those who need it probably don't understand it enough to use it properly."

To me, espresso is such a mystery. Each coffee is so different, each roast is so different, each day removed from the roast day brings changes, every change in dose reveals or conceals a coffee nuance.... Do you really mean to say that you understand all this so completely, and that you have no interest in a tool that might shed just a little more insight into the extraction process?

barry wrote:I caution against developing a blind allegiance to "the numbers", where the attitude of "it must be good because the meter says it is"

It's NOT ABOUT blind allegiance to any particular number. It's about being tired of NOT KNOWING WHY changing this variable or that one makes the espresso so different.

A few posts back you and Nick seemed interested in seeing what this system could do. Yet now you guys seem only interested in coming up with ways to "fool" it or reasons why it won't work. Weird.

AndyS wrote:A few posts back you and Nick seemed interested in seeing what this system could do. Yet now you guys seem only interested in coming up with ways to "fool" it or reasons why it won't work. Weird.

Well, no, Andy. We put forward a known, real-life extraction problem and wondered how it was handled and how well it was handled. Not weird at all. Curious.

King Seven wrote:I don't think anyone is seriously suggesting replacing taste with blind allegiance to numbers.

I know, but I also know what happened with the LM Chronos machines, and what I've personally seen happen with PID machines.

What interests and excites me about measurement and the data you could get is the potential for insight into the process, and better understanding where changes in the coffee that come with an altered variable actually come from.

Agreed wholeheartedly. I've spent a fair amount of time down that rabbit hole.