another_jim wrote:I guess I'm not getting a lot of feedback on the profile independent error measures. I wonder if it's worth working on.
To Espressoperson. With serial correlation (i.e if one observation is X degrees, the next one is going to be X or very close to X), measures of time on or off target can become deceptive as well.
As a correction to myself, on second thought, a standard deviation will work unmodified as a measure of accuracy. However, because of the correlated observations, calculations on how repeatable that standard deviation will be on subsequent tests will be off in an optimistic direction (that is, the number of independent readings one has gathered is less than the number of correlated observations, so any confidence interval derived using calculations based on independent observations will be too optimistic).
Howdee Jim:
Don't let my silence stop you. I've got several fish frying at the same time right now and I'm not a prolific as i could be. I think that the analysis that you propose solves a problem because it quantifies reproducibility in profiles that are not flat. It's certainly worth doing. The trick will be to get people to accept the analysis and to actually perform it. The standard won't be any good at all if people don't use it. Personally I think it supplies additional useful info, so it's worth investigating.
-Greg



