how science is done
Irrelevant as DePreSys only passed tests for skill in the first 1-4 years.
Hmm.
Should I believe you? Or should I believe
the guys who published this in Science:
back-peddle noted
You said something about DePreSys. I noted that the authors of DePreSys contradict you. You called that a "back-peddle".
Had you called it a back-pedal, I'd say you don't know the meaning of the word. As it is, I don't know the meaning of your word.
This supports my contention that whatever value exists here is in the original work by DePreSys not you contention that comparing that comparing it's performance to statistical models is somehow important.
Noe about that, are you ever going to provide some positive evidence for your assertion that comparing statistical models to physical models over short periods has value, and are you going to tell us what that value is or are you going to continue to dodge the issue?
It has to do with how science is done.
Scientists are always looking for ways to test their hypotheses, theories, and models. The fancy-pants word for this is "falsification". The popular literature would have you believe falsification involves two theories meeting on the street at high noon. When the dust clears, only one is left standing.
With exceedingly rare exceptions, that's not how science works. In reality, falsification is mostly about testing minor details and the limits of theories and models. That's especially true with models of complex systems, which are useful precisely because they are greatly simplified abstractions of the systems they model. We
know these models must have limited domains of applicability. To learn what those limits are, the models must be tested.
DePreSys is that kind of model. Its avowed purpose is to explore the feasibility of
near-term climate predictions, up to a decade in advance. To learn how well (or even whether) DePreSys works, and at what time scales, it must be tested.
Smith et al. tested the predictive skill of DePreSys by comparing its hindcasts to a deliberately crippled version of DePreSys itself. DePreSys did significantly better. That establishes some degree of predictive skill,
provided the crippled version wasn't doing worse than chance. It seems reasonable to assume that proviso, because doing significantly worse than chance would itself require anti-predictive skill, but it isn't hard to understand why scientists prefer tests that lead to more direct inference of predictive skill.
Fildes and Kourentzes performed that more direct test. To perform that test, they needed data that could be provided only by the authors of DePreSys. Did Doug Smith and the other authors say this new testing was redundant? Did Doug Smith object because Fildes and Kourentzes "lacked the requisite understanding of the subject" and don't have experience with physical modeling? Did Doug Smith complain about Fildes's association with "an off discipline journal"?
Evidently not:
Fildes and Kourentzes said:
We would like to thank Doug Smith for both supplying us with the data on which this paper is based and helping us to translate the language of climatologists into something closer to that of forecasters.
Doug Smith wasn't surprised when Fildes and Kourentzes found that DePreSys has considerably more predictive skill than random walks at time scales going out to ten years, but some people (you, for example) were surprised by that result. The authors of denialist blogs would also have been surprised, had they read and understood the paper whose results they're misrepresenting.
I doubt whether very many climate scientists were surprised. If any were, they learned something. In science, learning something is a good thing.