undefined | Better HN

0 pointsmirimir7y ago0 comments

Of course it's done! For one thing, you don't need to fit your model to the full historical record. So you can use more recent data to validate models fit to older data. It's like training AI.

But yes, models fit to the full historical record can only be validated in real time.

0 comments

thaumasiotes7y ago

> So you can use more recent data to validate models fit to older data. It's like training AI.

This doesn't work in an adversarial context; there's no guarantee that the modeler didn't cheat.

mirimirOP7y ago

Hey, science is adversarial. Climate datasets are publicly available. And there are mechanisms to detect and punish cheating.

thaumasiotes7y ago

Science as practiced is generally not adversarial. Witness the reproduction crisis.

1 more reply

j / k navigate · click thread line to collapse

0 pointsmirimir7y ago0 comments

Of course it's done! For one thing, you don't need to fit your model to the full historical record. So you can use more recent data to validate models fit to older data. It's like training AI.

But yes, models fit to the full historical record can only be validated in real time.

0 comments

thaumasiotes7y ago

> So you can use more recent data to validate models fit to older data. It's like training AI.

This doesn't work in an adversarial context; there's no guarantee that the modeler didn't cheat.

mirimirOP7y ago

Hey, science is adversarial. Climate datasets are publicly available. And there are mechanisms to detect and punish cheating.

thaumasiotes7y ago

Science as practiced is generally not adversarial. Witness the reproduction crisis.

1 more reply

j / k navigate · click thread line to collapse