Ep.6 How to fine tune a weather foundation model to hydrological variables?

This research evaluates the performance of the Aurora weather foundation model by using lightweight decoders to predict hydrological and energy variables not included in its original training. The study highlights that this decoder-based approach significantly reduces training time and memory requirements compared to fine-tuning the entire model, while still achieving strong accuracy. A key finding is that decoder accuracy is influenced by the physical correlation between the new variables and those initially used for pretraining, suggesting that Aurora's latent space effectively captures meaningful physical relationships. The authors argue that the ability to extend foundation models to new variables without full fine-tuning is an important quality metric for Earth sciences, pro ...