Comments (4)
In principle, scaling will deemphasize high latitudes and regions that tend to be associated with natural modes of variability. This matters if you're trying to make sure that you capture certain things within the first few modes. We're not interested in truncating after three modes, so I strongly suspect that it doesn't matter for our purposes. Thankfully, this is an easy thing to check - run it with scaling and without scaling, and compare the two answers. @rplzzz is that something that can be done relatively easily? I'm happy to look at the output that's generated.
from fldgen.
It's easy enough in principle, but in practice it's kind of a pain. Moreover, absent a quantitative measure of the quality of the results, I'm not sure on what basis we make the decision. I'm going to try to make progress on the other tasks before I tackle this.
from fldgen.
In the original R code (in test-r), I had scaled the data when computing the EOFs:
res_EOFs <-prcomp(resids, retx = TRUE, center = FALSE, scale = TRUE)
As BK has said, this was done because there was a LOT of variance at high latitudes and that dominated the first few EOFs (when not scaled scale=FALSE
). If scale=TRUE
, then the first few EOFs were the main modes of annual variablity (ie ENSO, NAO, and some PDO-looking thing).
from fldgen.
I'm not really seeing anything like what @CLynchy described in my results. Here is EOF-1:
It's true that the north polar region is strongly represented here, but it looks a bit like the Arctic oscillation to me. The next few EOFs don't really show anything in particular going on at the poles.
In light of that, I'm going to leave out the scaling for now. We can revisit in the next iteration if we feel the need.
from fldgen.
Related Issues (20)
- clean up comments and move internal functions in normalizeresiduals.R to be external HOT 1
- fix the memory bloat of a saved emulator HOT 6
- downsized data sets to speed up testing HOT 1
- Create and archive trained emulators for popular ESMs HOT 2
- Instructions in tutorial2 are incorrect
- Add option to splice a historical scenario onto each future scenario
- Meanfield arrays are not converted back to native units. HOT 1
- Misleading documentation in generate.TP.fullgrids
- Quantile transform sometimes generates NA values
- globalop field in griddata is incorrect when grid cells are missing
- Check with full GCM data - impacts of training on full data or just land data
- Add github actions to the repo HOT 2
- Add package down to fldgen HOT 1
- 'reading and writing models works' test fails HOT 6
- remove dependency on gcammaptools HOT 1
- Problem with testing fldgen on developmental version of R HOT 8
- update stickers on the readme HOT 1
- variability in Tgav and using Hector to drive trained ESM emulators HOT 1
- Add tutorials to actually go through emulator validation HOT 2
- revisit warnings - variable labels - units HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from fldgen.