Comments (3)
Scope
This group will focus on investigating testing frameworks to be applied for FIMS. We aim to discuss how to compare FIMS model runs with previous FIMS model versions, other modeling platforms, and true values from operating models through various tests. We plan to discuss error checks for FIMS input and output (i.e., run-time testing) but will check with the input/output file and type structure group first to avoid overlap. More specifically, we will:
1) share testing experience and review test cases from various platforms (stock assessment platforms and other software projects). We can compile a list of examples and discuss how to set up a testing framework structure, how often to run each type of test, and how to automate acceptance tests. For automated acceptance tests, we can discuss how to create expectation and evaluation criteria (e.g., tolerance value).
2) discuss various types of tests that could be useful for FIMS development. For example, why, who, when, and how to conduct unit tests, functional tests, integrated tests, regression tests, compatibility tests, and one-off tests (e.g., for replicating and fixing user-reported bugs). We plan to provide a glossary of terms and simple examples for each type of test. We can work with @Andrea-Havron-NOAA and see how tests can be implemented across different software languages under consideration for FIMS.
3) discuss FIMS test procedures. For example, draft a test procedure template and discuss the steps for conducting individual tests.
from fims-planning.
I encourage feedback on this topic from @k-doering-NOAA as she has set up a highly functional test system using Jenkins for Stock Synthesis
from fims-planning.
@Rick-Methot-NOAA , luckily I asked to join this group with Bai already!
I added @Bai-Li-NOAA and myself to assignees to indicate we are planning on participating in this group (not sure if there is a better way to do this). Feel free to assign yourself, too if anyone else wanted to join this investigation group.
from fims-planning.
Related Issues (20)
- Fill out requirements spreadsheet - SEFSC
- Fill out requirements spreadsheet - SWFSC
- Compile center provided requirements into mind map
- Flesh out "flexible forms and parameterization" requirements in the doc:
- Revisit prioritization criteria and scheme HOT 3
- move the requirements doc from your group into the FIMS/Requirements google drive HOT 3
- Investigation group idea: I/O file type and structure HOT 4
- Investigation group idea: collaborative workflow HOT 6
- Investigation group: FIMS software platform
- FIMS software specification document
- FIMS test specification
- FIMS File i/o specification
- FIMS collaborative workflow description HOT 3
- investigation group idea: how to validate new features HOT 10
- How to nest setting seeds to compare simulations when testing HOT 14
- Where does dimension folding occur - in TMB or C++? HOT 1
- Automated workflow to style code HOT 5
- Automated workflow to document code and update web sites HOT 3
- Fill out requirements spreadsheet - NEFSC HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from fims-planning.