exawind / exawind-builder Goto Github PK

View Code? Open in Web Editor NEW

3.0 3.0 11.0 6.51 MB

Scripts to help building Exawind codes on various systems

Home Page: https://exawind.github.io/exawind-builder/

License: Apache License 2.0

Shell 73.53% Ruby 0.26% Python 26.20%

build cmake exawind exawind-builder hpc

exawind-builder's People

Contributors

Stargazers

Watchers

Forkers

aprokop jhux2 alanw0 gantech jamelvin jvo1012 tasmith4 ashesh2512 lawrenceccheung sayerhs paulmullowney

exawind-builder's Issues

The text regarding symlinks in advanced dos seems off

ln -s packages.yaml ${HOME}/.spack/$(spack arch -p)/

does not work, as it will just create a symlink there that points to itself. Need to resolve the full path to the directory inside exawind-builder that has the file.

How is exawind_cmake_full used?

I see that function, but it does not seem to be called anywhere. Is a user script supposed to call it?

Does nalu-wind need to load modules?

Right now, nalu-wind tries to load non-standard modules like trilinos, yaml-cpp, etc. This breaks on cori. I expect that because paths are passed through cmake arguments, that is unnecessary. In addition, loading of hypre, tioga, should really depend on whether Hypre or Tioga are enabled in cmake arguments, which is tricky.

Package name of netcdf has changed in spack

Package netcdf is now netcdf-c in spack. At minimum, this affects the following:

spack install netcdf command in bootstrap.sh
netcdf descriptions in platform specific packages.yaml files

EXAWIND_NUM_JOBS does not work

@sayerhs

I tried both

EXAWIND_NUM_JOBS=16

and

export EXAWIND_NUM_JOBS=16

in my trilinos script on cori, but I still see it compiling with just 8.

Clang build issues on Eagle

On eagle, using /projects/hfm/shreyas/exawind/scripts/nalu-wind-clang.sh:

==> Loading options from /projects/hfm/shreyas/exawind-2020-08/exawind-config-eagle.sh
==> Setting TMPDIR=/scratch/mhenryde/.tmp
==> Loading options from /home/mhenryde/exawind/source/nalu-wind/build/exawind-config.sh
==> Using modules: /nopt/nrel/ecom/hpacf/software/2020-07/spack/share/spack/modules/linux-centos7-skylake_avx512/clang-7.0.1
==> gcc/8.4.0 = /nopt/nrel/ecom/hpacf/compilers/2020-07/spack/opt/spack/linux-centos7-skylake_avx512/gcc-8.4.0/gcc-8.4.0-2a3vha6hlw4xc5ja3jyhr7huzaxuw2kt
==> llvm = /nopt/nrel/ecom/hpacf/compilers/2020-07/spack/opt/spack/linux-centos7-skylake_avx512/gcc-8.4.0/llvm-10.0.0-rdkkzyvtbotoq4xjatwsb5eqyindy4sr
Lmod has detected the following error:  The following module(s) are unknown: "mpt/2.22"

Please check the spelling or version number. Also try "module spider ..."
It is also possible your cache file is out-of-date; it may help to try:
  $ module --ignore-cache load "mpt/2.22"

Also make sure that all modulefiles written in TCL start with the string #%Module



==> mpt/2.22: Cannot find standard module; attempting to detect local install
==> mpt/2.22: Set MPT_ROOT_DIR to provide the exact location
==> WARNING! Cannot load dependency: mpt/2.22
==> mpt/2.22 =
==> cmake = /nopt/nrel/ecom/hpacf/compilers/2020-07/spack/opt/spack/linux-centos7-skylake_avx512/gcc-8.4.0/cmake-3.17.3-fonvmr2wiznawln3zn3m5at5pvdgkyxv
==> git = /nopt/nrel/ecom/hpacf/compilers/2020-07/spack/opt/spack/linux-centos7-skylake_avx512/gcc-8.4.0/git-2.27.0-od5tlx3xitqxg37l2rdgd56x6cwgsnnf
==> binutils = /nopt/nrel/ecom/hpacf/compilers/2020-07/spack/opt/spack/linux-centos7-skylake_avx512/gcc-8.4.0/binutils-2.34-2drppsfmkeudqr3ll7zz7pqxlsszuh4b
Lmod has detected the following error:  The following module(s) are unknown: "netlib-lapack/3.8.0"

Please check the spelling or version number. Also try "module spider ..."
It is also possible your cache file is out-of-date; it may help to try:
  $ module --ignore-cache load "netlib-lapack/3.8.0"

Also make sure that all modulefiles written in TCL start with the string #%Module



==> netlib-lapack: Cannot find standard module; attempting to detect local install
==> netlib-lapack: Set NETLIB_LAPACK_ROOT_DIR to provide the exact location
==> WARNING! Cannot load dependency: netlib-lapack
==> netlib-lapack/3.8.0 =
which: no mpifort in (/nopt/nrel/ecom/hpacf/compilers/2020-07/spack/opt/spack/linux-centos7-skylake_avx512/gcc-8.4.0/binutils-2.34-2drppsfmkeudqr3ll7zz7pqxlsszuh4b/bin:/nopt/nrel/ecom/hpacf/compilers/2020-07/spack/opt/spack/linux-centos7-skylake_avx512/gcc-8.4.0/git-2.27.0-od5tlx3xitqxg37l2rdgd56x6cwgsnnf/bin:/nopt/nrel/ecom/hpacf/compilers/2020-07/spack/opt/spack/linux-centos7-skylake_avx512/gcc-8.4.0/cmake-3.17.3-fonvmr2wiznawln3zn3m5at5pvdgkyxv/bin:/nopt/nrel/ecom/hpac
f/compilers/2020-07/spack/opt/spack/linux-centos7-skylake_avx512/gcc-8.4.0/llvm-10.0.0-rdkkzyvtbotoq4xjatwsb5eqyindy4sr/bin:/nopt/nrel/ecom/hpacf/compilers/2020-07/spack/opt/spack/linux-centos7-skylake_avx512/gcc-8.4.0/gcc-8.4.0-2a3vha6hlw4xc5ja3jyhr7huzaxuw2kt/bin:/projects/hfm/shreyas/exawind-2020-08/source/ninja:/home/mhenryde/.zplug/bin:/opt/clmgr/sbin:/opt/clmgr/bin:/opt/sgi/sbin:/opt/sgi/bin:/nopt/nrel/utils/bin:/nopt/slurm/current/bin:/home/mhenryde/builds/fasd:/ho
me/mhenryde/Nek5000/bin:/home/mhenryde/ccls/Release:/home/mhenryde/bin:/home/mhenryde/mypython:/home/mhenryde/.local/bin:/nopt/xalt/xalt/bin:/home/mhenryde/miniconda3/condabin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/c3/bin:/opt/ibutils/bin:/sbin:/bin:/home/mhenryde/.fzf/bin)
which: no mpifort in (/nopt/nrel/ecom/hpacf/compilers/2020-07/spack/opt/spack/linux-centos7-skylake_avx512/gcc-8.4.0/binutils-2.34-2drppsfmkeudqr3ll7zz7pqxlsszuh4b/bin:/nopt/nrel/ecom/hpacf/compilers/2020-07/spack/opt/spack/linux-centos7-skylake_avx512/gcc-8.4.0/git-2.27.0-od5tlx3xitqxg37l2rdgd56x6cwgsnnf/bin:/nopt/nrel/ecom/hpacf/compilers/2020-07/spack/opt/spack/linux-centos7-skylake_avx512/gcc-8.4.0/cmake-3.17.3-fonvmr2wiznawln3zn3m5at5pvdgkyxv/bin:/nopt/nrel/ecom/hpac
f/compilers/2020-07/spack/opt/spack/linux-centos7-skylake_avx512/gcc-8.4.0/llvm-10.0.0-rdkkzyvtbotoq4xjatwsb5eqyindy4sr/bin:/nopt/nrel/ecom/hpacf/compilers/2020-07/spack/opt/spack/linux-centos7-skylake_avx512/gcc-8.4.0/gcc-8.4.0-2a3vha6hlw4xc5ja3jyhr7huzaxuw2kt/bin:/projects/hfm/shreyas/exawind-2020-08/source/ninja:/home/mhenryde/.zplug/bin:/opt/clmgr/sbin:/opt/clmgr/bin:/opt/sgi/sbin:/opt/sgi/bin:/nopt/nrel/utils/bin:/nopt/slurm/current/bin:/home/mhenryde/builds/fasd:/ho
me/mhenryde/Nek5000/bin:/home/mhenryde/ccls/Release:/home/mhenryde/bin:/home/mhenryde/mypython:/home/mhenryde/.local/bin:/nopt/xalt/xalt/bin:/home/mhenryde/miniconda3/condabin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/c3/bin:/opt/ibutils/bin:/sbin:/bin:/home/mhenryde/.fzf/bin)
which: no mpicc in (/nopt/nrel/ecom/hpacf/compilers/2020-07/spack/opt/spack/linux-centos7-skylake_avx512/gcc-8.4.0/binutils-2.34-2drppsfmkeudqr3ll7zz7pqxlsszuh4b/bin:/nopt/nrel/ecom/hpacf/compilers/2020-07/spack/opt/spack/linux-centos7-skylake_avx512/gcc-8.4.0/git-2.27.0-od5tlx3xitqxg37l2rdgd56x6cwgsnnf/bin:/nopt/nrel/ecom/hpacf/compilers/2020-07/spack/opt/spack/linux-centos7-skylake_avx512/gcc-8.4.0/cmake-3.17.3-fonvmr2wiznawln3zn3m5at5pvdgkyxv/bin:/nopt/nrel/ecom/hpacf/
compilers/2020-07/spack/opt/spack/linux-centos7-skylake_avx512/gcc-8.4.0/llvm-10.0.0-rdkkzyvtbotoq4xjatwsb5eqyindy4sr/bin:/nopt/nrel/ecom/hpacf/compilers/2020-07/spack/opt/spack/linux-centos7-skylake_avx512/gcc-8.4.0/gcc-8.4.0-2a3vha6hlw4xc5ja3jyhr7huzaxuw2kt/bin:/projects/hfm/shreyas/exawind-2020-08/source/ninja:/home/mhenryde/.zplug/bin:/opt/clmgr/sbin:/opt/clmgr/bin:/opt/sgi/sbin:/opt/sgi/bin:/nopt/nrel/utils/bin:/nopt/slurm/current/bin:/home/mhenryde/builds/fasd:/home
/mhenryde/Nek5000/bin:/home/mhenryde/ccls/Release:/home/mhenryde/bin:/home/mhenryde/mypython:/home/mhenryde/.local/bin:/nopt/xalt/xalt/bin:/home/mhenryde/miniconda3/condabin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/c3/bin:/opt/ibutils/bin:/sbin:/bin:/home/mhenryde/.fzf/bin)
which: no mpic++ in (/nopt/nrel/ecom/hpacf/compilers/2020-07/spack/opt/spack/linux-centos7-skylake_avx512/gcc-8.4.0/binutils-2.34-2drppsfmkeudqr3ll7zz7pqxlsszuh4b/bin:/nopt/nrel/ecom/hpacf/compilers/2020-07/spack/opt/spack/linux-centos7-skylake_avx512/gcc-8.4.0/git-2.27.0-od5tlx3xitqxg37l2rdgd56x6cwgsnnf/bin:/nopt/nrel/ecom/hpacf/compilers/2020-07/spack/opt/spack/linux-centos7-skylake_avx512/gcc-8.4.0/cmake-3.17.3-fonvmr2wiznawln3zn3m5at5pvdgkyxv/bin:/nopt/nrel/ecom/hpacf
/compilers/2020-07/spack/opt/spack/linux-centos7-skylake_avx512/gcc-8.4.0/llvm-10.0.0-rdkkzyvtbotoq4xjatwsb5eqyindy4sr/bin:/nopt/nrel/ecom/hpacf/compilers/2020-07/spack/opt/spack/linux-centos7-skylake_avx512/gcc-8.4.0/gcc-8.4.0-2a3vha6hlw4xc5ja3jyhr7huzaxuw2kt/bin:/projects/hfm/shreyas/exawind-2020-08/source/ninja:/home/mhenryde/.zplug/bin:/opt/clmgr/sbin:/opt/clmgr/bin:/opt/sgi/sbin:/opt/sgi/bin:/nopt/nrel/utils/bin:/nopt/slurm/current/bin:/home/mhenryde/builds/fasd:/hom
e/mhenryde/Nek5000/bin:/home/mhenryde/ccls/Release:/home/mhenryde/bin:/home/mhenryde/mypython:/home/mhenryde/.local/bin:/nopt/xalt/xalt/bin:/home/mhenryde/miniconda3/condabin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/c3/bin:/opt/ibutils/bin:/sbin:/bin:/home/mhenryde/.fzf/bin)
==> No user environment actions defined
==> Loading dependencies for nalu-wind...
Lmod has detected the following error:  The following module(s) are unknown: "trilinos/develop"

Please check the spelling or version number. Also try "module spider ..."
It is also possible your cache file is out-of-date; it may help to try:
  $ module --ignore-cache load "trilinos/develop"

Also make sure that all modulefiles written in TCL start with the string #%Module

etc...

Recommend Projects

React

A declarative, efficient, and flexible JavaScript library for building user interfaces.
Vue.js

🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
TensorFlow

An Open Source Machine Learning Framework for Everyone
Django

The Web framework for perfectionists with deadlines.
Laravel

A PHP framework for web artisans
D3

Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

javascript

JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
web

Some thing interesting about web. New door for the world.
server

A server is a program made to process requests and deliver data to clients.
Machine learning

Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Visualization

Some thing interesting about visualization, use data art
Game

Some thing interesting about game, make everyone happy.

Recommend Org

Facebook

We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft

Open source projects and samples from Microsoft.
Google

Google ❤️ Open Source for everyone.
Alibaba

Alibaba Open Source for everyone
D3

Data-Driven Documents codes.
Tencent

China tencent open source team.