mkandes / naked-singularity Goto Github PK

Context: #2

Requesting an image which builds Tensorflow 1.12, likely the mast major update of Tensorflow before the 2.0 release. This is already in progress by @mkandes .

Reintroduce a 'build' command to the naked-singularity.sh helper script that will build the latest version of a package, or a specific definition file locally; if singularity is not available, it will send definition file to remote build service (e.g., Sylabs Remote Builder, GitHub Actions CI/CD as suggested by Andreas); also try simple remote build over ssh to VM with singularity available (e.g., Jetstream2)

I was wondering if you could automatically build the containers directly on Github actions,
so I made a little test with the Ubuntu 20.04 image and it seems to be working fine:

See the workflow, from https://github.com/singularityhub/github-ci:

https://github.com/zonca/singularity_github_ci/blob/main/.github/workflows/native-install.yml

Log of a build:

https://github.com/zonca/singularity_github_ci/runs/6718361783?check_suite_focus=true

Package:

https://github.com/zonca/singularity_github_ci/runs/6718361783?check_suite_focus=true

I tested it on Expanse with:

singularity pull oras://ghcr.io/zonca/singularity_github_ci:ubuntu-20.04

Add simple tests of singularity following installation by naked-singularity.sh helper script and output the buildcfg to file

Hi,

I used to use "keras-tensorflow-gpu" loaded on comet
" /share/apps/gpu/singularity/images/keras/keras-tensorflow-gpu.simg"

With comet being decommissioned, I was hoping I can get it on Expanse, however, cannot find how to build/pull it.

Any help would be appreciated

I was building the container using the definition file comet/pytorch/pytorch-gpu.def and ran into this issue where it said git command not found.
I looked at the definition file and git wasn't being installed before the command was used.
The other issue is that mlocate is not being installed before you call the updated command near the end of the definition file.

https://github.com/hpcng/singularity
https://github.com/sylabs/singularity

Thank you for this excellent resource. Is there a location on SDSC where I can run the latest images? The images in /oasis/scratch/comet/mkandes/temp_project/singularity/images/ do not appear to be up to date; for example tensorflow-gpu.img appears to only have CUDA 8, while tensorflow-gpu.def (in this repository) appears to install CUDA 9.2

Cheers,
Chris