Comments (3)
Borda
commented on May 15, 2024
seems GH CLI does not offer a simple list of changed files, but this could work:
git --no-pager diff --name-only FETCH_HEAD $(git merge-base FETCH_HEAD main)see: https://stackoverflow.com/a/25071749/4521646
OR from the same discussion use GH API:
get https://api.github.com/repos/PyTorchLightning/ecosystem-ci/pulls/7/files
which gives:
[{
"sha": "fa3ac999d0ae5a728123ab555262ed68a1071efa",
"filename": ".azure/ci-testig-parameterized.yml",
"status": "modified",
"additions": 1,
"deletions": 0,
"changes": 1,
"blob_url": "https://github.com/PyTorchLightning/ecosystem-ci/blob/1cca821a70316c64dd1f6792971b0c2c0320de02/.azure/ci-testig-parameterized.yml",
"raw_url": "https://github.com/PyTorchLightning/ecosystem-ci/raw/1cca821a70316c64dd1f6792971b0c2c0320de02/.azure/ci-testig-parameterized.yml",
"contents_url": "https://api.github.com/repos/PyTorchLightning/ecosystem-ci/contents/.azure/ci-testig-parameterized.yml?ref=1cca821a70316c64dd1f6792971b0c2c0320de02",
"patch": "@@ -21,3 +21,4 @@ jobs:\n - \"PyTorchLightning/metrics_pl-release.yaml\"\n - \"PyTorchLightning/flash_pl-master.yaml\"\n - \"PyTorchLightning/flash_pl-release.yaml\"\n+ - \"NVIDIA/nemo-release.yaml\""
},
{
"sha": "4c4f6749721d54df289ddf72a53325016f1b9b87",
"filename": ".github/workflows/ci_testing.yml",
"status": "modified",
"additions": 1,
"deletions": 0,
"changes": 1,
"blob_url": "https://github.com/PyTorchLightning/ecosystem-ci/blob/1cca821a70316c64dd1f6792971b0c2c0320de02/.github/workflows/ci_testing.yml",
"raw_url": "https://github.com/PyTorchLightning/ecosystem-ci/raw/1cca821a70316c64dd1f6792971b0c2c0320de02/.github/workflows/ci_testing.yml",
"contents_url": "https://api.github.com/repos/PyTorchLightning/ecosystem-ci/contents/.github/workflows/ci_testing.yml?ref=1cca821a70316c64dd1f6792971b0c2c0320de02",
"patch": "@@ -27,6 +27,7 @@ jobs:\n - {os: \"ubuntu-20.04\", python-version: \"3.8\", config: \"PyTorchLightning/metrics_pl-master.yaml\"}\n - {os: \"ubuntu-20.04\", python-version: \"3.9\", config: \"PyTorchLightning/transformers_pl-master.yaml\"}\n - {os: \"ubuntu-20.04\", python-version: \"3.8\", config: \"PyTorchLightning/flash_pl-master.yaml\"}\n+ - {os: \"ubuntu-20.04\", python-version: \"3.8\", config: \"NVIDIA/nemo-release.yaml\"}\n exclude:\n - {os: \"windows-2019\", config: \"PyTorchLightning/transformers_pl-release.yaml\"}\n # Timeout: https://stackoverflow.com/a/59076067/4521646"
},
{
"sha": "390b3284d872b95626095a986199acc18fe601f0",
"filename": "configs/NVIDIA/nemo-release.yaml",
"status": "added",
"additions": 24,
"deletions": 0,
"changes": 24,
"blob_url": "https://github.com/PyTorchLightning/ecosystem-ci/blob/1cca821a70316c64dd1f6792971b0c2c0320de02/configs/NVIDIA/nemo-release.yaml",
"raw_url": "https://github.com/PyTorchLightning/ecosystem-ci/raw/1cca821a70316c64dd1f6792971b0c2c0320de02/configs/NVIDIA/nemo-release.yaml",
"contents_url": "https://api.github.com/repos/PyTorchLightning/ecosystem-ci/contents/configs/NVIDIA/nemo-release.yaml?ref=1cca821a70316c64dd1f6792971b0c2c0320de02",
"patch": "@@ -0,0 +1,24 @@\n+target_repository:\n+ HTTPS: https://github.com/NVIDIA/NeMo.git\n+ # checkout a particular branch or a tag\n+ checkout: main\n+ # define installing package extras\n+ install_extras: all\n+ # copy some test from the target repository\n+ copy_tests:\n+ - tests\n+\n+before_install:\n+ - sudo apt-get install libsndfile1\n+\n+dependencies:\n+ - name: pytorch-lightning\n+ HTTPS: https://github.com/PyTorchLightning/pytorch-lightning.git\n+ checkout: release/1.5.x\n+ install_extras: loggers\n+\n+testing:\n+ dirs:\n+ - tests\n+ # additional pytest arguments\n+ pytest_args: -m \"not pleasefixme and not torch_tts\" --cpu --with_downloads --relax_numba_compat"
},
{
"sha": "5699b2c67914e648e1ec6fbb13c86729e0d34bf8",
"filename": "requirements.txt",
"status": "modified",
"additions": 1,
"deletions": 0,
"changes": 1,
"blob_url": "https://github.com/PyTorchLightning/ecosystem-ci/blob/1cca821a70316c64dd1f6792971b0c2c0320de02/requirements.txt",
"raw_url": "https://github.com/PyTorchLightning/ecosystem-ci/raw/1cca821a70316c64dd1f6792971b0c2c0320de02/requirements.txt",
"contents_url": "https://api.github.com/repos/PyTorchLightning/ecosystem-ci/contents/requirements.txt?ref=1cca821a70316c64dd1f6792971b0c2c0320de02",
"patch": "@@ -1,3 +1,4 @@\n+Cython # some projects need it for compiling\n fire>=0.4\n PyYAML>=5.3\n coverage>=5.0"
}
]
from ecosystem-ci.
Borda
commented on May 15, 2024
Github actions:
we can set one job for all which would be determining changed configs and set it as output,
- https://newbedev.com/using-output-from-a-previous-job-in-a-new-one-in-a-github-action
- https://stackoverflow.com/a/61236803/4521646
with if job run:
- https://docs.github.com/en/actions/learn-github-actions/workflow-syntax-for-github-actions
- https://docs.github.com/en/actions/learn-github-actions/expressions#example-using-an-array
- https://stackoverflow.com/questions/65653291/conditional-to-check-if-a-string-is-included-in-a-list
from ecosystem-ci.
Borda
commented on May 15, 2024
Azure pipelines:
conditional skip for jobs:
- https://docs.microsoft.com/en-us/azure/devops/pipelines/process/conditions
- https://docs.microsoft.com/en-us/azure/devops/pipelines/process/expressions
sharing job outputs:
from ecosystem-ci.
Related Issues (13)
- enable email notifications
- mention contact person in Slack message
- Slack action is limited to Linux only HOT 1
- enable make for all configs HOT 3
- catching also PL deprecation warnigs HOT 1
- Create a GitHub issue if compatibility breaks HOT 3
- Test the ecosystem integration against GPU containers HOT 2
- Conda environment for specific dependencies HOT 1
- Add an option to specify the installation path of target_repository HOT 1
- Produce collection of passing integrations HOT 1
- isolate tests & extra dependencies
- expose other build commands
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ecosystem-ci.