Giter Club home page Giter Club logo

Comments (12)

freddydk avatar freddydk commented on June 9, 2024 1

Could you try to add a setting to .github/AL-Go-Settings.json like this:

"runs-on": "ubuntu-latest"

and then run Update AL-Go System Files and retry?

from al-go.

freddydk avatar freddydk commented on June 9, 2024

Sorry for the delay here.
So, you have setup a StorageContext secret for delivering to storage.
Does this work during CI/CD? or does it also fail there?

from al-go.

pieter-kok avatar pieter-kok commented on June 9, 2024

Thanks for coming back on this topic.
It's correct that I have setup a StorageContext secret and this works during CI/CD. Only the release step fails.

from al-go.

freddydk avatar freddydk commented on June 9, 2024

Could you copy/paste the delivery part of CI/CD here? (so I can see the difference)
Please format as Code.

from al-go.

pieter-kok avatar pieter-kok commented on June 9, 2024

Of course. This is the output of the Deliver step of the job Deliver to Storage part of the pull request that was executed just before the failing releases.

[1](https://github.com/BluaceBV/appsourceinventorytemplates/actions/runs/7132737691/job/19425575660#step:6:1)m [2](https://github.com/BluaceBV/appsourceinventorytemplates/actions/runs/7132737691/job/19425575660#step:6:2)0s
Run microsoft/AL-Go-Actions/[email protected]
  with:
    shell: powershell
    type: CD
    projects: ["."]
    deliveryTarget: Storage
    artifacts: .artifacts
    actor: pieter-kok
    token: ***
    parentTelemetryScopeJson: 7b7d
    atypes: Apps,Dependencies,TestApps
    goLive: N
  env:
    workflowDepth: 1
    ALGoOrgSettings: {
      "CICDPushBranches": [
          "main",
          "development",
          "release/*",
          "feature/*"
      ],
      "CICDPullRequestBranches": [
          "main",
          "development"
      ],
      "ConditionalSettings": [
          {
              "branches": [
                  "development"
              ],
              "settings": {
                  "doNotPublishApps": false,
                  "doNotSignApps": false
              }
          }
      ]
  }
    ALGoRepoSettings: 
    Settings: {"keyVaultCertificateUrlSecretName":"","microsoftTelemetryConnectionString":"InstrumentationKey=84bd922[3](https://github.com/BluaceBV/appsourceinventorytemplates/actions/runs/7132737691/job/19425575660#step:6:3)-67d[4](https://github.com/BluaceBV/appsourceinventorytemplates/actions/runs/7132737691/job/19425575660#step:6:4)-4378-8[5](https://github.com/BluaceBV/appsourceinventorytemplates/actions/runs/7132737691/job/19425575660#step:6:5)90-9e4a4[6](https://github.com/BluaceBV/appsourceinventorytemplates/actions/runs/7132737691/job/19425575660#step:6:6)023be2;IngestionEndpoint=https://westeurope-1.in.applicationinsights.azure.com/","NextMajorSchedule":"0 1 20 * *","type":"AppSource App","sendExtendedTelemetryToMicrosoft":false,"appBuild":81,"installTestApps":[],"versioningStrategy":0,"installApps":[],"installTestLibraries":false,"runNumberOffset":0,"codeSignCertificatePasswordSecretName":"codeSignCertificatePassword","vsixFile":"","country":"nl","partnerTelemetryConnectionString":"","doNotRunTests":false,"githubRunner":"windows-latest","generateDependencyArtifact":true,"excludeEnvironments":[],"keyVaultCertificatePasswordSecretName":"","rulesetFile":"","licenseFileUrlSecretName":"licenseFileUrl","enableExternalRulesets":false,"memoryLimit":"","keyVaultClientIdSecretName":"","testFolders":[],"doNotBuildTests":false,"environments":[],"companyName":"","assignPremiumPlan":false,"artifact":"","ghTokenWorkflowSecretName":"ghTokenWorkflow","enableTaskScheduler":false,"enableCodeCop":false,"repoVersion":"1.6","doNotPublishApps":false,"unusedALGoSystemFiles":[],"githubRunnerShell":"powershell","appFolders":[],"runs-on":"windows-latest","cacheKeepDays":3,"bcptTestFolders":[],"updateDependencies":false,"cacheImageName":"my","treatTestFailuresAsWarnings":false,"additionalCountries":["be","fi","ro"],"enableUICop":false,"customCodeCops":[],"appDependencies":[],"doNotRunBcptTests":false,"UpdateGitHubGoSystemFilesSchedule":"0 0 1[7](https://github.com/BluaceBV/appsourceinventorytemplates/actions/runs/7132737691/job/19425575660#step:6:7) * *","appDependencyProbingPaths":[{"AuthTokenSecret":"GhTokenWorkflow","release_status":"release","repo":"https://github.com/BluaceBV/appsourcecommon","version":"latest"}],"useCompilerFolder":false,"installTestFramework":false,"keyVaultCodesignCertificateName":"","keyVaultName":"","installOnlyReferencedApps":true,"CICDPushBranches":["main","development","release/*","feature/*"],"obsoleteTagMinAllowedMajorMinor":"","applicationDependency":"1[8](https://github.com/BluaceBV/appsourceinventorytemplates/actions/runs/7132737691/job/19425575660#step:6:8).0.0.0","applicationInsightsConnectionStringSecretName":"applicationInsightsConnectionString","shell":"powershell","failOn":"error","templateUrl":"https://github.com/microsoft/AL-Go-AppSource@main","projects":[],"projectName":".","testDependencies":[],"appRevision":0,"ConditionalSettings":[{"branches":["development"],"settings":{"doNotPublishApps":false,"doNotSignApps":false}}],"codeSignCertificateUrlSecretName":"codeSignCertificateUrl","configPackages":[],"useProjectDependencies":false,"appSourceCopMandatoryAffixes":["IBLC"],"buildModes":[],"templateBranch":"","NextMinorSchedule":"0 1 1[9](https://github.com/BluaceBV/appsourceinventorytemplates/actions/runs/7132737691/job/19425575660#step:6:9) * *","installPerformanceToolkit":false,"PullRequestTrigger":"pull_request_target","CICDPullRequestBranches":["main","development"],"doNotSignApps":false,"repoName":"appsourceinventorytemplates","fullBuildPatterns":[],"alwaysBuildAllProjects":false,"skipUpgrade":false,"CurrentSchedule":"0 1 18 * *","installTestRunner":false,"adminCenterApiCredentialsSecretName":"adminCenterApiCredentials"}
    Secrets: {"StorageContext":"***"}
Run $errorActionPreference = "Stop"; $ProgressPreference = "SilentlyContinue"; Set-StrictMode -Version 2.0
  $errorActionPreference = "Stop"; $ProgressPreference = "SilentlyContinue"; Set-StrictMode -Version 2.0
  try {
    D:\a\_actions\microsoft\AL-Go-Actions\v4.0\Deliver/Deliver.ps1 -actor $ENV:_actor -token $ENV:_token -parentTelemetryScopeJson $ENV:_parentTelemetryScopeJson -projects $ENV:_projects -deliveryTarget $ENV:_deliveryTarget -artifacts $ENV:_artifacts -type $ENV:_type -atypes $ENV:_atypes -goLive ($ENV:_goLive -eq 'Y')
  }
  catch {
    Write-Host "::ERROR::Unexpected error when running action. Error Message: $($_.Exception.Message.Replace("`r",'').Replace("`n",' ')), StackTrace: $($_.ScriptStackTrace.Replace("`r",'').Replace("`n",' <- '))";
    exit 1
  }
  shell: C:\Windows\System32\WindowsPowerShell\v1.0\powershell.EXE -command ". '{0}'"
  env:
    workflowDepth: 1
    ALGoOrgSettings: {
      "CICDPushBranches": [
          "main",
          "development",
          "release/*",
          "feature/*"
      ],
      "CICDPullRequestBranches": [
          "main",
          "development"
      ],
      "ConditionalSettings": [
          {
              "branches": [
                  "development"
              ],
              "settings": {
                  "doNotPublishApps": false,
                  "doNotSignApps": false
              }
          }
      ]
  }
    ALGoRepoSettings: 
    Settings: {"keyVaultCertificateUrlSecretName":"","microsoftTelemetryConnectionString":"InstrumentationKey=84bd9223-67d4-4378-8590-9e4a46023be2;IngestionEndpoint=https://westeurope-1.in.applicationinsights.azure.com/","NextMajorSchedule":"0 1 20 * *","type":"AppSource App","sendExtendedTelemetryToMicrosoft":false,"appBuild":81,"installTestApps":[],"versioningStrategy":0,"installApps":[],"installTestLibraries":false,"runNumberOffset":0,"codeSignCertificatePasswordSecretName":"codeSignCertificatePassword","vsixFile":"","country":"nl","partnerTelemetryConnectionString":"","doNotRunTests":false,"githubRunner":"windows-latest","generateDependencyArtifact":true,"excludeEnvironments":[],"keyVaultCertificatePasswordSecretName":"","rulesetFile":"","licenseFileUrlSecretName":"licenseFileUrl","enableExternalRulesets":false,"memoryLimit":"","keyVaultClientIdSecretName":"","testFolders":[],"doNotBuildTests":false,"environments":[],"companyName":"","assignPremiumPlan":false,"artifact":"","ghTokenWorkflowSecretName":"ghTokenWorkflow","enableTaskScheduler":false,"enableCodeCop":false,"repoVersion":"1.6","doNotPublishApps":false,"unusedALGoSystemFiles":[],"githubRunnerShell":"powershell","appFolders":[],"runs-on":"windows-latest","cacheKeepDays":3,"bcptTestFolders":[],"updateDependencies":false,"cacheImageName":"my","treatTestFailuresAsWarnings":false,"additionalCountries":["be","fi","ro"],"enableUICop":false,"customCodeCops":[],"appDependencies":[],"doNotRunBcptTests":false,"UpdateGitHubGoSystemFilesSchedule":"0 0 [17](https://github.com/BluaceBV/appsourceinventorytemplates/actions/runs/7132737691/job/19425575660#step:6:17) * *","appDependencyProbingPaths":[{"AuthTokenSecret":"GhTokenWorkflow","release_status":"release","repo":"https://github.com/BluaceBV/appsourcecommon","version":"latest"}],"useCompilerFolder":false,"installTestFramework":false,"keyVaultCodesignCertificateName":"","keyVaultName":"","installOnlyReferencedApps":true,"CICDPushBranches":["main","development","release/*","feature/*"],"obsoleteTagMinAllowedMajorMinor":"","applicationDependency":"[18](https://github.com/BluaceBV/appsourceinventorytemplates/actions/runs/7132737691/job/19425575660#step:6:18).0.0.0","applicationInsightsConnectionStringSecretName":"applicationInsightsConnectionString","shell":"powershell","failOn":"error","templateUrl":"https://github.com/microsoft/AL-Go-AppSource@main","projects":[],"projectName":".","testDependencies":[],"appRevision":0,"ConditionalSettings":[{"branches":["development"],"settings":{"doNotPublishApps":false,"doNotSignApps":false}}],"codeSignCertificateUrlSecretName":"codeSignCertificateUrl","configPackages":[],"useProjectDependencies":false,"appSourceCopMandatoryAffixes":["IBLC"],"buildModes":[],"templateBranch":"","NextMinorSchedule":"0 1 [19](https://github.com/BluaceBV/appsourceinventorytemplates/actions/runs/7132737691/job/19425575660#step:6:19) * *","installPerformanceToolkit":false,"PullRequestTrigger":"pull_request_target","CICDPullRequestBranches":["main","development"],"doNotSignApps":false,"repoName":"appsourceinventorytemplates","fullBuildPatterns":[],"alwaysBuildAllProjects":false,"skipUpgrade":false,"CurrentSchedule":"0 1 18 * *","installTestRunner":false,"adminCenterApiCredentialsSecretName":"adminCenterApiCredentials"}
    Secrets: {"StorageContext":"***"}
    _actor: pieter-kok
    _token: ***
    _parentTelemetryScopeJson: 7b7d
    _projects: ["."]
    _deliveryTarget: Storage
    _artifacts: .artifacts
    _type: CD
    _atypes: Apps,Dependencies,TestApps
    _goLive: N
Downloading BcContainerHelper latest version from CDN
Import from C:\ProgramData\BcContainerHelper\6.0.1\BcContainerHelper\BcContainerHelper.ps1
BcContainerHelper version 6.0.1
BC.HelperFunctions emits usage statistics telemetry to Microsoft
Applying settings from D:\a\appsourceinventorytemplates\appsourceinventorytemplates\.github\AL-Go-Settings.json
Applying settings from D:\a\appsourceinventorytemplates\appsourceinventorytemplates\.AL-Go\settings.json
No settings found in D:\a\appsourceinventorytemplates\appsourceinventorytemplates\.github\CICD.settings.json
No settings found in D:\a\appsourceinventorytemplates\appsourceinventorytemplates\.AL-Go\CICD.settings.json
No settings found in D:\a\appsourceinventorytemplates\appsourceinventorytemplates\.AL-Go\pieter-kok.settings.json
Artifacts .artifacts
Projects:
.
Project 'appsourceinventorytemplates'
Artifacts:
- appsourceinventorytemplates-main-Apps-1.6.[81](https://github.com/BluaceBV/appsourceinventorytemplates/actions/runs/7132737691/job/19425575660#step:6:82).0
- appsourceinventorytemplates-main-BuildOutput-1.6.81.0
- appsourceinventorytemplates-main-Dependencies-1.6.81.0
- appsourceinventorytemplates-main-TestApps-1.6.81.0
- appsourceinventorytemplates-main-TestResults-1.6.81.0
Azure.Storage Module is available in version 2.1.0
Using Azure.Storage version 2.1.0
WARNING: Microsoft Azure PowerShell collects data about how users use PowerShell cmdlets and some problems they 
encounter.  Microsoft uses this information to improve our PowerShell cmdlets.  Participation is voluntary and when you
 choose to participate your device automatically sends information to Microsoft about how you use Azure PowerShell. 

 

If you choose to participate, you can stop at any time by using Azure PowerShell as follows:

1. Use the Disable-AzureDataCollection cmdlet to turn the feature Off. The cmdlet can be found in the 
AzureResourceManager module

To disable data collection: PS > Disable-AzureDataCollection



If you choose to not participate, you can enable at any time by using Azure PowerShell as follows:

1. Use the Enable-AzureDataCollection cmdlet to turn the feature On. The cmdlet can be found in the 
AzureResourceManager module

To enable data collection: PS > Enable-AzureDataCollection

 

Select Y to enable data collection [Y/N]:
WARNING: You choose not to participate in Microsoft Azure PowerShell data collection.
WARNING: The setting profile has been saved to the following path 'C:\Users\runneradmin\AppData\Roaming\Windows Azure 
Powershell\AzureDataCollectionProfile.json'.
Storage Container Name is appsourceinventorytemplates
Storage Blob Name is {version}/{project}-{type}.zip
Delivering to appsourceinventorytemplates in babuildfileshare
Looking for: appsourceinventorytemplates-main-Apps-*.*.*.*
D:\a\appsourceinventorytemplates\appsourceinventorytemplates\.artifacts\appsourceinventorytemplates-main-Apps-1.6.81.0
Compressing
Delivering 1.6.81.0-preview/appsourceinventorytemplates-apps.zip
Delivering preview/appsourceinventorytemplates-apps.zip
Looking for: appsourceinventorytemplates-main-Dependencies-*.*.*.*
D:\a\appsourceinventorytemplates\appsourceinventorytemplates\.artifacts\appsourceinventorytemplates-main-Dependencies-1.6.81.0
Compressing
Delivering 1.6.81.0-preview/appsourceinventorytemplates-dependencies.zip
Delivering preview/appsourceinventorytemplates-dependencies.zip
Looking for: appsourceinventorytemplates-main-TestApps-*.*.*.*
D:\a\appsourceinventorytemplates\appsourceinventorytemplates\.artifacts\appsourceinventorytemplates-main-TestApps-1.6.81.0
Compressing
Delivering 1.6.81.0-preview/appsourceinventorytemplates-testapps.zip
Delivering preview/appsourceinventorytemplates-testapps.zip

from al-go.

freddydk avatar freddydk commented on June 9, 2024

Are you using this blob storage account for other things?
Did you try again after waiting 7 days (see this https://techcommunity.microsoft.com/t5/azure-paas-blog/troubleshooting-invalidblock-the-specified-block-list-is-invalid/ba-p/1870350)

from al-go.

pieter-kok avatar pieter-kok commented on June 9, 2024

I'm using this blob storage account also for supplying the development license file and certificate as input for the github actions. So, that's really kind of static data, but it is other use. That is however in a different blob container. Those files are uploaded manually from the Azure portal, so not through some API. Furthermore the storage account is only used for storing the build outputs from AL-Go for GitHub.

When it would be interfering other activities in the storage account that causes this, it makes me wonder why the the storage part of the CI/CD (just before the release action in this case) was working just fine. To my knowledge, the only failed/cancelled uploads are the ones from the failed release actions. Three uploads are done (dependency, app and test app). Once one upload fails, the other steps are cancelled. Is it possible that that is creating uncommitted blocks?

I just created a new release of the product to check the waiting period of 7 days as you requested. It now worked, but I don't really understand what that means now based on the supplied web page and how I can solve the issue within the 7 days when it's happening again.

from al-go.

freddydk avatar freddydk commented on June 9, 2024

I hear about this for the first time - never heard of other people having this problem.
Also Business Central artifacts are uploaded to azure blob storage as well, multiple times a day and we have never encountered this.
For the limited usage you are describing, you also shouldn't run into the limit described in the blog post - so I really don't know.
The CI/CD workflow uploads a preview version - the create release uploads a released version - that is really the main difference.
In the future - our recommendation is to use nuget for these things instead of storage accounts.

from al-go.

pieter-kok avatar pieter-kok commented on June 9, 2024

In our release round this month (last Monday and yesterday) we got this issue on every app that has at least a dependency on an app in another GitHub repository. The only thing we could do was retry the release and eventually the release succeeds, without modifications to the app or changing settings. Some examples of that:

image

image

In all situations, one of the upload actions fails and cancelled the other ones. But its not always the same one that fails:

image

image

As we've have had many examples of this behaviour in our account, maybe there is some information to collect to solve it.

from al-go.

pieter-kok avatar pieter-kok commented on June 9, 2024

Thanks for your response. I will do that and let you know the outcome.

from al-go.

pieter-kok avatar pieter-kok commented on June 9, 2024

During our latest release cycle, after we switched to ubunto-latest, we did not have this issue anymore.
Does this mean that the windows runners will not be supported anymore for specific tasks?

from al-go.

philipp-mlr avatar philipp-mlr commented on June 9, 2024

We had the same issue. Setting "runs-on": "ubuntu-latest" fixed it.

from al-go.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.