Giter Club home page Giter Club logo

osf-builder-suite-for-sfcc-data-import-plugin's Introduction

OSF Builder Suite For Salesforce Commerce Cloud :: Data Import

Import your site data to a Salesforce Commerce Cloud instance

OSF Builder Suite For Salesforce Commerce Cloud :: Data Import is a very easy-to-use and highly configurable Jenkins plugin that is used to automate data imports to your Salesforce Commerce Cloud continuous integration sandbox, development or staging instance.

If you have a bug to report or maybe a feature that you wish to request, please do so on GitHub, on the project's issues page.

 

Features

  • Simple. It does one thing, and it does it well.
  • Easy to install, use and keep updated.
  • Easy to configure. The plugin can be configured from the Jenkins web interface.
  • Support for classical mode, Jenkins Pipelines and also the new modern Blue Ocean interface.
  • Super flexible. Every little thing is configurable so that the plugin can be easily adjusted to your workflow.
  • Integrated with the Jenkins credentials plugin so that your credentials are safely stored encrypted.
  • Support for two factor authentication
  • Good documentation. Every option is documented both here on this page but also inline in Jenkins's UI by clicking the question mark icon next to the item for which you wish to display the help information.
  • Support for HTTP proxy with basic or NTLM authentication.
  • Free
  • Open source
  • Fast builds. The data is checked for changes and if nothing changed the build is skipped so that you don't import same unchanged data over and over again.

 

Installation

Just go to Manage Jenkins > Manage Plugins > Available, search for OSF Builder Suite, select OSF Builder Suite For Salesforce Commerce Cloud :: Data Import and click Download now and install after restart button.

 

Configuration

Hostname of the SFCC instance where this build should be deployed. Examples:

cert.staging.realm.customer.demandware.net For deployments to a staging instance that has two factor auth enabled. 
staging-realm-customer.demandware.net For deployments to a staging instance that does not have two factor auth enabled.
development-realm-customer.demandware.net For deployments to a development instance.
devNN-realm-customer.demandware.net For deployments to a sandbox instance.

Two Factor Auth credentials of type OSF Builder Suite :: Two Factor Auth Credentials for the SFCC instance where this build should be deployed. Select - none - if you deploy to a instance that does not require two factor auth.

Open Commerce API credentials of type OSF Builder Suite :: Open Commerce API Credentials for the SFCC instance where this build should be deployed.

The version to be used by the calls made to OCAPI. The Open Commerce API Version starts with the character v (lowercase) followed by the actual version number, separated by an underscore.

For example: v19_10

Name of the zip file that will be created by compressing your data that will be uploaded to your target instance and then imported. Only the name, without the .zip extension as it will be added by the plugin automatically. 

For example: metadata

Path (relative to the workspace) to a directory where the builder will look for data to be imported. 

For example: scm/my-git-repo/metadata

You can also define a list of patterns to be ignored. If a path matches any of the patterns in this list then it will be ignored and not added to the build. The pattern needs to be relative to the source path defined above.

When a path is matched against a pattern, the following special characters can be used:

? Matches one character (any character except path separators)
* Matches zero or more characters (not including path separators)
** Matches zero or more path segments

Examples:

**/*.js Matches all .js files/dirs in a directory tree
node_modules/** Matches the node_modules folder and all its contents
test/a??.js Matches all files/dirs which start with an a, then two more characters and then .js, in a directory called test
** Matches everything in a directory tree
**/test/**/XYZ* Matches all files/dirs which start with XYZ and where there is a parent directory called test (e.g. abc/test/def/ghi/XYZ123)
 

Path (relative to the workspace) to a temp directory, that will be used during the build. If the directory does not exist, it will be created by the builder and it will also be automatically cleaned up before each build.

For example: tmp/metadata

 

If your Jenkins server sits behind a firewall and does not have direct access to the internet, you can specify the HTTP proxy host in this field to allow Jenkins to connect to the internet trough it.

This field works in conjunction with the proxy host field to specify the HTTP proxy port.

This field works in conjunction with the proxy host field to specify the username used to authenticate with the proxy.

If this proxy requires Microsoft's NTLM authentication scheme then the domain name can be encoded within the username by prefixing the domain name followed by a back-slash \ before the username, e.g ACME\John Doe.

This field works in conjunction with the proxy host field to specify the HTTP proxy password.

When this option is checked, the builder will no longer validate the SSL certificate and hostname of the target instance.

This has potential security implications so make sure you know what you are doing before enabling this option!

Open Commerce API Settings

Go to Administration > Site Development > Open Commerce API Settings, select type Data, select context Global and add following configuration:

{
    "_v": "19.10",
    "clients": [
        {
            "client_id": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaa",
            "resources": [
                {
                    "resource_id": "/code_versions/*",
                    "methods": ["put", "patch"],
                    "read_attributes": "(**)",
                    "write_attributes": "(**)"
                },
                {
                    "resource_id": "/jobs/*/executions",
                    "methods": ["post"],
                    "read_attributes": "(**)",
                    "write_attributes": "(**)"
                },
                {
                    "resource_id": "/jobs/*/executions/*",
                    "methods": ["get"],
                    "read_attributes": "(**)",
                    "write_attributes": "(**)"
                }
            ]
        }
    ]
}

Go to Administration > Organization > WebDAV Client Permissions and add following configuration:

{
    "clients": [
        {
            "client_id": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaa",
            "permissions": [
                {
                    "path": "/cartridges",
                    "operations": [
                        "read_write"
                    ]
                },
                {
                    "path": "/impex",
                    "operations": [
                        "read_write"
                    ]
                }
            ]
        }
    ]
}

Whitelist cert.staging.???.???.demandware.net hostname

Go to Administration > Sites > Manage Sites > Business Manager - Hostnames and whitelist cert.staging.???.???.demandware.net

Jenkins Pipeline Configuration

Here's a sample pipeline configuration to get you started:

node {
    stage('Cleanup') {
        cleanWs()
    }

    stage('Git') {
        dir('scm/github.com/???/???') {
            git(
                branch: '???',
                credentialsId: '???',
                url: '[email protected]:???/???.git'
            )
        }
    }

    stage('Yarn') {
        dir('scm/github.com/???/???') {
            nodejs('NodeJS v12') {
                sh('yarn install')
            }
        }
    }

    stage('Build') {
        dir('scm/github.com/???/???') {
            nodejs('NodeJS v12') {
                sh('yarn run webpack:prd')
            }
        }
    }

    /* See https://plugins.jenkins.io/osf-builder-suite-for-sfcc-deploy
    stage('CodePush') {
        osfBuilderSuiteForSFCCDeploy(
            hostname: '???',
            tfCredentialsId: '???',
            ocCredentialsId: '???',
            ocVersion: 'v19_10',
            buildVersion: 'dev',
            sourcePaths: [[sourcePath: 'scm/github.com/???/???/cartridges']],
            activateBuild: true,
            createBuildInfoCartridge: true,
            tempDirectory: 'tmp/code'
        )
    }
    */

    stage('DataPush') {
        osfBuilderSuiteForSFCCDataImport(
            hostname: '???',
            tfCredentialsId: '???',
            ocCredentialsId: '???',
            ocVersion: 'v19_10',
            archiveName: 'metadata',
            sourcePath: 'scm/github.com/???/???/metadata',
            importStrategy: 'DELTA',
            tempDirectory: 'tmp/data'
        )
    }
}

You can also always consult the pipelines documentation available at https://jenkins.io/doc/book/pipeline/ or check the pipeline syntax link right inside Jenkins on the left navigation menu.

 

Version history

https://github.com/jenkinsci/osf-builder-suite-for-sfcc-data-import-plugin/releases

Dev

  • mvn hpi:run
  • mvn clean package hpi:hpi
  • mvn release:prepare release:perform

osf-builder-suite-for-sfcc-data-import-plugin's People

Contributors

danechitoaie avatar dependabot[bot] avatar notmyfault avatar strangelookingnerd avatar

Stargazers

 avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar

osf-builder-suite-for-sfcc-data-import-plugin's Issues

OCAPI Reindex new feature

During the CI/CD process if we import new:

  • Product
  • Content
  • Synonym
  • Suggestion
  • Inventory
    data, it's required to reindex those data types to be able to fully to see the changes on the storefront. At this moment we need manually inform related stakeholders and reindex data on the instance under Merchant Tools > Search > Search Indexes.
    It would be good to have this process as part of the plugin, which, for example, in the groovy configuration could have to reindex on/off and list of data types that require reindex.

Documentation about importStrategy

Hello,

I am using the Jenkins plugin to import data through different SFCC environments.
The fact is that the plugin give the importStrategy option to import data follow the 'DELTA' strategy (only import the new changes).
In some cases I want to import data 'REPLACING' the actual data and not 'MERGING'.
For example if I delete an attribute, I want to delete also in the target environment.
I try without the importStrategy option and I see on the log that executes a FULL import instead of DELTA import but still the import is not done via the MERGE type.

First of all I would like to know the difference between both options and secondly I would like to know if there is the possibility to import using the 'MERGE' type.

There is no documentation about this option and it would be of great help to me. Thanks

Best regards,

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.