rtp-demo-spring-boot

Overview and Business Flow

Source: https://fasterpaymentstaskforce.org/wp-content/uploads/tch-fis-vs.pdf

A real-time payments system is a centralized network connecting Financial Institutions (FIs) to facilitate real-time, account-to-account payments settlement.

In November 2017, The Clearing House (TCH) released a Real Time Payments (RTP) network for use within the US. The above diagram summarizes the messaging flow for both Debtor FIs (payment sender banks) and Creditor FIs (payment recipient banks) with the RTP network.

This repository contains a reference implementation intended to demonstrate technologies and patterns that can be leveraged by an FI to participate in TCH RTP.

Debtor/Payer Demo Implementation

Creditor/Payee Demo Implementation

Technology summary:

Deployed to OpenShift (OKD Minishift)
Strimzi Kafka cluster
Camel component is used to consume and writes from/to Kafka topics.
Camel routes are deployed and run as Spring Boot jars
Based on spring-boot-camel-archetype Fuse on OpenShift Maven archetype ( -DarchetypeGroupId=org.jboss.fuse.fis.archetypes, -DarchetypeArtifactId=spring-boot-camel-archetype, -DarchetypeVersion=2.2.0.fuse-710017-redhat-00003 )
Decision manager rules run in a stateless session as embedded DRL
Deployed with S2I binary build

1. Mock RTP route

Generates RTP FIToFICustomerCreditTransferV06 messages on a timer
Writes to creditor-ctms topic

2. Creditor Intake route

Consumes from creditor-ctms
Transforms FIToFICustomerCreditTransferV06 to CreditTransferMessage
Writes to creditor-pre-validation topic

3. Creditor Validation route

Consumes from creditor-pre-validation
Transforms CreditTransferMessage to PaymentValidationRequest
Stateless DRL rules evaluate the PaymentValidationRequest and enrich with errors
Transforms PaymentValidationRequest to Payment
Writes to creditor-post-validation topic

4-5. Account and Bank data access

In memory dummy data (next iteration JDG lookup) used to feed rules session

6. Auditing service listens to validation results via creditor-post-validation

7. Creditor Acknowledgement route

Consumes from creditor-post-validation
Transforms Payment to FIToFIPaymentStatusReportV07
Writes to creditor-acks topic

8.Mock RTP receives acknowledgement messages

Manual Setup

OC and Minishift

Follow the Minishift install instructions according to your environment:

https://docs.okd.io/latest/minishift/getting-started/preparing-to-install.html

Install the most recent oc binary:

https://github.com/openshift/origin/releases

Ensure that Minishift and oc versions are aligned:

$ oc version
oc v3.11.0+0cbc58b
kubernetes v1.11.0+d4cacc0
features: Basic-Auth

Server https://192.168.64.6:8443
kubernetes v1.11.0+d4cacc0

Start the Minishift VM and Enable Admin User

Start minishift with enough resources:

$ minishift start --cpus 4 --disk-size 100GB --memory 12GB

Once the Kubernetes cluster is running, login as admin user:

$ oc login -u system:admin

Enable the admin user so that you can login to the console as u:admin, p:admin

$ minishift addon apply admin-user

You should be able to login to the web console with user:admin, pass:admin

Strimzi Cluster and Kafka Topics

Create a new project for the Strimzi cluster:

$ oc new-project kafka-cluster

Apply the Strimzi installation file:

$ oc apply -f kafka/strimzi-cluster-operator-0.8.2.yaml -n kafka-cluster

Provision an ephemeral Kafka cluster:

$ oc apply -f kafka/kafka-ephemeral.yaml -n kafka-cluster

Note: The above files are local versions of these Strimzi project examples, modified to use the project name 'kafka-cluster':

Watch the deployment until all Kafka pods are created and running:

$ oc get pods -n kafka-cluster -w
NAME                                          READY     STATUS    RESTARTS   AGE
my-cluster-entity-operator-5d7cd7774c-x8sg7   3/3       Running   0          33s
my-cluster-kafka-0                            2/2       Running   0          57s
my-cluster-kafka-1                            2/2       Running   0          57s
my-cluster-kafka-2                            2/2       Running   0          57s
my-cluster-zookeeper-0                        2/2       Running   0          1m
my-cluster-zookeeper-1                        2/2       Running   0          1m
my-cluster-zookeeper-2                        2/2       Running   0          1m
strimzi-cluster-operator-56d699b5c5-ch9r2     1/1       Running   0          2m

Create the topics for the rtp demo application:

$ oc apply -f kafka/creditor-ctms.yaml -n kafka-cluster
$ oc apply -f kafka/creditor-acks.yaml -n kafka-cluster
$ oc apply -f kafka/creditor-pre-validation.yaml -n kafka-cluster
$ oc apply -f kafka/creditor-post-validation.yaml -n kafka-cluster

Confirm on each Kafka broker that the topics were replicated.

$ oc exec -it my-cluster-kafka-0 -c kafka -- bin/kafka-topics.sh --zookeeper localhost:2181 --list
creditor-acks
creditor-ctms
creditor-post-validation
creditor-pre-validation

$ oc exec -it my-cluster-kafka-1 -c kafka -- bin/kafka-topics.sh --zookeeper localhost:2181 --list
creditor-acks
creditor-ctms
creditor-post-validation
creditor-pre-validation

$ oc exec -it my-cluster-kafka-2 -c kafka -- bin/kafka-topics.sh --zookeeper localhost:2181 --list
creditor-acks
creditor-ctms
creditor-post-validation
creditor-pre-validation

$ mvn fabric8:deploy -Popenshift

oc create configmap rtp-creditor-intake-config
--from-literal=BOOTSTRAP_SERVERS="${bootstrap}"
--from-literal=CONSUMER_TOPIC=creditor-ctms
--from-literal=GROUP_ID=rtp-creditor-intake-app
--from-literal=SECURITY_PROTOCOL=PLAINTEXT
--from-literal=AUTO_OFFSET_RESET=earliest
--from-literal=ENABLE_AUTO_COMMIT=true

oc create configmap rtp-creditor-validation-config
--from-literal=BOOTSTRAP_SERVERS="${bootstrap}"
--from-literal=CONSUMER_TOPIC=creditor-pre-validation
--from-literal=GROUP_ID=rtp-creditor-validation-app
--from-literal=SECURITY_PROTOCOL=PLAINTEXT
--from-literal=AUTO_OFFSET_RESET=earliest
--from-literal=ENABLE_AUTO_COMMIT=true

oc create configmap rtp-creditor-acknowledgement-config
--from-literal=BOOTSTRAP_SERVERS="${bootstrap}"
--from-literal=CONSUMER_TOPIC=creditor-post-validation
--from-literal=GROUP_ID=rtp-creditor-acknowledgement-app
--from-literal=SECURITY_PROTOCOL=PLAINTEXT
--from-literal=AUTO_OFFSET_RESET=earliest
--from-literal=ENABLE_AUTO_COMMIT=true

oc new-project rtp-jdg

oc create secret generic pull-secret-name
--from-file=.dockerconfigjson=.docker/config.json
--type=kubernetes.io/dockerconfigjson

oc secrets link default pull-secret-name --for=pull

oc secrets link builder pull-secret-name

oc create -n openshift -f
https://raw.githubusercontent.com/jboss-container-images/jboss-datagrid-7-openshift-image/1.3/templates/datagrid72-image-stream.json

oc create -n openshift -f
https://raw.githubusercontent.com/jboss-container-images/jboss-datagrid-7-openshift-image/1.3/templates/datagrid72-basic.json

oc get is -n openshift | grep datagrid

oc describe is jboss-datagrid72-openshift -n openshift

oc new-project datagrid-env --display-name="JDG"

oc new-app --template=datagrid72-basic --name=rhdg
-e USERNAME=developer -e PASSWORD=password1!
-e CACHE_NAMES=mycache -e MYCACHE_CACHE_START=EAGER

oc env dc/datagrid-app -e MYCACHE_CACHE_START=LAZY

oc new-project datagrid

oc new-app --template=datagrid72-basic

oc status

oc describe route datagrid-app

curl -i -H "Accept:application/json" http://datagrid-app-jdg-env.192.168.64.4.nip.io/rest/mycache/a -u developer:password1!

curl -X POST -i -H "Content-type:application/json" -d "{"name":"Red Hat Data Gridd"}" http://datagrid-app-jdg-env.192.168.64.4.nip.io/rest/mycache/a -u developer:password1!

oc new-app --template=datagrid72-basic --name=rhdg -e USERNAME=developer -e PASSWORD=jdgpassword -e CACHE_NAMES=mycache -e MYCACHE_CACHE_START=EAGER

oc new-project datagrid-env --display-name="Setting Environment Variables"

oc new-app --template=datagrid72-basic --name=rhdg -e USERNAME=developer -e PASSWORD=jdgpassword -e CACHE_NAMES=mycache -e MYCACHE_CACHE_START=EAGER

oc get pods

Lizs-MacBook-Pro:rtp-creditor-intake-validation liz$ oc get pods NAME READY STATUS RESTARTS AGE datagrid-app-1-deploy 1/1 Running 0 10s datagrid-app-1-gzrvv 0/1 Running 0 9s

oc env pods/datagrid-app-1-gzrvv --list

curl -X POST -i -H "Content-type:application/json" -d "{"accountNumber":"12000194212199001"}" http://datagrid-app-jdg-env.192.168.64.4.nip.io/rest/mycache/12000194212199001 -u developer:password1!

curl -i -H "Accept:application/json" http://datagrid-app-jdg-env.192.168.64.4.nip.io/rest/mycache/12000194212199001 -u developer:password1!

curl -X DELETE -i -H "Content-type:application/json" http://datagrid-app-jdg-env.192.168.64.4.nip.io/rest/mycache/12000194212199001 -u developer:password1!

snandakumarops / rtp-demo-spring-boot Goto Github PK