Giter Club home page Giter Club logo

ibmstreams / samples Goto Github PK

View Code? Open in Web Editor NEW
40.0 30.0 73.0 256.92 MB

This repository contains open-source sample applications for IBM Streams.

Home Page: https://ibmstreams.github.io/samples/

License: Other

Makefile 14.85% Perl 3.62% HTML 25.42% Java 26.25% Shell 7.55% CSS 3.29% Python 1.53% C++ 11.77% JavaScript 2.83% Jupyter Notebook 2.14% Pug 0.75%
ibm-streams stream-processing samples geofencing geofence healthcare text-analytics database timeseries hdfs

samples's Introduction

README -- IBMStreams samples

This repository contains sample applications for IBM Streams.

You can also Contribute a sample

To learn more about Streams:

About this repository

Each branch in the repo is related and serves a different purpose.

  • main branch: has the actual code samples organized by feature or task, e.g. Read data, Analyze data, etc.

  • gh-pages branch has the code for the catalog, ibmstreams.github.io/samples/

    • AngularJS code
  • fileserver branch: This has the code for the file server. The file server is used by the catalog to provide a zip archive of each individual sample.

Adding a new sample to the catalog

You need to install jekyll. Background info:

  • Each individual sample has a catalog.json that describes the sample and is used by the gh-pages branch to display the catalog.
  • extSamples.json contains information about additional samples that are listed on the website but hosted in other repositories

To add a sample to the catalog:

  • If the sample is going to be in this repo,

    • add the sample folder to the tree in the appropriate folder, e.g. if it is a Database sample, add it to ReadAndStore data.
    • Add a catalog.json file to the top level folder of the new sample, use any of the existing catalog.json as an example
  • If it is going to be hosted in another repo,

    • edit the extSamples.json file to add the information about the sample.
  • Update the categories array in the JSON file is based on the categories listed in categoryKey.txt

  • Commit your changes to the main branch.

  • Run the updateCatalogDB.sh script. This script will

    • run the generate-catalog.py script combines the extSamples.json file with the entry from each catalog.json in the repo to create a master JSON file listing every entry in the catalog.
    • Switch to the gh-pages branch and start a local copy of the server at 127.0.0.1:4000/
  • 127.0.0.1:4000/ to see the catalog and verify the new sample is listed. Commit and push the changes to the gh-pages branch.

Note: Run the data/main.json file through a JSON minimizer before commiting it to remove whitespace.

samples's People

Contributors

anouri avatar brandtol avatar chanskw avatar crecoskie avatar ddebrunner avatar dependabot[bot] avatar gabijs avatar hildrum avatar kylebecker avatar mjbranson avatar natashadsilva avatar queeniema avatar raghukiran1224 avatar siegenth avatar vdogaru avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

samples's Issues

Add catalog entry for EdgeVideoAnalytics.starterKit

https://github.com/IBMStreams/streamsx.edgevideoanalytics.starterkit

This starter kit demonstrates an Apache Edgent/OpenCV based "Smart Camera" IoT device performing face detection and publishing detection events to Watson IoT Platform, and a Streams application performing Face Recognition on faces in face detection events.

Languages

  • Java

Categories:

  • Beginner / General
  • Starter kit
  • Edge device
  • Image Processing
  • Video Analytics

Services:

  • Bluemix
  • Watson IoT Platform
  • Apache Edgent

WordCount sample does not work out of the box

Trying out the WordCount sample

  1. Sample cannot be imported into Studio out of the box - need info.xml
  2. The application cannot compile:

make all
/homes/hny7/chanskw/streams//bin/sc --data-directory ./data -a -M Main
Main.spl:51:9: CDISP0021E ERROR: A port that corresponds to the Lines identifier was not found.

CDISP0092E ERROR: Because of previous compilation errors, the compile process cannot continue.
make: *** [distributed] Error 1

Create new Social Samples repository

I would like to put some samples that show how to use our toolkits to connect to popular social media sites like twitter etc.
Would like to have a single repository for putting all social media related samples or a new repository per social media site. Twitter would be the first.

Update to UpperRest.spl sample file

I was trying to run the UpperRest.spl file using the latest 2.9.6 release and was having issues with the use directives at the top of the file. I had to update the use directives to be as follows in order to properly compile my spl file...

use com.ibm.streamsx.inet.rest::HTTPRequest;
use com.ibm.streamsx.inet.http::HTTPResponse;
use com.ibm.streamsx.inet.rest::HTTPRequestProcess;

This may need to be updated in the sample code for proper compiling of the sample. Let me know if you need any clarification on the issue I was running into.

Add a user-friendly iopages including support for Bluemix.

While all the samples exist, there's no nice way of finding one, since there is not a github io pages for the project. Could one be added with a well formatted list of the samples and pointers to them. it some ways this is just a dumping ground for samples, rather than a useful repository.

I'm also wondering if for any samples that can run in Bluemix can we provide a ready built app, so a user can get an instant idea of streaming or the concept the sample is trying to demonstrate.

DBLoader sample

The 'DB Loader' is a SPL sample application for InfoSphere Streams
It uses DB2 load command tool or Oracle SQL Loader to load files directly into database.
It improves insert-performance into DB2 and Oracle databases

DbLoader scans the input directory and loads files parallel into database

All input files must have a correctly formated Comma Separated Value (csv).
The file name includes the database schema and the table name.
It is not needed to change the SPL code in case of new tables.

IndexAnalyzer has no README

@misquith Can you please provide a README that will help users understand what this sample is for as well as how to run it?

A README.md with a format of:

  1. Brief intro to what this sample is
  2. Instructions for building, submitting, and confirming that it worked.

Add MapViewerSample

In this sample, we are going to demonstrate how user can use the geospatial toolkit, inet toolkit and openLayer APIs to easily display geospatial data on a map.

Test, update and release samples for Streams 4.2.1.1

Some of the samples are out-of-date and no longer run.
Need to go through the samples to update them.

Need to think of a release strategy for us to be in sync with Streams product release. i.e. we should take a snapshot of the samples and make a release after we have made sure that all the samples work for a particular version of Streams.

Unable to build recursive directory scan sample

I am using the new docker image. When I tried to build the sample using the .mk script as suggested, I got the following error:

[streamsadmin@streamsqse RecursiveDirScanLib]$ ./mk
mkdir: cannot create directory \u2018../050_recursive_dir_scan/impl/lib/x86_64.CentOS7\u2019: No such file or directory
mv: cannot move \u2018libRecursiveDirScanLib.so\u2019 to \u2018../050_recursive_dir_scan/impl/lib/x86_64.CentOS7\u2019: No such file or directory
[streamsadmin@streamsqse RecursiveDirScanLib]$

Clean up

The samples repository is getting a bit messy.
Need to think of a better way to organize these samples.

Where can I find these samples?

There used to be these examples in the Examples for Beginners:

058_data_sharing_between_non_fused_spl_custom_and_cpp_primitive_operators

061_data_sharing_between_non_fused_spl_custom_operators_and_a_native_function

062_data_sharing_between_non_fused_spl_custom_and_java_primitive_operators

Is there a way for me to find them now? Why were they removed?

Cybersecurity Samples has no README.md

@cancilla Can you please provide a README that will help users understand what this sample is for as well as how to run it?

A README.md with a format of:

  1. Brief intro to what this sample is
  2. Instructions for building, submitting, and confirming that it worked.

STD2 sample is out of date

  • the samples dependency is outdated, so they don't compile out of the box
  • the sample does not have any build configuration
  • time series toolkit version is now bumped to 4.0.1, but the sample dependency requires 3.0 to 4.0

What is the buffersize unit?

bufferSize
Specifies the size of each buffer that is used to store the input tuples for each output port. The final punctuation marker is not forwarded until all buffers are drained.

So what is the unit? KB? MB? GB? or just bytes?

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.