When we package Streaming Shell, it doesn't work well, we can't use streaming commands and the text at the beginning ("Streaming Shell") has been replaced by "Spring Shell".

As of version 0.3.3, no output is shown when running the streaming engine. Some kind of feedback or output would be in order to inform the user about the version and that it has been correctly started and ready to be used.

It wil be useful to implement a method in the API which returns true if Streaming is running and false if it is down.

does siddhimanager instance run in driver processor ?
I don't unstand how to the relationship among "receiver","driver",and siddhimanager ,can you tell me ?

if I restart decisition , siddhi query,rules lost

It is possible, using streaming shell, save the output in a simple file (as txt, csv, ...) in HDFS? Reading the doc seems that only Cassandra, MongoDB and ElasticSearch are supported. If not which classes I need to modify to achieve this?

With siddhi 3.1.0 introduction of event table will be possibile some workaround to catch non occurencies. See #24 and this thread

Spark 1.3 introduced a new direct approach for integrating Kafka and Spark Streaming (without receivers). It has several advantages, as explained here:

https://spark.apache.org/docs/1.3.1/streaming-kafka-integration.html

When you execute step by step the streaming sandbox:
http://docs.stratio.com/modules/streaming-cep-engine/development/using-sandbox.html

In the point "6.7.5. Extra: Streaming metrics" when you restart stratio-streaming using the following command doesn't start the engine properly:
$ sudo service streaming restart

If you try to list the streams from the Shell you will see an error:
Command failed java.lang.reflect.UndeclaredThrowableException

But if you stop and start the engine it works fine
$ sudo service streaming stop
$ sudo service streaming start

Align versions with stratio streaming engine

Is there a workaround to handle non occurrences on sequences and patterns?j

1. Full syntax (create, alter, add query....)
2. Types of data
3. Link to Siddhi CEP engine https://docs.wso2.com/display/CEP310/User+Guide

Setting a kafka.hosts.n property without port (no colon char) will throw an ArrayIndexOutOfBounds exception here:
https://github.com/Stratio/streaming-cep-engine/blob/master/engine/src/main/java/com/stratio/streaming/configuration/ConfigurationContext.java#L111

Would be possible to develop a plugin for send output to Apache Solr?

These guys has published a plugin on Spark:

LucidWorks/spark-solr
Spark - Solr Integration

In order to distinguish between values which are returned by consecutive windows, it is needed something like a flag in the last message. Currently, we cannot be aware of it until we receive a message from the following window.

We could rely on auto-creation of topics by Kafka, so the issue is not critical (first message is lost if topics are not already created).

Anyway, as we are forcing the topic creation in the engine, we have to test it because is not working properly.

The first connection is established properly using the following commands:

stratioStreamingAPI = StratioStreamingAPIFactory.create().initializeWithServerConfig(kafkaServer, kafkaPort, zooKeeperServer, zooKeeperPort);

Then, we close the connection and create a new connection but an exception is thrown.

stratioStreamingAPI.close();
StratioStreamingAPIFactory.create().initializeWithServerConfig(kafkaServer, kafkaPort,
zooKeeperServer, zooKeeperPort);

The log when creating the second connection before the StratioEngineConnectionException:
INFO StratioStreamingAPI$ - Establishing connection with the engine...
WARN ZookeeperConsumer - Unable to check zNode: /stratio/streaming/engine
WARN StratioStreamingAPI$ - Ephemeral node does not exist

The entire log:
INFO StratioStreamingAPI$ - Establishing connection with the engine...
INFO CuratorFrameworkImpl - Starting
DEBUG CuratorZookeeperClient - Starting
DEBUG ConnectionState - Starting
DEBUG ConnectionState - reset
INFO ZooKeeper - Client environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
INFO ZooKeeper - Client environment:host.name=localhost
INFO ZooKeeper - Client environment:java.version=1.8.0_25
INFO ZooKeeper - Client environment:java.vendor=Oracle Corporation
INFO ZooKeeper - Client environment:java.home=/usr/lib/jvm/java-8-oracle/jre
INFO ZooKeeper - Client environment:java.class.path=/home/david/Escritorio/proyectos/stratio-connector-streaming/connector-streaming-ftest/target/test-classes:/home/david/Escritorio/proyectos/stratio-connector-streaming/connector-streaming-ftest/target/classes:/home/david/.m2/repository/com/stratio/crossdata/crossdata-connector/0.1.1/crossdata-connector-0.1.1.jar:/home/david/.m2/repository/com/stratio/crossdata/crossdata-core/0.1.1/crossdata-core-0.1.1.jar:/home/david/.m2/repository/org/antlr/antlr/3.5.2/antlr-3.5.2.jar:/home/david/.m2/repository/org/antlr/ST4/4.0.8/ST4-4.0.8.jar:/home/david/.m2/repository/org/antlr/antlr-runtime/3.5.2/antlr-runtime-3.5.2.jar:/home/david/.m2/repository/org/slf4j/slf4j-api/1.7.7/slf4j-api-1.7.7.jar:/home/david/.m2/repository/org/apache/commons/commons-lang3/3.2.1/commons-lang3-3.2.1.jar:/home/david/.m2/repository/com/google/guava/guava/16.0.1/guava-16.0.1.jar:/home/david/.m2/repository/org/infinispan/infinispan-core/6.0.2.Final/infinispan-core-6.0.2.Final.jar:/home/david/.m2/repository/org/infinispan/infinispan-commons/6.0.2.Final/infinispan-commons-6.0.2.Final.jar:/home/david/.m2/repository/org/jboss/spec/javax/transaction/jboss-transaction-api_1.1_spec/1.0.1.Final/jboss-transaction-api_1.1_spec-1.0.1.Final.jar:/home/david/.m2/repository/org/jboss/marshalling/jboss-marshalling-river/1.4.4.Final/jboss-marshalling-river-1.4.4.Final.jar:/home/david/.m2/repository/org/jboss/marshalling/jboss-marshalling/1.4.4.Final/jboss-marshalling-1.4.4.Final.jar:/home/david/.m2/repository/org/jboss/logging/jboss-logging/3.1.2.GA/jboss-logging-3.1.2.GA.jar:/home/david/.m2/repository/org/jgroups/jgroups/3.4.5.Final/jgroups-3.4.5.Final.jar:/home/david/.m2/repository/org/xerial/snappy/snappy-java/1.1.1-M1/snappy-java-1.1.1-M1.jar:/home/david/.m2/repository/net/jpountz/lz4/lz4/1.2.0/lz4-1.2.0.jar:/home/david/.m2/repository/jline/jline/2.11/jline-2.11.jar:/home/david/.m2/repository/joda-time/joda-time/2.3/joda-time-2.3.jar:/home/david/.m2/repository/com/stratio/crossdata/crossdata-common/0.1.1/crossdata-common-0.1.1.jar:/home/david/.m2/repository/org/scala-lang/scala-library/2.10.4/scala-library-2.10.4.jar:/home/david/.m2/repository/commons-io/commons-io/2.4/commons-io-2.4.jar:/home/david/.m2/repository/com/codahale/metrics/metrics-core/3.0.1/metrics-core-3.0.1.jar:/home/david/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.9.2/jackson-core-asl-1.9.2.jar:/home/david/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.9.2/jackson-mapper-asl-1.9.2.jar:/home/david/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar:/home/david/.m2/repository/com/typesafe/akka/akka-actor_2.10/2.2.4/akka-actor_2.10-2.2.4.jar:/home/david/.m2/repository/com/typesafe/akka/akka-contrib_2.10/2.2.4/akka-contrib_2.10-2.2.4.jar:/home/david/.m2/repository/com/typesafe/akka/akka-remote_2.10/2.2.4/akka-remote_2.10-2.2.4.jar:/home/david/.m2/repository/io/netty/netty/3.6.6.Final/netty-3.6.6.Final.jar:/home/david/.m2/repository/com/google/protobuf/protobuf-java/2.4.1/protobuf-java-2.4.1.jar:/home/david/.m2/repository/org/uncommons/maths/uncommons-maths/1.2.2a/uncommons-maths-1.2.2a.jar:/home/david/.m2/repository/com/typesafe/akka/akka-cluster_2.10/2.2.4/akka-cluster_2.10-2.2.4.jar:/home/david/.m2/repository/net/sandrogrzicic/scalabuff-runtime_2.10/1.2.0/scalabuff-runtime_2.10-1.2.0.jar:/home/david/.m2/repository/com/typesafe/akka/akka-testkit_2.10/2.2.4/akka-testkit_2.10-2.2.4.jar:/home/david/.m2/repository/com/typesafe/config/1.2.0/config-1.2.0.jar:/home/david/.m2/repository/org/scala-lang/scala-reflect/2.10.4/scala-reflect-2.10.4.jar:/home/david/Escritorio/proyectos/stratio-connector-streaming/connector-streaming-core/target/classes:/home/david/.m2/repository/com/stratio/streaming/streaming-api/0.6.0/streaming-api-0.6.0.jar:/home/david/.m2/repository/org/apache/kafka/kafka_2.10/0.8.1.1/kafka_2.10-0.8.1.1.jar:/home/david/.m2/repository/com/yammer/metrics/metrics-core/2.2.0/metrics-core-2.2.0.jar:/home/david/.m2/repository/net/sf/jopt-simple/jopt-simple/3.2/jopt-simple-3.2.jar:/home/david/.m2/repository/com/101tec/zkclient/0.3/zkclient-0.3.jar:/home/david/.m2/repository/org/apache/curator/curator-framework/2.4.1/curator-framework-2.4.1.jar:/home/david/.m2/repository/org/apache/curator/curator-client/2.4.1/curator-client-2.4.1.jar:/home/david/.m2/repository/org/apache/zookeeper/zookeeper/3.4.5/zookeeper-3.4.5.jar:/home/david/.m2/repository/com/stratio/streaming/streaming-commons/0.6.0/streaming-commons-0.6.0.jar:/home/david/.m2/repository/com/google/code/gson/gson/2.2.4/gson-2.2.4.jar:/home/david/.m2/repository/org/apache/httpcomponents/httpclient/4.3.3/httpclient-4.3.3.jar:/home/david/.m2/repository/org/apache/httpcomponents/httpcore/4.3.2/httpcore-4.3.2.jar:/home/david/.m2/repository/commons-logging/commons-logging/1.1.3/commons-logging-1.1.3.jar:/home/david/.m2/repository/commons-codec/commons-codec/1.6/commons-codec-1.6.jar:/home/david/.m2/repository/com/netflix/curator/curator-test/1.3.3/curator-test-1.3.3.jar:/home/david/.m2/repository/org/javassist/javassist/3.15.0-GA/javassist-3.15.0-GA.jar:/home/david/.m2/repository/org/apache/commons/commons-math/2.2/commons-math-2.2.jar:/home/david/Escritorio/proyectos/stratio-connector-commons/connector-commons-core/target/classes:/home/david/.m2/repository/org/slf4j/slf4j-log4j12/1.7.7/slf4j-log4j12-1.7.7.jar:/home/david/.m2/repository/log4j/log4j/1.2.17/log4j-1.2.17.jar:/home/david/Escritorio/proyectos/stratio-connector-commons/connector-commons-ftest/target/test-classes:/home/david/.m2/repository/junit/junit/4.11/junit-4.11.jar:/home/david/.m2/repository/org/hamcrest/hamcrest-core/1.3/hamcrest-core-1.3.jar:/home/david/.m2/repository/org/powermock/powermock-api-mockito/1.5.5/powermock-api-mockito-1.5.5.jar:/home/david/.m2/repository/org/mockito/mockito-all/1.9.5/mockito-all-1.9.5.jar:/home/david/.m2/repository/org/powermock/powermock-api-support/1.5.5/powermock-api-support-1.5.5.jar:/home/david/.m2/repository/org/powermock/powermock-core/1.5.5/powermock-core-1.5.5.jar:/home/david/.m2/repository/org/powermock/powermock-reflect/1.5.5/powermock-reflect-1.5.5.jar:/home/david/.m2/repository/org/objenesis/objenesis/2.1/objenesis-2.1.jar:/home/david/.m2/repository/org/powermock/powermock-module-junit4/1.5.5/powermock-module-junit4-1.5.5.jar:/home/david/.m2/repository/org/powermock/powermock-module-junit4-common/1.5.5/powermock-module-junit4-common-1.5.5.jar:/home/david/Escritorio/eclipse/configuration/org.eclipse.osgi/202/0/.cp/:/home/david/Escritorio/eclipse/configuration/org.eclipse.osgi/201/0/.cp/
INFO ZooKeeper - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
INFO ZooKeeper - Client environment:java.io.tmpdir=/tmp
INFO ZooKeeper - Client environment:java.compiler=
INFO ZooKeeper - Client environment:os.name=Linux
INFO ZooKeeper - Client environment:os.arch=amd64
INFO ZooKeeper - Client environment:os.version=3.13.0-39-generic
INFO ZooKeeper - Client environment:user.name=david
INFO ZooKeeper - Client environment:user.home=/home/david
INFO ZooKeeper - Client environment:user.dir=/home/david/Escritorio/proyectos/stratio-connector-streaming/connector-streaming-ftest
INFO ZooKeeper - Initiating client connection, connectString=127.0.0.1:2181 sessionTimeout=60000 watcher=org.apache.curator.ConnectionState@5ccddd20
DEBUG ClientCnxn - zookeeper.disableAutoWatchReset is false
INFO ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
INFO ClientCnxn - Socket connection established to localhost/127.0.0.1:2181, initiating session
DEBUG ClientCnxn - Session establishment request sent on localhost/127.0.0.1:2181
WARN ClientCnxnSocket - Connected to an old server; r-o mode will be unavailable
INFO ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x14a3340e8d7001a, negotiated timeout = 60000
INFO ConnectionStateManager - State change: CONNECTED
WARN ConnectionStateManager - There are no ConnectionStateListeners registered.
DEBUG ClientCnxn - Reading reply sessionid:0x14a3340e8d7001a, packet:: clientPath:null serverPath:null finished:false header:: 1,3 replyHeader:: 1,122,0 request:: '/stratio/streaming/engine,F response:: s{23,23,1418199160796,1418199160796,0,0,0,92943096191844353,13,0,23}
DEBUG ClientCnxn - Reading reply sessionid:0x14a3340e8d7001a, packet:: clientPath:null serverPath:null finished:false header:: 2,3 replyHeader:: 2,122,0 request:: '/stratio/streaming/engine,T response:: s{23,23,1418199160796,1418199160796,0,0,0,92943096191844353,13,0,23}
INFO StratioStreamingAPI$ - Initializing kafka topic...
DEBUG ZkConnection - Creating new ZookKeeper instance to connect to 127.0.0.1:2181.
INFO ZkEventThread - Starting ZkClient event thread.
INFO ZooKeeper - Initiating client connection, connectString=127.0.0.1:2181 sessionTimeout=10000 watcher=org.I0Itec.zkclient.ZkClient@16ec5519
INFO ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
INFO ClientCnxn - Socket connection established to localhost/127.0.0.1:2181, initiating session
DEBUG ClientCnxn - Session establishment request sent on localhost/127.0.0.1:2181
DEBUG ZkClient - Awaiting connection to Zookeeper server
DEBUG ZkClient - Waiting for keeper state SyncConnected
WARN ClientCnxnSocket - Connected to an old server; r-o mode will be unavailable
INFO ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x14a3340e8d7001b, negotiated timeout = 10000
DEBUG ZkClient - Received event: WatchedEvent state:SyncConnected type:None path:null
INFO ZkClient - zookeeper state changed (SyncConnected)
DEBUG ZkClient - Leaving process event
DEBUG ZkClient - State is SyncConnected
DEBUG ClientCnxn - Reading reply sessionid:0x14a3340e8d7001b, packet:: clientPath:null serverPath:null finished:false header:: 1,3 replyHeader:: 1,123,0 request:: '/brokers/topics/stratio_streaming_requests,F response:: s{47,47,1418199189973,1418199189973,0,1,0,0,36,1,54}
INFO KafkaTopicService - Topic stratio_streaming_requests already exists
DEBUG ClientCnxn - Reading reply sessionid:0x14a3340e8d7001b, packet:: clientPath:null serverPath:null finished:false header:: 2,3 replyHeader:: 2,123,0 request:: '/brokers/topics/stratio_streaming_data,F response:: s{51,51,1418199190082,1418199190082,0,1,0,0,36,1,69}
INFO KafkaTopicService - Topic stratio_streaming_data already exists
DEBUG ClientCnxn - Got ping response for sessionid: 0x14a3340e8d7001b after 12ms
INFO VerifiableProperties - Verifying properties
INFO VerifiableProperties - Property metadata.broker.list is overridden to 127.0.0.1:9092
INFO VerifiableProperties - Property serializer.class is overridden to kafka.serializer.StringEncoder
INFO Producer - Shutting down producer
INFO ProducerPool - Closing all sync producers
INFO VerifiableProperties - Verifying properties
INFO VerifiableProperties - Property metadata.broker.list is overridden to 127.0.0.1:9092
INFO VerifiableProperties - Property serializer.class is overridden to kafka.serializer.StringEncoder
INFO Producer - Shutting down producer
INFO ProducerPool - Closing all sync producers
DEBUG ZkClient - Closing ZkClient...
INFO ZkEventThread - Terminate ZkClient event thread.
DEBUG ZkConnection - Closing ZooKeeper connected to 127.0.0.1:2181
DEBUG ZooKeeper - Closing session: 0x14a3340e8d7001b
DEBUG ClientCnxn - Closing client for session: 0x14a3340e8d7001b
DEBUG ClientCnxn - Reading reply sessionid:0x14a3340e8d7001b, packet:: clientPath:null serverPath:null finished:false header:: 3,-11 replyHeader:: 3,124,0 request:: null response:: null
DEBUG ClientCnxn - Disconnecting client for session: 0x14a3340e8d7001b
INFO ZooKeeper - Session: 0x14a3340e8d7001b closed
DEBUG ClientCnxn - An exception was thrown while closing send thread for session 0x14a3340e8d7001b : Unable to read additional data from server sessionid 0x14a3340e8d7001b, likely server has closed socket
DEBUG ZkClient - Closing ZkClient...done
INFO ClientCnxn - EventThread shut down
DEBUG CuratorFrameworkImpl - Closing
ERROR CuratorFrameworkImpl - Exception while sending Closing event
scala.MatchError: CLOSING (of class org.apache.curator.framework.api.CuratorEventType)
at com.stratio.streaming.api.StratioStreamingAPI$$anon$1.eventReceived(StratioStreamingAPI.scala:338)
at org.apache.curator.framework.imps.CuratorFrameworkImpl$4.apply(CuratorFrameworkImpl.java:272)
at org.apache.curator.framework.imps.CuratorFrameworkImpl$4.apply(CuratorFrameworkImpl.java:265)
at org.apache.curator.framework.listen.ListenerContainer$1.run(ListenerContainer.java:92)
at com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:297)
at org.apache.curator.framework.listen.ListenerContainer.forEach(ListenerContainer.java:83)
at org.apache.curator.framework.imps.CuratorFrameworkImpl.close(CuratorFrameworkImpl.java:262)
at com.stratio.streaming.api.StratioStreamingAPI.close(StratioStreamingAPI.scala:276)
at com.stratio.connector.streaming.ftest.thread.ThreadConnectionFT.apiStreamingTest(ThreadConnectionFT.java:98)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at org.eclipse.jdt.internal.junit4.runner.JUnit4TestReference.run(JUnit4TestReference.java:50)
at org.eclipse.jdt.internal.junit.runner.TestExecution.run(TestExecution.java:38)
at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:459)
at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:675)
at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.run(RemoteTestRunner.java:382)
at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.main(RemoteTestRunner.java:192)
DEBUG CuratorZookeeperClient - Closing
DEBUG ConnectionState - Closing
DEBUG ZooKeeper - Closing session: 0x14a3340e8d7001a
DEBUG ClientCnxn - Closing client for session: 0x14a3340e8d7001a
DEBUG ClientCnxn - Reading reply sessionid:0x14a3340e8d7001a, packet:: clientPath:null serverPath:null finished:false header:: 3,-11 replyHeader:: 3,125,0 request:: null response:: null
DEBUG ClientCnxn - An exception was thrown while closing send thread for session 0x14a3340e8d7001a : Unable to read additional data from server sessionid 0x14a3340e8d7001a, likely server has closed socket
DEBUG ClientCnxn - Disconnecting client for session: 0x14a3340e8d7001a
INFO ZooKeeper - Session: 0x14a3340e8d7001a closed
INFO ClientCnxn - EventThread shut down
INFO StratioStreamingAPI$ - Establishing connection with the engine...
WARN ZookeeperConsumer - Unable to check zNode: /stratio/streaming/engine
WARN StratioStreamingAPI$ - Ephemeral node does not exist

Is it possible to support Apache Flink?

Due to an issue in virtualbox, sandbox could not install the network interfaces.

hashicorp/vagrant#6059

There is an official workaround. Just downloand and run as administrator

https://www.virtualbox.org/attachment/ticket/14040/VBox-Win10-fix-14040.exe

Let the fix running in the background while executing vagrant up.

That should be included in the documentation

Some unit tests are being run with scalatest-maven-plugin whereas could be run with surefire (from the inherited com.stratio:parent pom)

Some clients are demanding a way to redirect Stratio Streaming output to RabbitMQ.

public ColumnNameTypeValue deserialize(JsonElement element, Type type, JsonDeserializationContext ctx)
            throws JsonParseException {
        final JsonObject object = element.getAsJsonObject();

        String name = object.get("column").getAsString();
        ColumnType columnType = ColumnType.valueOf(object.get("type").getAsString());
        JsonElement jsonValue = object.get("value");
        Object value = null;
            switch (columnType) {
                case BOOLEAN:
                    value = jsonValue.getAsBoolean();
                    break;
                case DOUBLE:
                    value = jsonValue.getAsDouble();
                    break;
                case FLOAT:
                    value = jsonValue.getAsFloat();
                    break;
                case INTEGER:
                    value = jsonValue.getAsInt();
                    break;
                case LONG:
                    value = jsonValue.getAsLong();
                    break;
                case STRING:
                    value = jsonValue.getAsString();
                    break;
                default:
                    break;
            }


        return new ColumnNameTypeValue(name, columnType, value);
    }

when the jsonValue is null ,it will report a null point error!

Now is running 0.5.0

Implement new failover which saves data in Zookeeper in order to remove Cassandra dependency.

I am trying to listening an existing stream using the API. Numerical columns are returned as Double. Therefore, there is loss of precision working with longs. The streaming shell is working OK. Is there any way to solve it?

Thanks.

Exception in thread "hz.stratio-streaming-hazelcast-instance.cached.thread-2" java.lang.NullPointerException
at com.stratio.streaming.callbacks.StreamToCassandraCallback.shutdownCallback(StreamToCassandraCallback.java:250)
at com.stratio.streaming.callbacks.StreamToCassandraCallback.onMessage(StreamToCassandraCallback.java:260)
at com.hazelcast.topic.TopicService.dispatchEvent(TopicService.java:95)
at com.hazelcast.spi.impl.EventServiceImpl$LocalEventDispatcher.run(EventServiceImpl.java:480)
at com.hazelcast.util.executor.StripedExecutor$Worker.run(StripedExecutor.java:96)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at com.hazelcast.util.executor.PoolExecutorThreadFactory$ManagedThread.run(PoolExecutorThreadFactory.java:59)

Hi, I am playing with Vagrant sandbox and going through demo with Kibana... there is an issue when executing list command. First time I started shell it worked fine, then I exited and started it again and it started misbehaving

stratio-streaming> version
1
stratio-streaming> list
Command failed java.lang.reflect.UndeclaredThrowableException
stratio-streaming> date
Monday, July 20, 2015 10:20:08 PM UTC
stratio-streaming> insert --stream sensor_grid --values "name.cpu,data.333"
Added an event to stream sensor_grid correctly
stratio-streaming> insert --stream sensor_grid --values "name.cpu,data.3333"
Added an event to stream sensor_grid correctly
stratio-streaming> insert --stream sensor_grid --values "name.cpu,data.33333"
Added an event to stream sensor_grid correctly
stratio-streaming> list
Command failed java.lang.reflect.UndeclaredThrowableException
stratio-streaming>

After that I exited shell and continued with demo steps (changing statsEnabled property to true, as described in streaming documentation) but then I encountered even bigger problems:

[vagrant@streaming ~]$ sudo vi /etc/sds/streaming/config.conf
[vagrant@streaming ~]$ sudo service streaming restart
Stopping Stratio Streaming Starting Stratio Streaming STARTED
[vagrant@streaming ~]$ /opt/sds/streaming-shell/bin/shell

/ | | () / | | | | |
| ( | | _ __ ___ __ _ _ __ ___ _ _ __ __ _ | ( | |__ | | |
** | | '/ _ / | '_ | | '_ \ / ` | ___ | ' \ / _ \ | |
_) | || | | __/ (| | | | | | | | | | | (| | _) | | | | **/ | |
|/ || **|**,|| || |||| |_|, | |_____/|| ||**|||
__/ |
|**/
Connection urls:
- Kafka: localhost:9092
- Zookeeper: localhost:2181

Type "help" to see all available commands.
stratio-streaming> list
Command failed -> Unable to connect to statio streaming
stratio-streaming> exit
[vagrant@streaming ~]$ sudo service streaming status
Checking for Stratio Streaming: Stratio Streaming seems to be running (pid 4812)
[vagrant@streaming ~]$ sudo service streaming restart
Stopping Stratio Streaming Starting Stratio Streaming STARTED
[vagrant@streaming ~]$ sudo service streaming status
Checking for Stratio Streaming: Stratio Streaming seems to be running (pid 5375)
[vagrant@streaming ~]$ /opt/sds/streaming-shell/bin/shell

/ | | () / | | | | |
| ( | | _ __ ___ __ _ _ __ ___ _ _ __ __ _ | ( | |__ | | |
** | | '/ _ / | '_ | | '_ \ / ` | ___ | ' \ / _ \ | |
_) | || | | __/ (| | | | | | | | | | | (| | _) | | | | **/ | |
|/ || **|**,|| || |||| |_|, | |_____/|| ||**|||
__/ |
|**/
Connection urls:
- Kafka: localhost:9092
- Zookeeper: localhost:2181

Type "help" to see all available commands.
stratio-streaming> list
Command failed -> Unable to connect to statio streaming
stratio-streaming>

Sometimes, errors throws by shell are java.lang.reflect.UndeclaredThrowableException.

After the latests changes the integration tests are not getting executed. The jenkins job is failing because of that:

[STREAMING_INT_TESTS] $ /bin/sh /tmp/hudson7240159017431071278.sh
*** RUN ABORTED ***
Archiving artifacts
Recording test results
Test reports were found but none of them are new. Did tests run?

Failover is not working properly when system recovers doesn't create the old streams.

Currently, there are some issues when trying to stop Stratio Streaming engine, preventing it from terminating properly.

Currently, stratio-streaming-api is depending on slf4j-log4j12 instead of slf4j-api. This forces other projects (e.g. stratio-ingestion) to add a dependency exclusion when log4j is not to be used.

The dependency should look something like this:

        <dependency>
            <groupId>org.slf4j</groupId>
            <artifactId>slf4j-api</artifactId>
            <version>1.7.7</version>
        </dependency>

This will enable you to use the Logger/LoggerFactory API from slf4j without forcing any specific implementation to the Streaming API consumer.

Create a new Gson parser to get the column type to do the correct cast.

Hi,

i downloaded the docker sandbox and got the server running on my Windows 10 server. Every time I try to create a stream from the decision shell, it times out. What could be the issue?

Thanks
Arun

Hi!

I came across this error when installing (from binaries) stratio-streaming on a cluster. After some trial and error I found in the sources that "node.stratio.com" is hardcoded in engine/src/main/resources/config.conf.
Somehow on running time stratio-streaming is picking that config file instead of the good one: /engine/src/main/config/config.conf.
How should I fix it?

Thanks in advance!

Hello,

Does anybody know why distributed mode on Shiddi is not used? There were issues?

Thank you

FYI

Constructing Javadoc information...
Standard Doclet version 1.8.0_77
Building tree for all the packages and classes...
Generating /root/opensource/Decision/api/target/apidocs/com/stratio/decision/api/partitioner/HashPartitionerStrategy.html...
Generating /root/opensource/Decision/api/target/apidocs/com/stratio/decision/api/partitioner/IPartitionerStrategy.html...
Generating /root/opensource/Decision/api/target/apidocs/com/stratio/decision/api/partitioner/JenkinsHash.html...
Generating /root/opensource/Decision/api/target/apidocs/com/stratio/decision/api/partitioner/PartitionerStrategyFactory.html...
Generating /root/opensource/Decision/api/target/apidocs/com/stratio/decision/api/partitioner/PartitionerStrategyFactory.Strategy.html...
Generating /root/opensource/Decision/api/target/apidocs/com/stratio/decision/api/partitioner/package-frame.html...
Generating /root/opensource/Decision/api/target/apidocs/com/stratio/decision/api/partitioner/package-summary.html...
Generating /root/opensource/Decision/api/target/apidocs/com/stratio/decision/api/partitioner/package-tree.html...
Generating /root/opensource/Decision/api/target/apidocs/constant-values.html...
Generating /root/opensource/Decision/api/target/apidocs/com/stratio/decision/api/partitioner/class-use/JenkinsHash.html...
Generating /root/opensource/Decision/api/target/apidocs/com/stratio/decision/api/partitioner/class-use/PartitionerStrategyFactory.html...
Generating /root/opensource/Decision/api/target/apidocs/com/stratio/decision/api/partitioner/class-use/PartitionerStrategyFactory.Strategy.html...
Generating /root/opensource/Decision/api/target/apidocs/com/stratio/decision/api/partitioner/class-use/HashPartitionerStrategy.html...
Generating /root/opensource/Decision/api/target/apidocs/com/stratio/decision/api/partitioner/class-use/IPartitionerStrategy.html...
Generating /root/opensource/Decision/api/target/apidocs/com/stratio/decision/api/partitioner/package-use.html...
Building index for all the packages and classes...
Generating /root/opensource/Decision/api/target/apidocs/overview-tree.html...
Generating /root/opensource/Decision/api/target/apidocs/index-all.html...
Generating /root/opensource/Decision/api/target/apidocs/deprecated-list.html...
Building index for all classes...
Generating /root/opensource/Decision/api/target/apidocs/allclasses-frame.html...
Generating /root/opensource/Decision/api/target/apidocs/allclasses-noframe.html...
Generating /root/opensource/Decision/api/target/apidocs/index.html...
Generating /root/opensource/Decision/api/target/apidocs/help-doc.html...
2 errors
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] Stratio Decision ................................... SUCCESS [  0.845 s]
[INFO] Decision commons ................................... SUCCESS [  2.575 s]
[INFO] Stratio Decision examples .......................... SUCCESS [  2.105 s]
[INFO] Decision Siddhi extensions ......................... SUCCESS [ 19.708 s]
[INFO] Decision engine .................................... SUCCESS [ 16.072 s]
[INFO] Stratio Decision API ............................... FAILURE [ 23.774 s]
[INFO] Decision shell ..................................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 01:05 min
[INFO] Finished at: 2016-06-04T20:34:26+08:00
[INFO] Final Memory: 89M/779M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-javadoc-plugin:2.9.1:jar (attach-javadocs) on project api: MavenReportException: Error while creating archive:
[ERROR] Exit code: 1 - /root/opensource/Decision/api/src/main/scala/com/stratio/decision/api/partitioner/JenkinsHash.java:76: error: bad HTML entity
[ERROR] * <code>h = (h & hashmask(10));</code>
[ERROR] ^
[ERROR] /root/opensource/Decision/api/src/main/scala/com/stratio/decision/api/partitioner/JenkinsHash.java:80: error: malformed HTML
[ERROR] * for (int i = 0, h = 0; i < n; ++i) h = hash( k[i], h);
[ERROR] ^
[ERROR] 
[ERROR] Command line was: /opt/software/jdk1.8.0_77/jre/../bin/javadoc @options @packages
[ERROR] 
[ERROR] Refer to the generated Javadoc files in '/root/opensource/Decision/api/target/apidocs' dir.
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn <goals> -rf :api

My PR

Hi,

I have successfully generate rpm and deb packages in my Centos7 machine and now I am trying to install Stratio Decision in another machine using the rpm file.

I am getting the following error:

rpm -i stratio-decision-1.2.0_SNAPSHOT.noarch.rpm

error: Failed dependencies:
osgi(org.sonatype.sisu.guava) is needed by stratio-decision-1.2.0_20160727.070542-1.noarch

This machine does not have maven dependencies required. Do need to have all the dependencies in my machine to install it from rpm file?

Please help me to resolve this issue.

Thanks,
Austin