Giter Club home page Giter Club logo

cdc-stressor's People

Contributors

piodul avatar

Watchers

avatar avatar

Forkers

aleksbykov

cdc-stressor's Issues

CDC Stressor Tool failing during a longevity-10g-3h-test

during longevity-10g-3h-test we had a nemesis called RunCDCStressorTool and it failed.
the command executed by nemesis is cdc-stressor -stream-query-round-duration 30s
the error message is:

TransportError(429, 'circuit_breaking_exception', '[parent] Data too
 large, data for [<http_request>] would be [1067233530/1017.7mb], which is larger than the limit of [1020054732/972.7mb], real usage: [1067232576/1017.7mb], new bytes reserved: [954/954b], usages [reques
t=51888128/49.4mb, fielddata=4202/4.1kb, in_flight_requests=207550474/197.9mb, model_inference=0/0b, accounting=56641464/54mb]')

the logs to the failed are here:
sct.log
db-cluster.logs

cdc-stresor failed with index out of range [0] with length 0

next schema was created:

[shard 0] migration_manager - Create new ColumnFamily: org.apache.cassandra.config.CFMetaData@0x600009181c00[cfId=b5d20b21-7fae-11ea-be51-000000000000,ksName=ks1,cfName=table1,cfType=Standard,comparator=org.apache.cassandra.db.marshal.CompositeType(org.apache.cassandra.db.marshal.FloatType,org.apache.cassandra.db.marshal.ByteType,org.apache.cassandra.db.marshal.TimestampType,org.apache.cassandra.db.marshal.UTF8Type,org.apache.cassandra.db.marshal.ColumnToCollectionType(636f6c37:org.apache.cassandra.db.marshal.MapType(org.apache.cassandra.db.marshal.UTF8Type,org.apache.cassandra.db.marshal.TimeUUIDType))),comment=,readRepairChance=0,dcLocalReadRepairChance=0.1,gcGraceSeconds=864000,keyValidator=org.apache.cassandra.db.marshal.CompositeType(org.apache.cassandra.db.marshal.Int32Type, org.apache.cassandra.db.marshal.ShortType, org.apache.cassandra.db.marshal.ByteType, org.apache.cassandra.db.marshal.ShortType, org.apache.cassandra.db.marshal.ShortType),minCompactionThreshold=4,maxCompactionThreshold=32,columnMetadata=[ColumnDefinition{name=pk0, type=org.apache.cassandra.db.marshal.Int32Type, kind=PARTITION_KEY, componentIndex=0, droppedAt=-9223372036854775808}, ColumnDefinition{name=pk1, type=org.apache.cassandra.db.marshal.ShortType, kind=PARTITION_KEY, componentIndex=1, droppedAt=-9223372036854775808}, ColumnDefinition{name=pk2, type=org.apache.cassandra.db.marshal.ByteType, kind=PARTITION_KEY, componentIndex=2, droppedAt=-9223372036854775808}, ColumnDefinition{name=pk3, type=org.apache.cassandra.db.marshal.ShortType, kind=PARTITION_KEY, componentIndex=3, droppedAt=-9223372036854775808}, ColumnDefinition{name=pk4, type=org.apache.cassandra.db.marshal.ShortType, kind=PARTITION_KEY, componentIndex=4, droppedAt=-9223372036854775808}, ColumnDefinition{name=ck0, type=org.apache.cassandra.db.marshal.FloatType, kind=CLUSTERING_COLUMN, componentIndex=0, droppedAt=-9223372036854775808}, ColumnDefinition{name=ck1, type=org.apache.cassandra.db.marshal.ByteType, kind=CLUSTERING_COLUMN, componentIndex=1, droppedAt=-9223372036854775808}, ColumnDefinition{name=ck2, type=org.apache.cassandra.db.marshal.TimestampType, kind=CLUSTERING_COLUMN, componentIndex=2, droppedAt=-9223372036854775808}, ColumnDefinition{name=col0, type=org.apache.cassandra.db.marshal.ByteType, kind=REGULAR, componentIndex=null, droppedAt=-9223372036854775808}, ColumnDefinition{name=col1, type=org.apache.cassandra.db.marshal.DurationType, kind=REGULAR, componentIndex=null, droppedAt=-9223372036854775808}, ColumnDefinition{name=col10, type=org.apache.cassandra.db.marshal.UTF8Type, kind=REGULAR, componentIndex=null, droppedAt=-9223372036854775808}, ColumnDefinition{name=col11, type=org.apache.cassandra.db.marshal.UUIDType, kind=REGULAR, componentIndex=null, droppedAt=-9223372036854775808}, ColumnDefinition{name=col12, type=org.apache.cassandra.db.marshal.BytesType, kind=REGULAR, componentIndex=null, droppedAt=-9223372036854775808}, ColumnDefinition{name=col13, type=org.apache.cassandra.db.marshal.FloatType, kind=REGULAR, componentIndex=null, droppedAt=-9223372036854775808}, ColumnDefinition{name=col2, type=org.apache.cassandra.db.marshal.SimpleDateType, kind=REGULAR, componentIndex=null, droppedAt=-9223372036854775808}, ColumnDefinition{name=col3, type=org.apache.cassandra.db.marshal.FloatType, kind=REGULAR, componentIndex=null, droppedAt=-9223372036854775808}, ColumnDefinition{name=col4, type=org.apache.cassandra.db.marshal.AsciiType, kind=REGULAR, componentIndex=null, droppedAt=-9223372036854775808}, ColumnDefinition{name=col5, type=org.apache.cassandra.db.marshal.TupleType(org.apache.cassandra.db.marshal.TimestampType, org.apache.cassandra.db.marshal.SimpleDateType, org.apache.cassandra.db.marshal.LongType, org.apache.cassandra.db.marshal.BytesType, org.apache.cassandra.db.marshal.DurationType, org.apache.cassandra.db.marshal.AsciiType, org.apache.cassandra.db.marshal.ShortType), kind=REGULAR, componentIndex=null, droppedAt=-9223372036854775808}, ColumnDefinition{name=col6, type=org.apache.cassandra.db.marshal.DurationType, kind=REGULAR, componentIndex=null, droppedAt=-9223372036854775808}, ColumnDefinition{name=col7, type=org.apache.cassandra.db.marshal.MapType(org.apache.cassandra.db.marshal.UTF8Type,org.apache.cassandra.db.marshal.TimeUUIDType), kind=REGULAR, componentIndex=null, droppedAt=-9223372036854775808}, ColumnDefinition{name=col8, type=org.apache.cassandra.db.marshal.TupleType(org.apache.cassandra.db.marshal.FloatType, org.apache.cassandra.db.marshal.IntegerType, org.apache.cassandra.db.marshal.TimestampType, org.apache.cassandra.db.marshal.InetAddressType), kind=REGULAR, componentIndex=null, droppedAt=-9223372036854775808}, ColumnDefinition{name=col9, type=org.apache.cassandra.db.marshal.UTF8Type, kind=REGULAR, componentIndex=null, droppedAt=-9223372036854775808}],compactionStrategyClass=class org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={enabled=true},compressionParameters={sstable_compression=org.apache.cassandra.io.compress.LZ4Compressor},bloomFilterFpChance=0.01,memtableFlushPeriod=0,caching={"keys":"ALL","rows_per_partition":"ALL"},cdc={"enabled":"true","postimage":"false","preimage":"false","ttl":"86400"},defaultTimeToLive=0,minIndexInterval=128,maxIndexInterval=2048,speculativeRetry=99.0PERCENTILE,triggers=[],isDense=false,version=b5d20b22-7fae-11ea-be51-000000000000,droppedColumns={},collections={636f6c37 : org.apache.cassandra.db.marshal.MapType(org.apache.cassandra.db.marshal.UTF8Type,org.apache.cassandra.db.marshal.TimeUUIDType)},indices={}]

2020/04/16 06:52:13 Watching changes from 1455 of 1455 total streams
panic: runtime error: index out of range [0] with length 0

goroutine 89 [running]:
github.com/gocql/gocql.readInt(...)
/go/src/github.com/gocql/gocql/frame.go:322
github.com/gocql/gocql.readBytes(...)
/go/src/github.com/gocql/gocql/marshal.go:1895
github.com/gocql/gocql.unmarshalTuple(0x78c620, 0xc0000ee080, 0x0, 0x0, 0x0, 0x6b3e80, 0xc013441420, 0x0, 0xc01073f9a0)
/go/src/github.com/gocql/gocql/marshal.go:1917 +0x1217
github.com/gocql/gocql.Unmarshal(0x78c620, 0xc0000ee080, 0x0, 0x0, 0x0, 0x6b3e80, 0xc013441420, 0x0, 0x0)
/go/src/github.com/gocql/gocql/marshal.go:166 +0xd56
github.com/gocql/gocql.scanColumn(0x0, 0x0, 0x0, 0xc00011f4ac, 0x3, 0xc0000e85e0, 0x15, 0xc00011f4b0, 0x4, 0x78c620, ...)
/go/src/github.com/gocql/gocql/session.go:1341 +0x1b3
github.com/gocql/gocql.(*Iter).Scan(0xc0106cbb00, 0xc00095c680, 0x33, 0x58, 0x96b040)
/go/src/github.com/gocql/gocql/session.go:1446 +0x2e2
github.com/gocql/gocql.(*Iter).MapScan(0xc0106cbb00, 0xc01073fde8, 0x7247ac)
/go/src/github.com/gocql/gocql/helpers.go:411 +0x16c
main.processStream.func1(0xc000133260, 0xbf9e1e0744942771, 0xfffffffffb8b6027, 0x94d700, 0xc0000e8240, 0x19, 0xc0000bc380, 0xc0000faf00, 0xc00025abc0, 0x10, ...)
/go/src/github.com/piodul/cdc-stressor/main.go:286 +0x306
created by main.processStream
/go/src/github.com/piodul/cdc-stressor/main.go:252 +0xde

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.