java.lang.ArrayIndexOutOfBoundsException at de.undercouch.bson4jackson.io.DynamicOutputBuffer about bson4jackson HOT 8 CLOSED

Feature.ENABLE_STREAMING is on

from bson4jackson.

The BSON document which I'm trying to produce is of several gigabytes size.
Looks like DynamicOutputBuffer._position integer value overflowed its maximum value of Integer.MAX_VALUE after reaching 2147483647 bytes and became negative. Consequently it's not possible to track the offset position in a buffer greater than 2 gigabytes.

from bson4jackson.

I took a look at BsonGenerator & BsonParser, they also use integer type arithmetic for referring offset & position

from bson4jackson.

For the sake of the priority of the issue I've adjusted bson4jackson classes to use long arithmetic. If you would like to convey them back to the repo the changes are available at the https://github.com/nuodb/migration-tools/tree/master/core/src/main/java/de/undercouch/bson4jackson.

Best Regards, Sergey.

from bson4jackson.

Thank you very much for your work!

I would have preferred a pull request though, since I cannot see what you changed exactly. Reformatting the files destroyed the possibility to create a reasonable diff.

So, if you want the change to be included in bson4jackson please send me a pull request and please do not format the files.

Thanks!
Michel

from bson4jackson.

I'm about to release a new version of bson4jackson. If you want your change to be included please send me a proper pull request. Thanks a lot!

I will close this issue if I don't receive an answer until Monday, 29th.

Cheers,
Michel

from bson4jackson.

I will close this issue due to no activity.

from bson4jackson.

Same problem here. This problem makes it impossible to use this library for large structures/files.

from bson4jackson.