Context: OS: macOS 12.2.1 Chip: Apple M1 Pro Node: v16.13.2 rocksdb: 5

Could you write a simple (JS not TS) to reproduce?

<div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clip

Memory leak in `db.getMany()` about rocksdb HOT 4 CLOSED

tzapzoor commented on June 14, 2024

Memory leak in `db.getMany()`

from rocksdb.

Comments (4)

vweevers commented on June 14, 2024 1

Could you write a simple (JS not TS) script to reproduce?

from rocksdb.

vweevers commented on June 14, 2024 1

Thanks, looking into it. Also reproduces on other implementations (that share code):

const { ClassicLevel } = require('classic-level')

const db = new ClassicLevel('./db/' + Date.now())
const keys = new Array(2000).fill(0).map((_, i) => String(i))

;(async () => {
  while (true) {
    await db.getMany(keys)
    console.log(process.memoryUsage().rss / 1024 / 1024)
  }
})()

from rocksdb.

vweevers commented on June 14, 2024 1

Fixed in 5.2.1. Thanks for the report - and your Open Collective donation ❤️

from rocksdb.

tzapzoor commented on June 14, 2024

const level = require('level-rocksdb');

let db = level('./database', { valueEncoding: 'json' });

const getKeys = () => {
    let keys = [];

    for (let i = 0; i < 2000; i++) {
        keys.push('a');
    }

    return keys;
};

(async () => {
    await db.open();

    while (true) {
        let keys = getKeys();
        let values = await db.getMany(keys);
        console.log(values.length);
    }
})();

This can be run on an empty database as well. It fills 5GB in 2 minutes and growing.

from rocksdb.

Recommend Projects