Giter Club home page Giter Club logo

Comments (7)

vinllen avatar vinllen commented on May 16, 2024

你主备是跑在一台机器上?shake会记录checkpoint,重启后会重新从之前的checkpoint拉取,机器时间是一致的?

from mongoshake.

shiftyman avatar shiftyman commented on May 16, 2024

主备在同一台跑的,所以时间是一致的。

其实源存储的checkpoint是相对于源来说的吧,表示源已经被拉取后的最后的时间点,所以下次从相对于源的oplog的这个checkpoint时间点继续拉取,理应不会有漏掉才对,不管各个组件的时间是否一致,对不对?

但是现在就是丢了

from mongoshake.

vinllen avatar vinllen commented on May 16, 2024

是否有错误日志

from mongoshake.

shiftyman avatar shiftyman commented on May 16, 2024

日志没发现有错误提示,你可以模拟我说的场景试试

from mongoshake.

vinllen avatar vinllen commented on May 16, 2024

给一下shake和Mongodb的版本号

from mongoshake.

shiftyman avatar shiftyman commented on May 16, 2024

shake是master分支,是1.4.3?
Mongodb是3.2.11版本,用的副本集

from mongoshake.

vinllen avatar vinllen commented on May 16, 2024

启用upsert和insert_on_dup_update开关可以解决。这个原因是因为插入是bulkWriter,多条聚合后插入,如果有1条有重复数据将导致这一批数据都插入失败,启用开关可以解决这个问题。
replayer.executor.upsert = true
replayer.executor.insert_on_dup_update = true

from mongoshake.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.