Giter Club home page Giter Club logo

Comments (4)

nphyx avatar nphyx commented on August 19, 2024

If it's the inserts, not the reads, that are lagging, will they not also lag when inserted into the archive table? Or do you plan to not index them (meaning very high read lag)?

from logblock.

DiddiZ avatar DiddiZ commented on August 19, 2024

No, but using some kind of bulk insert (several thousand rows at once), that should help to create the indices faster.

from logblock.

rautamiekka avatar rautamiekka commented on August 19, 2024

It's true this will get the table's SELECTions alot faster with alot smaller indices and smaller table, but after all a regular SQL table is designed to contain any amount of data and still be reasonably fast, especially on MySQL. Take our Mainworld table for an example, it has over 33 million rows and SELECT was always fast on one engine and so much faster on second. I grant that a table with 33k rows is faster than 33 million, but in the end with proper conf you won't mind 2-100ms slower SELECT.

But, like I've read, moving shit from a table to archiving table is wasting of all with proper-like table and index design. LB's block change table indexing is about as perfect as it can get by my experience, so slow SELECT or INSERT comes from totally wrong conf.

from logblock.

Brokkonaut avatar Brokkonaut commented on August 19, 2024

As we have bulk inserts in the main table now, I don't think there is a reason for an additional archive table

from logblock.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.