Comments (4)
@fqazi - what do you think of the above approach? We should be able to expand this for other schema changes involving backfill as well right?
from cockroach.
I think its a reasonable approach, and I think was probably not there because it seems far less likely. We probably didn't expect the column backfill to balloon the size too much with an in place backfill.
from cockroach.
I think there is a very real possibility of column backfill leading to this scenario. In the legacy case, we will rewrite all the rows containing the new column which will easily 2x the table size until GC runs. With the declarative schema changer, we simply recreate the index so once again the space usage is high. I think this is worth prioritizing as it will at least prevent cluster outages due to the disk filling up.
from cockroach.
Let's add this check for the column backfiller here:
Lines 2393 to 2397 in d7f4220
And also in the declarative schema changer here:
from cockroach.
Related Issues (20)
- Sentry: store_remove_replica.go:120: log.Fatal: replica descriptor's ID has changed (3 >= 2) (1) attached stack trace -- stack trace: | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).re... HOT 1
- schemachanger: handle prepared statements in DSC HOT 1
- telemetry: apply sampling rules to more statement types other than DML
- util/log: TestHTTPSinkHeadersAndCompression failed
- roachtest: cluster_creation failed HOT 21
- ccl/backupccl: TestOnlineRestoreBasic failed HOT 2
- ccl/multitenantccl/tenantcostclient: TestDataDriven failed HOT 2
- Sentry: catch.go:29: runtime error: invalid memory address or nil pointer dereference (1) assertion failure Wraps: (2) attached stack trace -- stack trace: | github.com/cockroachdb/cockroach/pkg/u... HOT 1
- ccl/kvccl/kvfollowerreadsccl: TestBoundedStalenessDataDriven failed HOT 1
- ccl/backupccl: TestClusterRestoreFailCleanup failed
- kvserver: log iterator stats for lock table scan HOT 1
- sql/tests: TestRandomSyntaxGeneration failed HOT 1
- roachtest: schemachange/mixed-versions failed HOT 4
- roachtest: multitenant/distsql/instances=20/bundle=on/timeout=1 failed
- pkg/sql/logictest/tests/cockroach-go-testserver-23.1/cockroach-go-testserver-23_1_test: TestLogic_pg_lsn_mixed failed
- pkg/sql/logictest/tests/cockroach-go-testserver-23.1/cockroach-go-testserver-23_1_test: TestLogic_upgrade_skip_version failed
- roachtest: costfuzz/rand-multi-region failed
- ccl/kvccl/kvfollowerreadsccl: TestBoundedStalenessDataDriven failed HOT 1
- internal/sqlsmith: TestGenerateParse failed HOT 1
- internal/sqlsmith: TestGenerateParse failed HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from cockroach.