Comments (3)
davidanthoff
commented on June 22, 2024
2
I would much prefer if we could keep DataTables.jl as the place for a container based approach to missing values. At this point it is not clear whether the Union{T,Null} approach can work for the whole data ecosystem (e.g. Query.jl) and I don't think we should start to convert anything in this repo here until that is sorted out.
Why not do the Nulls.jl work in a branch in DataFrames.jl?
from datatables.jl.
ararslan
commented on June 22, 2024
1
Why not just do this in DataFrames/DataArrays, since the approach there is already the closest to how Nulls.jl works?
from datatables.jl.
nalimilan
commented on June 22, 2024
1
Because storing columns as Array{Union{T, Null}} is going to be quite slow until (at least) Julia 1.0, and because AFAIK we don't want to continue using Nullable in the future. So better keep DataFrames usable for now (maybe porting DataArrays to Null, but keeping them for efficient memory layout) and apply breaking changes to DataTables, which are still in an experimental state. After Julia 1.0 we should be able to make DataFrames and DataTables converge to a common representation.
from datatables.jl.
Related Issues (20)
- documentation link broken HOT 1
- Recommended date to make DataTables branches master HOT 4
- Overwrites DataFrames describe function HOT 11
- "correct" join results HOT 9
- usefulness of a `colwise!` method? HOT 5
- Strange error message at REPL with the latest Julia nightly HOT 5
- complete_cases for selected columns HOT 21
- How do I use CSV.read to return a DataTable instead of a DataFrame? HOT 3
- Make DataTables a major release of DataFrames HOT 3
- duplicate functionality in merge! and hcat! HOT 2
- Tag a new version? HOT 4
- Don't reexport Statsbase HOT 5
- describe does not function HOT 1
- Throw error for type mismatch using join? HOT 5
- Join on columns of different name HOT 4
- Compiling error HOT 1
- Backporting to DataFrames HOT 7
- Future of DataTables HOT 13
- `==` does not compare columns of `ZonedDateTime`s correctly HOT 7
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from datatables.jl.