Comments (5)
Yes, we should probably guard these as we guard nanprod
from dask.
That seems perfectly reasonable. I started doing that, but I think they were being imported dask/array/init.py#3f5e6e69137be3b4ffffc7cc3390d19d6c6b73e5. Is it ok if this is eliminated?
I noticed that you were just using nansum
. So, I figured it would be fine to have your functions and skip the wrappings, which I did here ( https://github.com/jakirkham/dask/tree/numpy_1_7_support ).
However, I ran into another surprise, which is nansum
does not supply the keepdims
argument. So, whatever solution is settled upon should probably have a workaround for keepdims
, as well.
from dask.
They should probably be imported in __init__.py
if they are available. Not sure on the least ugly way to do this (maybe __all__
in reductions.py?).
Skipping just the wrappings sounds great.
Arg, not supporting keepdims is a pain. At the moment I don't see a clear way around this other than by fundamentally changing how we do reductions. This might require some cleverness but is probably possible. Thoughts?
from dask.
Using __all__
seems reasonable.
Good to hear.
As for the last bit, I think this should be doable. I tried adding a wrapper function called keepdims_wrapper
, which appears to work ( jakirkham@89b9395 ). It could be applied at the reduction stage (as done in the commit), which guarantees that all functions used have keepdims
of some sort. Alternatively, it could be applied earlier when wrapping all the numpy
functions, which would reduce the performance hit of doing the actual wrapping and inspection.
from dask.
Nevermind, it appears following the last case is required.
from dask.
Related Issues (20)
- toolz-0.12.0 doesn't have tlz.curry that is expected by dask-2023.12.1 HOT 2
- Rename shuffle to shuffle_method in remaining methods
- Deprecate axis in GroupBy cumulative transformers
- Deprecate axis keyword in rolling
- Non deterministic tokenization for empty numpy arrays after pickle roundtrip HOT 2
- Deprecate method and limit from fillna
- Deprecate convert_dtype in apply
- Doc build broken HOT 1
- GPU CI failing HOT 3
- `dask.array.tensordot` bug: negative values in argument `axes` give wrong results.
- Wrong `string[pyarrow]` dtype after using `unique()` with pyarrow as an engine
- _compute_sum_of_squares uses pandas.DataFrame.groupby without `observed` HOT 1
- `SeriesGroupBy.agg` does not accept `Aggregate`s when passed as kwargs HOT 3
- `make_meta` over a Dask Dataframe returns a reference, not a new object
- pandas 2.2: dask-expr failure in test_groupby_reduction_split[median] HOT 1
- pandas 2.2: changed behaviour in `test_multi.py::test_concat5` HOT 1
- SeriesGroupBy.agg does not accept `Aggregate` when paired with `'median'`
- ⚠️ Upstream CI failed ⚠️
- Tests for dummy data generation failing HOT 1
- pyright: "read_parquet" is not exported from module "dask.dataframe" HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from dask.