Comments (4)
AdamWill
commented on July 22, 2024
Oh, I see why the tests were skipped before: we intentionally leave out the build dependency on arrow on s390x, but it seems that it's now being pulled into the s390x build environment by some other dependency chain which I guess wasn't there before.
from dask.
phofl
commented on July 22, 2024
pyarrow is a required dependency for dask-expr, which is the default dataframe backend now. So if it's only this that's causing the tests to fail, then we can close here. This is now the expected behavior
from dask.
AdamWill
commented on July 22, 2024
I didn't honestly look into the details of the failure very closely. I don't know if it's only arrow bits that are not BE-safe, or if there's stuff in dask itself and/or these tests that is not BE-safe. arrow is needed for these tests to run, which is why we didn't see it downstream before, but it doesn't mean the problems are in (or only in) arrow.
from dask.
phofl
commented on July 22, 2024
Closing this for now then, please ping to reopen if those are legit dask failures
from dask.
Related Issues (20)
- Text Vectorization Pipeline example failed at feature hashing HOT 4
- Pandas nightlies broken
- Handling errors in Dask distributed
- `imread` relies on `skimage.io.imread` (instead of `imageio.v3.imread`?) HOT 1
- More support for serialization & deserialization. HOT 3
- Dask DataFrame fails to export to parquet when using ProcessPoolExecutor
- Dask and FastAPI can't run at the same process. HOT 2
- Handle np.frombuffer HOT 2
- copy.deepcopy() doesn't work with new dataframe API HOT 1
- Discrepancy Between Native Pandas Types And Dask Computed Pandas Types HOT 2
- Negative lookahead suddenly incorrectly parsed HOT 3
- Removal of Sphinx context injection at build time
- Roundtripping timezone-aware DataFrame through parquet doesn't preserve timestamp resolution
- from_pandas fails when given empty dataframe and chunksize HOT 2
- Array slicing is using low level materialized graphs
- Pyarrow <NA> filters are not being applied in read_parquet
- When Dask merges two large tables, the _merge column disappears. However, it appears normally when merging with a smaller table. HOT 4
- `read_sql_table` no longer sets index name in the resulting ddf meta
- Optimizer applies parquet `filters` after loading when using `read_parquet(...).map_partitions(...).compute()`
- Create dask array from non-dask npy stack
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from dask.