Comments (4)
Hi Jeff, Can you provide a bit more info on why instead of what? Who wants this functionality? I also like to see a plan of how this work can be isolated from any effects due to awkward
rewrites (one already happened since the original release). Also, it would be so nice if the debugging work that Jim and others already performed on equivalent functionality withinawkward
doesn't have to be repeated here. Perhaps this is a good use case for thinking about how to run libraries within Ceph/CLS using outcomes of Saloni's work on WebAssembly isolates.
from skyhookdm-ceph-cls.
Good points Carlos, thanks. I totally agree and updated the beginning of the comment to add motivation. We should definitely not duplicate awkward functionality, and get in the business of closely tracking awkward lib. It was really meant to use as a motivation of the types of list ops scientific analysts use. Probably the simple ops can apply to lists in general so I think this will be very useful. Regarding WebAssembly, yes I think once we understand how to express and offload list predicates, we should definitely consider the feasibility of a WebAssembly approach for awkward.
from skyhookdm-ceph-cls.
Now that I know a bit more about Arrow, doesn't this duplicate Arrow compute
and function
functionalities?
from skyhookdm-ceph-cls.
Yes we can use the array ops available in Arrow. Xiongfeng is working on this.
from skyhookdm-ceph-cls.
Related Issues (20)
- add step to CI pipeline to push rook-compatible image to dockerhub
- add step to CI pipeline to bump up the submodule commit of the ceph fork HOT 1
- incorporate buildkit caching feature to CI pipeline
- Start SkyhookDM documentation at Read the Docs HOT 1
- Create "Hello World" instructions HOT 1
- Create development environment instructions HOT 2
- create high-level c++ api HOT 1
- port wiki documentation to readthedocs HOT 8
- Implement Rados reads in CLS
- Fix epel repo issue HOT 1
- Add indexing for Arrow data format
- Add dev container for vstart
- Document how to use rados namespaces as buckets
- Upgrade to new Apache Arrow v1.0.0
- arrow-cls: setup for running unit tests
- arrow-cls: InMemoryFragment interface to object store's API
- arrow-cls: work on benchmarks HOT 1
- implement arrow::dataset::Fragment on (invoke cls via librados)
- create a librados cls sdk mock HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from skyhookdm-ceph-cls.