olange / data-pipes Goto Github PK
View Code? Open in Web Editor NEWA set of invisible yet fabulous components to access data
License: BSD 3-Clause "New" or "Revised" License
A set of invisible yet fabulous components to access data
License: BSD 3-Clause "New" or "Revised" License
Next to the description of the schema of data literals, we would need to describe transformations of theirselves. The ability to express data transformations in the data plane promotes:
Figure out a way to express transformations in data-pipes.
Higher-level data-structures challenges: we would like the ability to use/handle/transport metadata and schema — although transforms might leave metadata and schema in terminals only — and may be, provide immutable data-structures as a result (however, how to handle streaming data, and how-to traverse the worker context?), or may be just frozen objects.
Start with the Streams API, as it provides transformation of binary data and chunked data (aka streaming). As well as service workers, web workers, transferable objects and indexed DB.
Usually, when client-side data transforms reach a certain degree of sophistication, developers move them to the middle- or back-end.
In the case of complex back-end APIs, moving transforms to these tiers might be either not feasible, or unpractical, requiring extensive testing. For instance, Cloud Firestore offers a rich set of near real-time synchronization features of mobile and web apps with the datastore, traversing CDNs, yet its querying API is limited — though already powerful.
Hence the need to transform them in the front-end — however we lack a universal API for such transforms, including immutable data-structures where possible, as Clojure would provide.
Ability to transform data in Javascript is scattered around:
Map
/Set
/upcoming Record
);And have I forgot to name XSLT and XPath? XSLT expresses data transforms and is available to browsers — however this technology geared towards transforming XML documents.
Find a way to attach metadata to our data-structures.
Attach a metadata
Symbol to data-structures. Use only native objects (Boolean, Number, String, …) to represent terminal values, instead of built-in primitive values – see first comment hereafter; good idea, but they do not pass in/out workers.
Description of the schema of returned data serves following purposes:
Schema description should circulate in following forms:
Ideally, it should be possible to produce such a schema description automatically:
The DSL should also support optional annotations, that would allow to:
String
type to 25 chars);Prefer schema description languages that mimic type systems that provide support for typing of data literals, such as GraphQL or Flow.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.