Comments (1)
Agreed, but even the ODBC interface has issues with this. i.e. just try doing:
library(DBI)
library(odbc)
library(tidyverse)
DBI::dbConnect(
odbc::odbc(),
driver = "/Library/mapr/drill/lib/libdrillodbc_sbu.dylib",
ConnectionType = "Zookeeper",
AuthenticationType = "No Authentication",
ZKCLusterID = "drillbits1",
ZkQuorum = "localhost:2181",
AdvancedProperties = "CastAnyToVarchar=true;HandshakeTimeout=30;QueryTimeout=180;TimestampTZDisplayTimezone=utc;
ExcludedSchemas=sys,INFORMATION_SCHEMA;NumberOfPrefetchBuffers=5;"
) -> drill_con
dbCreateTable(drill_con, "dfs.tmp.mtcars", mtcars)
One reason for the ODBC interface error is the syntax Drill needs.
One of the only ways I initially went down a path on was to save off a data frame as JSON then use CREATE TABLE x AS SELECT cols FROM thejsonfile
but that wld assume Drill is running on the local host. Trying to generalize that (e.g. having an option to automatically scp the JSON to a remote Drill server, having an option to point the CTAS
call to a specific path assuming it was, say an NFS share, etc) would require doing quite a bit of condition handling and hasn't made it back to the priority list.
I also went down a path of using CTAS
and then adding VALUES()
but the REST interface rly does not like it when you do that with a ton of columns and values.
I'll keep the issue open tho in the event I get some time or others find it and have other ideas on how to make it work.
from sergeant.
Related Issues (20)
- BREAKING STUFF: 0.7.0 re-introducts JDBC dependency HOT 4
- Problem with installing sergeant HOT 2
- drill_version(ds) failed HOT 6
- Provide an automated downloader and way to start drill-embedded? HOT 1
- REST API: Add support for new query metadata in 1.15.0 release
- Add example of accessing S3 files HOT 3
- Switch to rapidjsonr HOT 2
- better error messages on query failures HOT 2
- Support field type metadata prior to rapidjsonr switch HOT 3
- Column data types not being parsed under v0.8.0-dev HOT 8
- dplyr interface does not work outside of `cp` schema HOT 1
- Support dbQuoteIdentifier method for `src_drill` class HOT 2
- Should dplyr idioms work if `tbl()` source is a custom SQL statement? HOT 4
- Improve drill_up() interactive experience HOT 3
- drill_up fails (maybe due to Docker Toolkit?) HOT 2
- Out of memory Issue reading single column from parquet file
- "bad pad value" when trying to install from GitHub HOT 2
- Prepare for new streaming JSON
- table identifier escaping causing dplyr interface errors HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from sergeant.