Comments (4)
I think we need to include functionality for setting up a database. We should make as many sane choices for users as possible, and we should assume that users are going to use individual databases for basic data science tasks. Therefore any hyper-scale database functionality is out of scope
from sixtyfour.
Okay, can include db setup function(s).
from sixtyfour.
Working on this on branch dbs
notes trying to sort out how to do these functions
- https://aws.amazon.com/blogs/opensource/getting-started-with-r-on-amazon-web-services/
- https://blog.davisvaughan.com/posts/2017-05-10-aws-rds-r/
- https://medium.com/analytics-vidhya/connecting-amazon-relational-database-with-r-d9b800e5efb0
- connecting with a python client https://docs.aws.amazon.com/redshift/latest/mgmt/python-connect-examples.html
- sorting out connection failure https://docs.aws.amazon.com/redshift/latest/mgmt/connecting-refusal-failure-issues.html
- localstack docs for redshift https://docs.localstack.cloud/user-guide/aws/redshift/
from sixtyfour.
Right now I made the following assumptions/decisions/questions:
- no fxns for deleting/updating/etc. databases are available in this pkg. I assume we just provide the creation fxn, and then the user is left to use the AWS dashboard to do the rest. Do we want to provide additional fxn-ality beyond create and connect?
- there's only one client for each of RDS and Redshift right now. That is, one set of credentials for each of the services. The only issue comes if a user has 2 or more sets of credentials they want to use in the same R sessions. See #20 for more
- we do not have fxns for setting up security groups right now. should we? then we could make it one less step outside of R to get a DB up and running?
- generate strings for users? right now to set up a DB users have to think of an ID name for the instance, and set a user name and password. We could use a dependency to generate these things. Should we?
from sixtyfour.
Related Issues (20)
- Allow users to set their AWS account within exported functions?
- aws_bucket_delete visibly returns an empty list on successful bucket deletion HOT 1
- repo tidying
- RDS IAM flow function aws_user_add_to_rds
- use minio for s3 testing at least on gh actions HOT 1
- Impersonate for admins?
- Document minio usage in more detail
- Localstack HOT 1
- Magic functions HOT 1
- Fill out Description field in DESCRIPTION file
- Simulate user
- RDS list and create throwing errors HOT 2
- Is return value of aws_bucket_upload correct? HOT 4
- Return value for aws_file_delete HOT 2
- Users can see buckets they haven't been granted permissions for HOT 5
- aws_file_upload changes file w/o extension into a directory within the s3 bucket HOT 1
- magic function idea: six_bucket_delete HOT 5
- aws_secrets_all errors when there are no secrets HOT 2
- user with write permissions for bucket unable to upload folders or files HOT 5
- magic function: six_file_upload HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from sixtyfour.