Giter Club home page Giter Club logo

meerschaum's Introduction

Hi, I'm Bennett! ✌️

I'm a data engineer and the author of the open source library Meerschaum, which is meant to make your life as a data analyst easier.

Meerschaum bubbles gif

Some Info About Me...

  • 🐯 I have a masters in CS from Clemson University.
  • 🕒 Time-series ETL is my thing.
  • Python + SQL = ❤️
  • I love mentoring and teaching new developers!

Video Tutorials

I have a tutorial series called Learning Meerschaum, where we walk through ways you can use Meerschaum in your projects. Check out some episodes below!

Meerschaum in 100 seconds Meerschaum tutorial series Meerschaum tutorial series Meerschaum tutorial series Meerschaum tutorial series

meerschaum's People

Contributors

bmeares avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar

meerschaum's Issues

Credentials needed to delete a plugin

Trying to delete a plugin, but receive an error requiring authentication "login api:mrsm". Can not recall setting credentials for this connector and unable to locate reference for default credentials in docs.
Screen Shot 2022-02-01 at 12 08 53 PM
.

v1.1.0 Breaks the behavior of the Docker image

I'm opening this issue as a note to myself and others who are using Dockerized Meerschaum. Changes to the virtual environment system in v1.1.0 mean that dependencies are more strictly enforced to be installed within the specified virtual environment. The behavior of the latest and full images relies on installing all of the dependencies in the user environment, so this change reverts its behavior to the same as the minimal image.

A temporary workaround for this is to persist a docker volume mounted at /meerschaum (the container's root), and run the command mrsm upgrade packages -y which will install everything into the virtual environment.

I will be working on a more permanent solution in the coming days, mainly considering a package as "not installed" when it's detected in the user environment if it fails the version check. Admittedly, I added the stricter behavior to avoid having to go the long way around and verify the version, but now I realize there's no easy way to get around that.

Expect a patch in v1.1.1 to be out soon!

"mrsm show pipes" generates a database connection error.

Primary issue appears to indicate that MRSM and TimescaleDB are not able to communicate. I have verified that mrsm_db_1 is running in Docker.

CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
c3a41726b5b9 timescale/timescaledb:latest-pg13-oss "docker-entrypoint.s…" 12 hours ago Restarting (1) 25 seconds ago mrsm_db_1

Previous communication
"You can use the preconfigured docker-compose stack, just run mrsm stack up -d db to get TimescaleDB up. You can first set the password with mrsm edit config before running mrsm stack up -d db or you can change the password later (default is username: mrsm and password: mrsm)."

Note: there is no mrsm user on the system only my azureuser


Distributor ID: Ubuntu
Description: Ubuntu 20.04.3 LTS
Release: 20.04
Codename: focal

Setup/Install Notes:

  1. Setup DOCKER on Azure VM (needed to add "azureuser", sudo usermod -a -G docker azureuser)
  2. pip install meerschaum (mrsm was installed in /home/.local/bin and needed to add to PATH)
  3. mrsm stack up -d db
  4. test mrsm install "$mrsm" successfully starts mrsm session (everything looks good)
  5. mrsm show pipes generates the following error:

⚠️ (psycopg2.OperationalError) could not connect to server: Connection refused
Is the server running on host "localhost" (127.0.0.1) and accepting
TCP/IP connections on port 5432?
(Background on this error at: https://sqlalche.me/e/14/e3q8)
warn(str(e))
💢 Failed to execute 'show pipes' with exception:
' 🛑 (psycopg2.OperationalError) could not connect to server: Connection refused
Is the server running on host "localhost" (127.0.0.1) and accepting
TCP/IP connections on port 5432?
(Background on this error at: https://sqlalche.me/e/14/e3q8)'.
Run again with '--debug' to see a full stacktrace.

Need a quickstart!

Hi Bennett! I see on your dev branch that you have a header for a quick start, but no content there. Want some help writing something here? What's a minimal usage of this package look like? :)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.