Giter Club home page Giter Club logo

sfguide-data-engineering-with-snowpark-python-intro's Introduction

Intro to Data Engineering with Snowpark Python

This repository contains the code for the Intro to Data Engineering with Snowpark Python Snowflake Quickstart.

➡️ For overview, prerequisites, and to learn more, complete this end-to-end tutorial Intro to Data Engineering with Snowpark Python on quickstarts.snowflake.com.

Here is an overview of what we'll build in this lab:

sfguide-data-engineering-with-snowpark-python-intro's People

Stargazers

avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar

Watchers

avatar avatar avatar

Forkers

sfc-gh-rishah alamtariq143 shapaul maxtuzz maungmyominthu aagrawal-quot sarthak368 sfc-gh-gwarrier ank1111-dev swathy-babu xdfc-777 sfc-gh-vvinchurkar danmedrano88 mm-ahmed marcusreeve arunkhare glennholgado nkrishnabng dwivediayush krishnadhuriya terrencechan0830 suparsav h-glez rajapathakcse usamaabbas3632 naz375630 ashokbabupondy anukeswani asifthebhai neerjav pavanitvsea atulkatiyar1007 annamalaiarunachalam soniabhi09 rishisharma111 sb12387 saloni-kadu sridharpothamsetti jonathanraso adeshkothavade terezalic low-static cesarodiaz tsomoriri kanishka1987 taylorj01 luettgem sfc-gh-mrashed felixgondwe dolly1 cris1403 rleitaker kmswaroop ahsenaeem aaru235 u201413458 twivyass margieh lisstasy zack-solvenna rmorton8 sibaprasadm didihbabs azfeenixfire priscillaoclark siriusbits kfranci2 fletchertyler914 maxklimen nanditha-shankar mlaheyzenput shivanipaunikar thomaswalker-dr seattlethunder naga-manohar-y miladindjurisic oshaybutter blbar2020 jkleckr keith-maura ortegaa32 jasontourville coldra1n annah998936 radoslavovm marcogarciabi ada4sh monsam aparada96 amrhelmy11 dunawayw maparkdev dj216185 alikoupaei kuzmicni stevewithington bofuld mbro95 lauracrumbl relentless1987

sfguide-data-engineering-with-snowpark-python-intro's Issues

07_deploy_task_dag.py DAG dependency issue

This appears to be backwards:
image
It creates a DAG graph where 1 and 2 are dependent on task3

Note Snowflake docs :

. . .
  dag_task2 = DAGTask(
    StoredProcedureCall(
      dosomething, stage_location="@mystage",
      packages=["snowflake-snowpark-python"]
    ),
    warehouse="test_warehouse"
  )
# Shift right and left operators can specify task relationships.
dag_task1 >> dag_task2  # dag_task1 is a predecessor of dag_task2
. . .

Apologies if I've done anything incorrect in here. This is my first :D

ModuleNotFoundError when running 07_deploy_task_dag.py

I got the error below when running the code via GitHub CodeSpaces

(snowflake-demo) (base) @PingPongSet ➜ /workspaces/sfguide-data-engineering-with-snowpark-python-intro (main) $ /opt/conda/envs/snowflake-demo/bin/python /workspaces/sfguide-data-engineering-with-snowpark-python-intro/steps/07_deploy_task_dag.py
Traceback (most recent call last):
  File "/workspaces/sfguide-data-engineering-with-snowpark-python-intro/steps/07_deploy_task_dag.py", line 119, in <module>
    from utils import snowpark_utils
ModuleNotFoundError: No module named 'utils'
(snowflake-demo) (base) @PingPongSet ➜ /workspaces/sfguide-data-engineering-with-snowpark-python-intro (main) $

any idea?

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.