Install Docker and Docker Compose by following the instructions here.

Install the just command runner by following the instructions here.

Install the AWS Command Line Interface (AWS CLI) by following the instructions here. SSO credentials can be configured for a named profile with the command aws configure sso --profile <profile-name> (only needed for deployment of cloud resources).

Install the pyenv Python version manager by following the instructions here. Initialize pyenv with the command pyenv init. Install the interpreter for Python version 3.10 with the command pyenv install 3.10. Set the local application-specific Python version to 3.10 with the command pyenv local 3.10.

Install the Poetry dependency management tool by following the instructions here. Tell Poetry which Python version to use for the current project with the command poetry env use 3.10.

Install the Microsoft Python extension for Visual Studio Code.

Install the Microsoft Black Formatter extension for Visual Studio Code.

Install the Terraform infrastructure as code tool by following the instructions here (only needed for deployment of cloud resources).

Run the command just build to build Docker images and start services with Docker Compose. The Dagster web server UI will be served from http://localhost:3000.

To initiate a job run via the sensor for processing SQS messages run the command just send-message.

1. Add an asset with an upstream dependency.
2. Add a job that materializes multiple assets.
3. Add a sensor... (WIP)