We are going to deploy a pretrained image segmentation model:

https://github.com/tensorflow/models/tree/master/research/deeplab

It is important that you research how to write a dockerfile and a docker-compose file.

Please see Docker, the Dockerfile cheatsheet, and the the Docker file guide.

Please see Docker, FastAPI in Containers, and this and this sample.

• Go to EC2 console: https://us-east-1.console.aws.amazon.com/ec2/home?region=us-east-1#
• Create EC2 instance
• Pick amazon linux
• Pick instance type: At least t3.medium
• Create key-pair
• Download key
• Edit network
• Enable IPV4 address
• Open ports 8000-8002 from anywhere
• Launch Instance

• Get the ip address of the instance
• Change key permissions to 400 (chmod 400 key.pem)
• SSH into the machine ssh -i key.pem [email protected]
• Install git if needed (sudo apt install git for ubuntu based distros, sudo yum install git for amazon linux)
• Install Docker (sudo apt install docker for ubuntu based distros, sudo yum install docker for amazon linux)
• Start Docker (sudo systemctl start docker)
• Add user to docker group (sudo usermod -aG docker ${USER})
• Logout and Login again through SSH to take the group changes into account
• Check if docker installed correctly (docker run hello-world)
• Install Docker-Compose

sudo curl -L https://github.com/docker/compose/releases/latest/download/docker-compose-$(uname -s)-$(uname -m) -o /usr/local/bin/docker-compose
sudo chmod +x /usr/local/bin/docker-compose
docker-compose version

• Clone the repo (git clone ...)
• If there's permission issues with gitlab, generate ssh keys (ssh-keygen) and add them to github account
• CD into the folder (cd cloned-repo)

• Run all the endpoints (docker-compose -f docker-compose.yaml up --build)
• Create a request with docs (http://ec2.ip.address:8000/docs)