The Modular Accelerated Xecution (MAX) platform is an integrated suite of AI libraries, tools, and technologies that unifies commonly fragmented AI deployment workflows. MAX accelerates time to market for the latest innovations by giving AI developers a single toolchain that unlocks full programmability, unparalleled performance, and seamless hardware portability.

See here to get started with MAX and when you want to report issues or request features, please create a GitHub issue here.

The Discord community is the best place to share your experiences and chat with the team and other community members.

In the examples directory, you will find code examples for model inference, Jupyter notebooks for an interactive experience learning experience and instructions for how to work with benchmarking and visualization tooling.

1. Install the MAX SDK.

2. Git clone the repository of MAX samples using the command below:

git clone https://github.com/modularml/max.git

Run the console and follow the prompt to choose which example to run.

python3 -m venv venv && source venv/bin/activate
python3 -m pip install --find-links "$(modular config max.path)/wheels" max-engine
python3 examples/console.py

which opens up

Follow the instructions in the README for each example, notebook or tool you want to run.

Check out the notebooks examples for using MAX Engine 🏎️ for models such as

• Mistral-7B
• Roberta-pytorch
• Roberta-tensorflow

Q: I get ModuleNotFoundError: No module named 'max' when running an example?

A: Please make sure you run

python3 -m pip install --find-links "$(modular config max.path)/wheels" max-engine

in your local python environment. Note that max can also be available in your PATH

For MAX Serving, you can pull our Docker Container from the the public ECR here: https://gallery.ecr.aws/modular/max-serving-de

public.ecr.aws/modular/max-serving-de

Thanks for your interest in contributing to this repository! We are not accepting pull requests yet.

However, we welcome your bug reports. If you have a bug, please file an issue here.

If you need support, the Discord community is the best place to share your experiences and chat with the team and other community members.

The Mojo examples and notebooks in this repository are licensed under the Apache License v2.0 with LLVM Exceptions (see the LLVM License).

You are entirely responsible for checking and validating the licenses of third parties (i.e. Huggingface) for related software and libraries that are downloaded.