An iOS app that generates images using Stable Diffusion and displays them in AR.
You can generate images specifying any prompt (text) and display them on the wall in AR.
- macOS 13.1 or newer, Xcode 14.1 or newer
- iPhone 12+ / iOS 16.2+, iPad Pro with M1/M2 / iPadOS 16.2+
You can run the app on above mobile devices. And you can run the app on Mac, building as a Designed for iPad app.
This Xcode project uses the Apple/ml-stable-diffusion
Swift Package.
This project does not contain the CoreML models of Stable Diffusion v2 (SD2). You need to make them converting the PyTorch SD2 models using Apple converter tools. You can find the instructions of converting models in Apple's repo on GitHub.
- Apple/ml-stable-diffusion repo: https://github.com/apple/ml-stable-diffusion
And I explain how to add the models to the Xcode project in another GitHub Repository's Readme. Please check that if necessary.
- Image Generator with Stable Diffusion v2: https://github.com/ynagatomo/ImgGenSD2
- Apple Swift Package / ml-stable-diffusion: https://github.com/apple/ml-stable-diffusion
- Hugging Face Hub - stabilityai/stable-diffusion-2: https://huggingface.co/stabilityai/stable-diffusion-2