Giter Club home page Giter Club logo

deforum-for-automatic1111-webui's Introduction

Deforum Stable Diffusion โ€” official extension script for AUTOMATIC1111's webui

For now, video-input, 2D, pseudo-2D and 3D animation modes are available. Interpolation and render image batch temporary excluded for simplicity

Last Commit GitHub issues GitHub stars GitHub forks Colab Replicate

Before Starting

Read the README file at the original Deforum repo

https://github.com/deforum/stable-diffusion

Getting Started

  1. Cover yourself in oil

  2. Install AUTOMATIC1111's webui

  3. Download this repository and put the files deforum.py and the 'deforum' folder into the 'scripts' folder inside your WebUI installation directory

  4. If you're on Windows and want to launch Deforum in 3D mode, you'll have to download the depths model manually. Download these files https://github.com/intel-isl/DPT/releases/download/1_0/dpt_large-midas-2f21e586.pt and https://cloudflare-ipfs.com/ipfs/Qmd2mMnDLWePKmgfS8m6ntAg4nhV5VkUyAydYBp8cWWeB7/AdaBins_nyu.pt and put them into the 'models/Deforum' folder of your webui installation. (if it doesn't exist, create it)

4.Important: If you want to use 3D mode, launch the WebUI with the --disable-safe-unpickle option or else it won't let you to use the depth models! How to add it to the .bat file on Windows. Open the webui, switch to 'img2img' tab and select 'Deforum v0.5-webui-beta' in the 'Custom scripts' dropdown menu

  1. Enter the animation settings. Refer to this general guide and this guide to math keyframing functions in Deforum. However, in this version prompt weights less than zero don't just like in original Deforum! Split the positive and the negative prompt in the json section using --neg argument like this "apple:`where(cos(t)>=0, cos(t), 0)`, snow --neg strawberry:`where(cos(t)<0, -cos(t), 0)`"

  2. To view animation frames as they're being made, without waiting for the completion of an animation, go to the 'Settings' tab and set the value of this toolbar above zero, then click 'Apply settings' at the top of the page and return to the 'Deforum' tab. Warning: it may slow down the generation process.

adsdasunknown

  1. Run the script and see if you got it working or even got something. In 3D mode a large delay is expected at first as the script loads the depth models. In the end, using the default settings the whole thing should consume 6.4 GBs of VRAM at 3D mode peaks and no more than 3.8 GB VRAM in 3D mode if you launch the webui with the '--lowvram' command line argument.

  2. If it gives errors on missing modules, such as about missing 'numexpr', go to the original webui directory, open 'requirements_versions.txt' and append the missing packages names at the end of that file. Then restart the webui.

  3. After the generation process is completed, click the button with the self-describing name to show the video or gif result right in the GUI!

Screenshot 2022-10-18 at 01-06-24 Stable Diffusion

  1. Join our Discord where you can post generated stuff, ask questions and infuriate the devs with 'this feature is in auto's build. When will it be in Deforum? Why can't I launch Deforum on my potato computer?'(not anymore, ha-ha) https://discord.gg/deforum. There's also the 'Issues' tab in the repo.

  2. Profit!

Showcase

Proof that it works good enough of AUTOMATIC1111's build with MATH keyframing and prompt-weighting enabled in 3D mode

sw-min

'Le Grand Interface' at work:

Screenshot 2022-10-18 at 01-04-09 Stable Diffusion

Math evaluation:

math-eval

Benchmarks

3D mode without additional WebUI flags

image

3D mode when WebUI is launched with '--lowvram'

image

deforum-for-automatic1111-webui's People

Contributors

apolinario avatar aredden avatar bardia323 avatar blackneoo avatar carriemorrison avatar chenxwh avatar cpacker avatar deforum avatar doggettx avatar enzymezoo-code avatar johnnypeck avatar kabachuha avatar makeitrad-old avatar nicolai256 avatar nousr avatar owenvincent avatar patrickvonplaten avatar pesser avatar pharmapsychotic avatar rromb avatar scottiefox avatar sxela avatar thibaudart avatar thorsthunder04 avatar viztopia avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.