Face Editor for Stable Diffusion. It can be used to repair broken faces in images generated by Stable Diffusion.

This is a extension of AUTOMATIC1111's Stable Diffusion Web UI.

This software improves facial images in these features:

• txt2img
• img2img
• batch processing (batch count / batch size)
• img2img Batch

1. Open the "Extensions" tab then the "Install from URL" tab.
2. Enter "https://github.com/ototadana/sd-face-editor.git" in the "URL of the extension's git repository" field.
3. Click the "Install" button and wait for the "Installed into /home/ototadana/stable-diffusion-webui/extensions/sd-face-editor. Use Installed tab to restart." message to appear.
4. Go to "Installed" tab and click "Apply and restart UI".

1. Click "Face Editor" and check "Enabled".
2. Then enter the prompts as usual and click the "Generate" button to modify the faces in the generated images.
3. If you are not satisfied with the results, adjust the parameters and rerun. see Tips.

If you feel uncomfortable with the facial contours, try increasing the "Mask size" value. This discomfort often occurs when the face is not facing straight ahead.

If the forelock interferes with rendering the face properly, generally, selecting "Hair" from "Affected areas" results in a more natural image.

This setting modifies the mask area as illustrated below:

When multiple faces are close together, one face may collapse under the influence of the other. In such cases, enable "Use minimal area (for close faces)".

Use "Prompt for face" option if you want to change the facial expression.

Faces can be individually directed with prompts separated by || (two vertical lines).

• Each prompt is applied to the faces on the image in order from left to right.
• The number of prompts does not have to match the number of faces to work.
• If you write the string @@, the normal prompts (written at the top of the screen) will be expanded at that position.
• If you are using the Wildcards Extension, you can use the __name__ syntax and the text file in the directory of the wildcards extension as well as the normal prompts.

If you wish to modify the face of an already existing image instead of creating a new one, follow these steps:

1. Open the image to be edited in the img2img tab It is recommended that you use the same settings (prompt, sampling steps and method, seed, etc.) as for the original image. So, it is a good idea to start with the PNG Info tab.
   1. Click PNG Info tab.
   2. Upload the image to be edited.
   3. Click Send to img2img button.
2. Set the value of "Denoising strength" of img2img to 0. This setting is good for preventing changes to areas other than the faces and for reducing processing time.
3. Click "Face Editor" and check "Enabled".
4. Then, set the desired parameters and click the Generate button.

This script performs the following steps:

First, image(s) are generated as usual according to prompts and other settings. This script acts as a post-processor for those images.

When pasting the generated image to its original location, the rectangle of the detected face area is used. If this option is not enabled, the generated image itself is pasted. In other words, enabling this option applies a smaller face image, while disabling it applies a larger face image.

This option allows you to save the original, unmodified image.

This option allows you to display the original, unmodified image.

This option enables the display of images that depict detected faces and masks. If the generated image is unnatural, enabling it may reveal the cause.

Prompt for generating a new face. If this parameter is not specified, the prompt entered at the top of the screen is used.

For more information, please see: here.

Size of the mask area when inpainting to blend the new face with the whole image.

Size of the blur area when inpainting to blend the new face with the whole image.

Use this parameter when you want to reduce the number of faces to be detected. If more faces are found than the number set here, the smaller faces will be ignored.

Confidence threshold for face detection. Set a lower value if you want to detect more faces.

Specify the size of the margin for face cropping by magnification.

If other parameters are exactly the same but this value is different, the atmosphere of the new face created will be different.

Specifies one side of the image size when creating a face image. Normally, there should be no need to change this from the default value (512), but you may see interesting changes if you do.

Ignore if the size of the detected face is larger than the size specified in "Size of the face when recreating".

For more information, please see: here.

Denoising strength for generating a new face. If the value is too small, facial collapse cannot be corrected, but if it is too large, it is difficult to blend with the entire image.

Paste an image cut out in the shape of a face instead of a square image.

For more information, please see: here.

Denoising strength when inpainting to blend the new face with the whole image. If the border lines are too prominent, increase this value.

If you want to use this script as an extension (alwayson_scripts) in the API, specify "face editor ex" as the script name as follows:

   "alwayson_scripts": {
      "face editor ex": {
         "args": [{"prompt_for_face": "smile"}]
      },

By specifying an object as the first argument of args as above, parameters can be specified by keywords. We recommend this approach as it can minimize the impact of modifications to the software. If you use a script instead of an extension, you can also specify parameters in the same way as follows:

   "script_name": "face editor",
   "script_args": [{"prompt_for_face": "smile"}],

• See source code for available keywords.