Skip to content

ComfyUI Setup

This guide is for those who want to use the Krita plugin with their custom installation of ComfyUI .

When connecting via the “Custom Server” option, the plugin checks for a number of custom node extensions and models which it requires to function. These are listed below.

Required custom nodes

Install custom nodes according to the instructions of the respective projects, or use ComfyUI Manager .

Required models

Some models are required for the plugin to work - you cannot connect if they are not found. They are used implicitly across various functionality and pre-installing them makes for a smoother, uninterrupted experience.

All models must be placed in the appropriate ComfyUI models folder. The plugin queries available models from the ComfyUI server. This means paths configured in extra_model_paths.yml will also work.

Models can be downloaded and placed manually, or via script (see below).

Model list SDXL Model list SD1.5 Model list (minimal)

Diffusion Model Checkpoints

At least one diffusion model (commonly just called “Checkpoint”) is required. There is a list with recommended checkpoints which are used by the plugin’s default styles. But they are not required, you can use any checkpoint you like as long as the base model is supported.

Download Script

Instead of downloading models manually you can use the download_models.py script to fetch all required and optional models. This requires you to find the script and execute Python from the command line.

After installing the plugin you can find the script in the plugin folder (called ai_diffusion, see Paths). Open a command prompt and run:

Terminal window
python -m pip install aiohttp tqdm
python download_models.py --all /path/to/your/comfyui

This will download all models supported by the plugin directly into the specified folder with the correct version, location, and filename. The download location does not have to be your ComfyUI installation, you can use an empty folder if you want to avoid clashes and copy models afterwards. There are also options to only download a subset, or list all relevant URLs without downloading.

Terminal window
python download_models.py --help

Note: The script downloads models only. It does not install or modify ComfyUI or custom nodes!

Troubleshooting

If you’re getting errors about missing resources, or workload not being installed, it’s probably because one of the models wasn’t found. You can find the client.log file by clicking the “View Log files” link in the Connection settings. Check the log for warnings. Here you will also find which models were found in your installation, and the patterns the plugin looks for.

Model filenames must contain one of the search patterns to match. The model path is allowed to be longer though: you may place models in arbitrary subfolders and they will still be found. If there are multiple matches, any files placed inside a krita subfolder are prioritized.

Questions and Support

  • ComfyUI, comfy.org for issues related to ComfyUI
  • Discussions, Issues or Discord for things concerning the setup for Krita Diffusion Plugin
  • Please don’t use official Krita channels for questions related to the Plugin