September 28th, 2023
Head over to the IllusionDiffusion space on HuggingFace: https://huggingface.co/spaces/AP123/IllusionDiffusion.
Drag your mask image (test or a meme) into the “Input Illusion” box.
Black and white images work very well, make sure to find the highest quality image you can.
From here head down to the prompt box. Prompt engineering is a whole separate can of worms that I won’t get into so for the purposes of this tutorial head to a premade prompt template website like this list on github by Dalabad.
You will likely have to tweak your prompt to get a good result. Due to the popularity, you will likely get an “Application too busy” error. Just keep pressing run until you get in the queue.
You may have to tweak the illusion strength if it’s not clear enough or you want it more subtle.
Another HuggingFace space, FaceReal-ESRGAN, is able to increase the detail level of these images.
Visit it here: https://huggingface.co/spaces/doevent/Face-Real-ESRGAN
This tutorial requires a pretty beefy computer to run well. Familiarity with a command prompt is highly recommended, though not required.