ComfyUI lab 6: Build style as a system
Separate content, composition, light, palette, and finish; compare prompt, LoRA, IPAdapter, and deterministic transforms.
Listen to this article
On-device voiceUses the voice built into your browser; no article text leaves this page.
Audio narration is not supported by this browser.
“Style” is often used as one giant variable, but it is a stack: shape language, composition, materials, palette, lighting, mark-making, lens behavior, and post-processing. Control improves when those layers stay separate.
Choose the control mechanism by job
Text is best for broad, interpretable direction. A LoRA injects learned visual tendencies into the denoiser and often affects both content and finish. IPAdapter conditions from a reference image and can target style, composition, or identity depending on model and node settings. ControlNet carries explicit structure. A deterministic shader changes pixels without inventing new geometry.
The concept-sheet workflow starts with only structured text fields. Generate a baseline, then change palette alone. Next change style alone. If character identity changes, the prompt is not yet separating invariant content from appearance.
Add reference conditioning carefully
The GPL-3.0 ComfyUI IPAdapter project includes example workflows and unified loaders. Start near moderate weight, keep the base prompt meaningful, and verify the required CLIP Vision and adapter pair. Reference images have rights and identity implications; record their source just like a LoRA or checkpoint.
A durable style system is a small versioned specification plus evaluation images, not a folder named “final prompts.” Keep fixed subjects, seeds, and compositions for regression tests.
Run the lab
- Open this graph in Comfy Studio
- Download the exact API-format workflow
- CLI:
app comfy download character-concept-sheet
Record the graph JSON, input assets, seed where relevant, model or service version, custom-node commit, and final artifact together. That bundle—not a screenshot—is the reproducible creative unit.
Open-source map
- ComfyUI IPAdapter — GPL-3.0 reference-image conditioning nodes
- Open prompt composer — MIT first-principles prompt node
Creative Systems Labs: 6 of 12. Previous: Turn sound into reactive motion Next: Write inspectable shader looks