Lore

Staged relight-then-restore-detail pipeline for product photography

The ComfyUI product-photo workflow chains several stages. Each stage fixes the weakness of the one before it, so the output moves from a rough scene to a faithful, relit product shot in one click.

Stages

  1. New background. The original shot becomes the guide for a new background (Depth and lineart background generation).
  2. Blended composite. The real subject is masked and placed on the generated background (Subject masking and background replacement). This fixes the subject, but the lighting does not match.
  3. Relit image. IC-Light relighting (Stable Diffusion 1.5) fixes the lighting, using White-spot light-source mask (automatic lighting) or Hand-drawn lighting mask via Preview Bridge. Relighting degrades fine detail such as text.
  4. Restored detail. Because relighting degrades detail, original detail is restored last, by Frequency separation for detail preservation (native ComfyUI) and Mask-based high-frequency blend.

Why the order matters

Restoring detail before relighting would lose it again. Placing it last guarantees the final image carries the real product's detail with the new lighting.

The commercial problem it targets

In product photography you sell the actual product, not a 90% replica. Baioni names two obstacles to generative AI in production: incoherent lighting, and a product that is not the actual product. Generated shots a month earlier were good but unconvincing, because the lighting did not match and the subject looked copy-pasted. This chain addresses both.

Origin

The detail-restoration step came out of a community exchange. A viewer challenged Baioni on a live stream to keep a whiskey bottle's fine details. Baioni proposed Photoshop frequency separation. Reddit user Powered_JJ then posted a native ComfyUI version, and together they integrated it into Baioni's existing relight workflow.

Baioni says the demos are not cherry-picked and that the progression through the stages is organic. Limits are in ic-light-detail-restore-workflow-limits.