# Gallery Every comparison image in this repo, kept out of the README so that page stays short. Nothing here is a measurement -- those live in [BENCHMARKS.md](BENCHMARKS.md). These exist because LPIPS answers "how far did it move", not "is it worse", and the two come apart: W4A4 shifts the sampling trajectory, so a checkpoint can score a large distance and still look fine, or a small one and mangle a line of text. * [Fidelity sheets, no LoRA](#fidelity-sheets-no-lora) -- 16 prompts x 7 checkpoints x 2 seeds * [Fidelity sheets, with a LoRA](#fidelity-sheets-with-a-lora) -- the same, under `bloomgirls-ultrarealism` * [Rank sweep, refined vs not](#rank-sweep-refined-vs-not) * [Identity-edit LoRA](#identity-edit-lora) * [Single-prompt stress tests](#single-prompt-stress-tests) **How to read the sheets.** They are wide -- open one full size, they are unreadable at page width. Columns run left to right in accuracy order: **BF16 reference** first, then no low-rank branch, then rising rank, ending with the activation-aware build. Rows are two seeds. So anything that differs between the two rows of a *single* column is sampling variance, not a property of the checkpoint -- and if a difference between columns is smaller than the difference between rows, it is not a difference. Settings are identical everywhere: 1024x1024, 8 steps, cfg 1.0, euler/simple, `qwen_image_vae`, seeds 987654321 and 424242424. ## Fidelity sheets, no LoRA Built with `tools/contact_sheet.py` from the same renders `tools/fidelity_bench.py score` measures, so every image here has a number behind it in [Test 3 and Test 4](BENCHMARKS.md#test-3--paired-lpips-fidelity-with-and-without-a-lora). ### 01_dense_text > A rain-soaked neon diner sign at night, below it a handwritten chalkboard menu with three lines of text reading 'SOUP $4 / PIE $6 / COFFEE $2', reflections on wet asphalt, cinematic Three lines of small chalkboard text. The hardest cell in the set: read the prices. ![01_dense_text](examples/fidelity_sheets/sheet_base_01_dense_text.jpg) ### 02_curved_text > Close-up of a person holding a paper coffee cup with large bold curved text 'STAY WARM' printed around the cup, soft morning light, shallow depth of field Two large words wrapped around a cup. Every checkpoint gets this; it is the easy control. ![02_curved_text](examples/fidelity_sheets/sheet_base_02_curved_text.jpg) ### 03_hands_detail > A violinist's hands mid-performance, fingers pressed on the strings, bow in motion with visible blur, studio lighting, extreme close-up, photorealistic Finger placement on the strings, and whether the motion-blurred bow holds together. ![03_hands_detail](examples/fidelity_sheets/sheet_base_03_hands_detail.jpg) ### 04_crowd_faces > A busy Tokyo street crossing at dusk, dozens of pedestrians with distinct faces and expressions, neon signage in the background, wide angle, high detail Dozens of small faces. Look for melted or duplicated ones rather than at the whole frame. ![04_crowd_faces](examples/fidelity_sheets/sheet_base_04_crowd_faces.jpg) ### 05_symmetry_pattern > A perfectly symmetrical Islamic geometric tile mosaic, intricate repeating star and polygon pattern, deep blue and gold, overhead flat lighting, ultra sharp Repeating geometry. Breaks in the tiling are far easier to see than colour drift. ![05_symmetry_pattern](examples/fidelity_sheets/sheet_base_05_symmetry_pattern.jpg) ### 06_multi_subject > Two chefs in white uniforms plating a dish together in a busy kitchen, one holding tweezers placing a garnish, the other pouring sauce, steam rising, low angle shot Two people acting at once -- tweezers in one pair of hands, sauce in the other. ![06_multi_subject](examples/fidelity_sheets/sheet_base_06_multi_subject.jpg) ### 07_reflections_glass > A glass of iced whiskey on a dark wood bar, condensation droplets, warm bokeh lights reflected in the glass and the liquid, macro photography Condensation and bokeh reflected through liquid. High frequency, little structure. ![07_reflections_glass](examples/fidelity_sheets/sheet_base_07_reflections_glass.jpg) ### 08_logo_typography > A vintage motorcycle fuel tank with a hand-painted logo reading 'IRON WOLF GARAGE' in bold serif letters, chrome and scratched paint texture, studio product shot Serif signage on curved chrome: text and specular highlight in the same place. ![08_logo_typography](examples/fidelity_sheets/sheet_base_08_logo_typography.jpg) ### 09_counting_objects > A wooden table from directly above with exactly seven red apples arranged in a neat row next to three green pears, soft natural light, flat lay photography Seven apples, three pears. Miscounting is a structural failure, not a detail one. ![09_counting_objects](examples/fidelity_sheets/sheet_base_09_counting_objects.jpg) ### 10_complex_scene > A fantasy marketplace street at golden hour, merchant stalls with hanging fabrics and baskets of spices, a dragon perched on a rooftop in the background, dense crowd, painterly digital art Dense painterly scene. Composition should be identical; brushwork will not be. ![10_complex_scene](examples/fidelity_sheets/sheet_base_10_complex_scene.jpg) ### 11_portrait_woman > Close-up portrait of a woman with freckles and green eyes, windswept auburn hair, wearing a chunky knitted wool sweater, standing on a rainy city street at blue hour, shallow depth of field, natural skin texture with visible pores, catchlights in both eyes, 85mm lens, photorealistic Skin texture, freckles, catchlights. Where a photographic LoRA earns its keep. ![11_portrait_woman](examples/fidelity_sheets/sheet_base_11_portrait_woman.jpg) ### 12_person_holding_sign > A young woman in a bright yellow raincoat standing at the end of a wooden pier, holding up a handwritten cardboard sign that reads 'BACK IN 5 MIN' in thick black marker, seagulls circling behind her, overcast diffused light, full body shot, 35mm documentary photography Handwritten marker text on cardboard at arm's length -- text plus a full body. ![12_person_holding_sign](examples/fidelity_sheets/sheet_base_12_person_holding_sign.jpg) ### 13_two_people_interaction > A barista with tattooed forearms handing a paper cup across a marble counter to a bearded man in a denim jacket, both mid-conversation and smiling, morning light through a tall window, steam rising from the cup, candid documentary photography, natural skin tones Two faces mid-expression, and the hand-off between them. ![13_two_people_interaction](examples/fidelity_sheets/sheet_base_13_two_people_interaction.jpg) ### 14_hands_and_face > A woman applying red lipstick while looking into a small round handheld mirror, her fingers wrapped around the mirror rim, the reflection of one eye visible in the glass, warm bathroom lighting, extreme close-up on face and hands, photorealistic detail Hands, lips and a reflected eye in one frame at extreme close-up. ![14_hands_and_face](examples/fidelity_sheets/sheet_base_14_hands_and_face.jpg) ### 15_full_body_fashion > Full body editorial fashion photograph of a woman in a flowing emerald green silk dress mid-stride on a marble staircase, one hand trailing on the brass railing, dramatic hard side lighting, sharp fabric texture and folds, 50mm, high fashion magazine style Fabric folds under hard side light, and whether the stride survives. ![15_full_body_fashion](examples/fidelity_sheets/sheet_base_15_full_body_fashion.jpg) ### 16_group_selfie > Four friends of different ethnicities crowded around a restaurant table taking a group selfie, one holding the phone at arm's length, another leaning in making a peace sign, plates of pasta and half-full wine glasses on the table, warm indoor lighting, natural candid expressions Four faces at once, plus the arm geometry of whoever is holding the phone. ![16_group_selfie](examples/fidelity_sheets/sheet_base_16_group_selfie.jpg) ## Fidelity sheets, with a LoRA The same 16 prompts and seeds with `bloomgirls-ultrarealism-krea2_4k` at strength 1.0, applied through this repo's LoRA node. The BF16 column carries the LoRA too -- the comparison is quantized+LoRA against BF16+LoRA, which is the question the repo's earlier LoRA benchmark never asked. ### 01_dense_text > A rain-soaked neon diner sign at night, below it a handwritten chalkboard menu with three lines of text reading 'SOUP $4 / PIE $6 / COFFEE $2', reflections on wet asphalt, cinematic Three lines of small chalkboard text. The hardest cell in the set: read the prices. ![01_dense_text](examples/fidelity_sheets/sheet_lora2_01_dense_text.jpg) ### 02_curved_text > Close-up of a person holding a paper coffee cup with large bold curved text 'STAY WARM' printed around the cup, soft morning light, shallow depth of field Two large words wrapped around a cup. Every checkpoint gets this; it is the easy control. ![02_curved_text](examples/fidelity_sheets/sheet_lora2_02_curved_text.jpg) ### 03_hands_detail > A violinist's hands mid-performance, fingers pressed on the strings, bow in motion with visible blur, studio lighting, extreme close-up, photorealistic Finger placement on the strings, and whether the motion-blurred bow holds together. ![03_hands_detail](examples/fidelity_sheets/sheet_lora2_03_hands_detail.jpg) ### 04_crowd_faces > A busy Tokyo street crossing at dusk, dozens of pedestrians with distinct faces and expressions, neon signage in the background, wide angle, high detail Dozens of small faces. Look for melted or duplicated ones rather than at the whole frame. ![04_crowd_faces](examples/fidelity_sheets/sheet_lora2_04_crowd_faces.jpg) ### 05_symmetry_pattern > A perfectly symmetrical Islamic geometric tile mosaic, intricate repeating star and polygon pattern, deep blue and gold, overhead flat lighting, ultra sharp Repeating geometry. Breaks in the tiling are far easier to see than colour drift. ![05_symmetry_pattern](examples/fidelity_sheets/sheet_lora2_05_symmetry_pattern.jpg) ### 06_multi_subject > Two chefs in white uniforms plating a dish together in a busy kitchen, one holding tweezers placing a garnish, the other pouring sauce, steam rising, low angle shot Two people acting at once -- tweezers in one pair of hands, sauce in the other. ![06_multi_subject](examples/fidelity_sheets/sheet_lora2_06_multi_subject.jpg) ### 07_reflections_glass > A glass of iced whiskey on a dark wood bar, condensation droplets, warm bokeh lights reflected in the glass and the liquid, macro photography Condensation and bokeh reflected through liquid. High frequency, little structure. ![07_reflections_glass](examples/fidelity_sheets/sheet_lora2_07_reflections_glass.jpg) ### 08_logo_typography > A vintage motorcycle fuel tank with a hand-painted logo reading 'IRON WOLF GARAGE' in bold serif letters, chrome and scratched paint texture, studio product shot Serif signage on curved chrome: text and specular highlight in the same place. ![08_logo_typography](examples/fidelity_sheets/sheet_lora2_08_logo_typography.jpg) ### 09_counting_objects > A wooden table from directly above with exactly seven red apples arranged in a neat row next to three green pears, soft natural light, flat lay photography Seven apples, three pears. Miscounting is a structural failure, not a detail one. ![09_counting_objects](examples/fidelity_sheets/sheet_lora2_09_counting_objects.jpg) ### 10_complex_scene > A fantasy marketplace street at golden hour, merchant stalls with hanging fabrics and baskets of spices, a dragon perched on a rooftop in the background, dense crowd, painterly digital art Dense painterly scene. Composition should be identical; brushwork will not be. ![10_complex_scene](examples/fidelity_sheets/sheet_lora2_10_complex_scene.jpg) ### 11_portrait_woman > Close-up portrait of a woman with freckles and green eyes, windswept auburn hair, wearing a chunky knitted wool sweater, standing on a rainy city street at blue hour, shallow depth of field, natural skin texture with visible pores, catchlights in both eyes, 85mm lens, photorealistic Skin texture, freckles, catchlights. Where a photographic LoRA earns its keep. ![11_portrait_woman](examples/fidelity_sheets/sheet_lora2_11_portrait_woman.jpg) ### 12_person_holding_sign > A young woman in a bright yellow raincoat standing at the end of a wooden pier, holding up a handwritten cardboard sign that reads 'BACK IN 5 MIN' in thick black marker, seagulls circling behind her, overcast diffused light, full body shot, 35mm documentary photography Handwritten marker text on cardboard at arm's length -- text plus a full body. ![12_person_holding_sign](examples/fidelity_sheets/sheet_lora2_12_person_holding_sign.jpg) ### 13_two_people_interaction > A barista with tattooed forearms handing a paper cup across a marble counter to a bearded man in a denim jacket, both mid-conversation and smiling, morning light through a tall window, steam rising from the cup, candid documentary photography, natural skin tones Two faces mid-expression, and the hand-off between them. ![13_two_people_interaction](examples/fidelity_sheets/sheet_lora2_13_two_people_interaction.jpg) ### 14_hands_and_face > A woman applying red lipstick while looking into a small round handheld mirror, her fingers wrapped around the mirror rim, the reflection of one eye visible in the glass, warm bathroom lighting, extreme close-up on face and hands, photorealistic detail Hands, lips and a reflected eye in one frame at extreme close-up. ![14_hands_and_face](examples/fidelity_sheets/sheet_lora2_14_hands_and_face.jpg) ### 15_full_body_fashion > Full body editorial fashion photograph of a woman in a flowing emerald green silk dress mid-stride on a marble staircase, one hand trailing on the brass railing, dramatic hard side lighting, sharp fabric texture and folds, 50mm, high fashion magazine style Fabric folds under hard side light, and whether the stride survives. ![15_full_body_fashion](examples/fidelity_sheets/sheet_lora2_15_full_body_fashion.jpg) ### 16_group_selfie > Four friends of different ethnicities crowded around a restaurant table taking a group selfie, one holding the phone at arm's length, another leaning in making a peace sign, plates of pasta and half-full wine glasses on the table, warm indoor lighting, natural candid expressions Four faces at once, plus the arm geometry of whoever is holding the phone. ![16_group_selfie](examples/fidelity_sheets/sheet_lora2_16_group_selfie.jpg) ## Rank sweep, refined vs not Ten prompts across rank 16 through 256, refined and non-refined, from the sweep documented in [Test 1](BENCHMARKS.md#test-1--text-to-image-rank-sweep). Speed tables and the prompts themselves are there; these are the images. ![01_dense_text](examples/rank_sweep_t2i_comparison/grid_01_dense_text.png) ![02_curved_text](examples/rank_sweep_t2i_comparison/grid_02_curved_text.png) ![03_hands_detail](examples/rank_sweep_t2i_comparison/grid_03_hands_detail.png) ![04_crowd_faces](examples/rank_sweep_t2i_comparison/grid_04_crowd_faces.png) ![05_symmetry_pattern](examples/rank_sweep_t2i_comparison/grid_05_symmetry_pattern.png) ![06_multi_subject](examples/rank_sweep_t2i_comparison/grid_06_multi_subject.png) ![07_reflections_glass](examples/rank_sweep_t2i_comparison/grid_07_reflections_glass.png) ![08_logo_typography](examples/rank_sweep_t2i_comparison/grid_08_logo_typography.png) ![09_counting_objects](examples/rank_sweep_t2i_comparison/grid_09_counting_objects.png) ![10_complex_scene](examples/rank_sweep_t2i_comparison/grid_10_complex_scene.png) ## Identity-edit LoRA Six edits on three real photographs through the [Krea 2 Identity Edit LoRA](https://github.com/lbouaraba/comfyui-krea2edit), same rank sweep. Details in [Test 2](BENCHMARKS.md#test-2--krea2edit-lora-identity-preserving-editing). | woman 1 | woman 2 | woman 3 | |---|---|---| | ![woman1](examples/krea2edit_lora_comparison/source_photos/source_woman1.png) | ![woman2](examples/krea2edit_lora_comparison/source_photos/source_woman2.png) | ![woman3](examples/krea2edit_lora_comparison/source_photos/source_woman3.png) | ![e1_paris_w1](examples/krea2edit_lora_comparison/grid_e1_paris_w1.png) ![e2_sunset_sky_w1](examples/krea2edit_lora_comparison/grid_e2_sunset_sky_w1.png) ![e3_horse_w2](examples/krea2edit_lora_comparison/grid_e3_horse_w2.png) ![e4_night_lights_off_w2](examples/krea2edit_lora_comparison/grid_e4_night_lights_off_w2.png) ![e5_paris_w3](examples/krea2edit_lora_comparison/grid_e5_paris_w3.png) ![e6_night_lights_off_w3](examples/krea2edit_lora_comparison/grid_e6_night_lights_off_w3.png) ## Single-prompt stress tests The two early comparisons, one seed each, across all nine formats tried during development (FP8, INT8 and rank 32 are here for reference; they were never uploaded). One seed is not a ranking -- read these as "what does this format do to this image", not "which is best". ### Hard case: dense multi-line text A rainy neon diner sign with a three-line handwritten chalkboard menu. | BF16 (reference) | INT8 + convrot | |---|---| | ![bf16](examples/neon_sign_text_test/compare_bf16_reference_00001_.png) | ![int8](examples/neon_sign_text_test/compare_int8_convrot_00001_.png) | | W4A4, no low-rank branch | SVDQuant rank 128 | |---|---| | ![w4a4](examples/neon_sign_text_test/compare_w4a4_convrot_nolowrank_00001_.png) | ![r128](examples/neon_sign_text_test/compare_svdq_r128_00001_.png) | What happened at this one seed: BF16, FP8 and INT8 render the menu correctly; W4A4 with no branch duplicates a word; rank 16 is correct but shifts a nearby sign's colour; rank 32 duplicates a line; rank 64 gets a digit wrong; rank 128 lands closest to BF16; rank 256 swaps two digits. That is not a rank ordering -- it is seed sensitivity, which is precisely why the paired multi-seed sheets above exist.
All nine variants for this prompt [`examples/neon_sign_text_test/`](examples/neon_sign_text_test) -- file names match the config names used in the benchmark tables.
### Easy case: large text, two subjects, low angle Two people, a low camera angle, and two words of large curved text on a held object. Every checkpoint renders the text correctly here, down to W4A4 with no branch; only fine composition details vary. | BF16 (reference) | SVDQuant rank 64 | |---|---| | ![bf16](examples/ice_cream_multisubject_test/compare_bf16_reference_00001_.png) | ![r64](examples/ice_cream_multisubject_test/compare_svdq_r64_00001_.png) |
All nine variants for this prompt [`examples/ice_cream_multisubject_test/`](examples/ice_cream_multisubject_test)
**Across both:** for large signage text or no text, any checkpoint here works. For dense small text the low-rank branch helps and does not fully close the gap to INT8 -- `quantize_krea2.py --format int8` is the better choice if that is your main use case.