Gallery
Every comparison image in this repo, kept out of the README so that page stays short. Nothing here is a measurement -- those live in BENCHMARKS.md. These exist because LPIPS answers "how far did it move", not "is it worse", and the two come apart: W4A4 shifts the sampling trajectory, so a checkpoint can score a large distance and still look fine, or a small one and mangle a line of text.
- Fidelity sheets, no LoRA -- 16 prompts x 7 checkpoints x 2 seeds
- Fidelity sheets, with a LoRA -- the same, under
bloomgirls-ultrarealism - Rank sweep, refined vs not
- Identity-edit LoRA
- Single-prompt stress tests
How to read the sheets. They are wide -- open one full size, they are unreadable at page width. Columns run left to right in accuracy order: BF16 reference first, then no low-rank branch, then rising rank, ending with the activation-aware build. Rows are two seeds. So anything that differs between the two rows of a single column is sampling variance, not a property of the checkpoint -- and if a difference between columns is smaller than the difference between rows, it is not a difference.
Settings are identical everywhere: 1024x1024, 8 steps, cfg 1.0, euler/simple, qwen_image_vae,
seeds 987654321 and 424242424.
Fidelity sheets, no LoRA
Built with tools/contact_sheet.py from the same renders tools/fidelity_bench.py score measures, so every image here has a number behind it in
Test 3 and Test 4.
01_dense_text
A rain-soaked neon diner sign at night, below it a handwritten chalkboard menu with three lines of text reading 'SOUP $4 / PIE $6 / COFFEE $2', reflections on wet asphalt, cinematic
Three lines of small chalkboard text. The hardest cell in the set: read the prices.
02_curved_text
Close-up of a person holding a paper coffee cup with large bold curved text 'STAY WARM' printed around the cup, soft morning light, shallow depth of field
Two large words wrapped around a cup. Every checkpoint gets this; it is the easy control.
03_hands_detail
A violinist's hands mid-performance, fingers pressed on the strings, bow in motion with visible blur, studio lighting, extreme close-up, photorealistic
Finger placement on the strings, and whether the motion-blurred bow holds together.
04_crowd_faces
A busy Tokyo street crossing at dusk, dozens of pedestrians with distinct faces and expressions, neon signage in the background, wide angle, high detail
Dozens of small faces. Look for melted or duplicated ones rather than at the whole frame.
05_symmetry_pattern
A perfectly symmetrical Islamic geometric tile mosaic, intricate repeating star and polygon pattern, deep blue and gold, overhead flat lighting, ultra sharp
Repeating geometry. Breaks in the tiling are far easier to see than colour drift.
06_multi_subject
Two chefs in white uniforms plating a dish together in a busy kitchen, one holding tweezers placing a garnish, the other pouring sauce, steam rising, low angle shot
Two people acting at once -- tweezers in one pair of hands, sauce in the other.
07_reflections_glass
A glass of iced whiskey on a dark wood bar, condensation droplets, warm bokeh lights reflected in the glass and the liquid, macro photography
Condensation and bokeh reflected through liquid. High frequency, little structure.
08_logo_typography
A vintage motorcycle fuel tank with a hand-painted logo reading 'IRON WOLF GARAGE' in bold serif letters, chrome and scratched paint texture, studio product shot
Serif signage on curved chrome: text and specular highlight in the same place.
09_counting_objects
A wooden table from directly above with exactly seven red apples arranged in a neat row next to three green pears, soft natural light, flat lay photography
Seven apples, three pears. Miscounting is a structural failure, not a detail one.
10_complex_scene
A fantasy marketplace street at golden hour, merchant stalls with hanging fabrics and baskets of spices, a dragon perched on a rooftop in the background, dense crowd, painterly digital art
Dense painterly scene. Composition should be identical; brushwork will not be.
11_portrait_woman
Close-up portrait of a woman with freckles and green eyes, windswept auburn hair, wearing a chunky knitted wool sweater, standing on a rainy city street at blue hour, shallow depth of field, natural skin texture with visible pores, catchlights in both eyes, 85mm lens, photorealistic
Skin texture, freckles, catchlights. Where a photographic LoRA earns its keep.
12_person_holding_sign
A young woman in a bright yellow raincoat standing at the end of a wooden pier, holding up a handwritten cardboard sign that reads 'BACK IN 5 MIN' in thick black marker, seagulls circling behind her, overcast diffused light, full body shot, 35mm documentary photography
Handwritten marker text on cardboard at arm's length -- text plus a full body.
13_two_people_interaction
A barista with tattooed forearms handing a paper cup across a marble counter to a bearded man in a denim jacket, both mid-conversation and smiling, morning light through a tall window, steam rising from the cup, candid documentary photography, natural skin tones
Two faces mid-expression, and the hand-off between them.
14_hands_and_face
A woman applying red lipstick while looking into a small round handheld mirror, her fingers wrapped around the mirror rim, the reflection of one eye visible in the glass, warm bathroom lighting, extreme close-up on face and hands, photorealistic detail
Hands, lips and a reflected eye in one frame at extreme close-up.
15_full_body_fashion
Full body editorial fashion photograph of a woman in a flowing emerald green silk dress mid-stride on a marble staircase, one hand trailing on the brass railing, dramatic hard side lighting, sharp fabric texture and folds, 50mm, high fashion magazine style
Fabric folds under hard side light, and whether the stride survives.
16_group_selfie
Four friends of different ethnicities crowded around a restaurant table taking a group selfie, one holding the phone at arm's length, another leaning in making a peace sign, plates of pasta and half-full wine glasses on the table, warm indoor lighting, natural candid expressions
Four faces at once, plus the arm geometry of whoever is holding the phone.
Fidelity sheets, with a LoRA
The same 16 prompts and seeds with bloomgirls-ultrarealism-krea2_4k at strength 1.0,
applied through this repo's LoRA node. The BF16 column carries the LoRA too -- the
comparison is quantized+LoRA against BF16+LoRA, which is the question the repo's earlier
LoRA benchmark never asked.
01_dense_text
A rain-soaked neon diner sign at night, below it a handwritten chalkboard menu with three lines of text reading 'SOUP $4 / PIE $6 / COFFEE $2', reflections on wet asphalt, cinematic
Three lines of small chalkboard text. The hardest cell in the set: read the prices.
02_curved_text
Close-up of a person holding a paper coffee cup with large bold curved text 'STAY WARM' printed around the cup, soft morning light, shallow depth of field
Two large words wrapped around a cup. Every checkpoint gets this; it is the easy control.
03_hands_detail
A violinist's hands mid-performance, fingers pressed on the strings, bow in motion with visible blur, studio lighting, extreme close-up, photorealistic
Finger placement on the strings, and whether the motion-blurred bow holds together.
04_crowd_faces
A busy Tokyo street crossing at dusk, dozens of pedestrians with distinct faces and expressions, neon signage in the background, wide angle, high detail
Dozens of small faces. Look for melted or duplicated ones rather than at the whole frame.
05_symmetry_pattern
A perfectly symmetrical Islamic geometric tile mosaic, intricate repeating star and polygon pattern, deep blue and gold, overhead flat lighting, ultra sharp
Repeating geometry. Breaks in the tiling are far easier to see than colour drift.
06_multi_subject
Two chefs in white uniforms plating a dish together in a busy kitchen, one holding tweezers placing a garnish, the other pouring sauce, steam rising, low angle shot
Two people acting at once -- tweezers in one pair of hands, sauce in the other.
07_reflections_glass
A glass of iced whiskey on a dark wood bar, condensation droplets, warm bokeh lights reflected in the glass and the liquid, macro photography
Condensation and bokeh reflected through liquid. High frequency, little structure.
08_logo_typography
A vintage motorcycle fuel tank with a hand-painted logo reading 'IRON WOLF GARAGE' in bold serif letters, chrome and scratched paint texture, studio product shot
Serif signage on curved chrome: text and specular highlight in the same place.
09_counting_objects
A wooden table from directly above with exactly seven red apples arranged in a neat row next to three green pears, soft natural light, flat lay photography
Seven apples, three pears. Miscounting is a structural failure, not a detail one.
10_complex_scene
A fantasy marketplace street at golden hour, merchant stalls with hanging fabrics and baskets of spices, a dragon perched on a rooftop in the background, dense crowd, painterly digital art
Dense painterly scene. Composition should be identical; brushwork will not be.
11_portrait_woman
Close-up portrait of a woman with freckles and green eyes, windswept auburn hair, wearing a chunky knitted wool sweater, standing on a rainy city street at blue hour, shallow depth of field, natural skin texture with visible pores, catchlights in both eyes, 85mm lens, photorealistic
Skin texture, freckles, catchlights. Where a photographic LoRA earns its keep.
12_person_holding_sign
A young woman in a bright yellow raincoat standing at the end of a wooden pier, holding up a handwritten cardboard sign that reads 'BACK IN 5 MIN' in thick black marker, seagulls circling behind her, overcast diffused light, full body shot, 35mm documentary photography
Handwritten marker text on cardboard at arm's length -- text plus a full body.
13_two_people_interaction
A barista with tattooed forearms handing a paper cup across a marble counter to a bearded man in a denim jacket, both mid-conversation and smiling, morning light through a tall window, steam rising from the cup, candid documentary photography, natural skin tones
Two faces mid-expression, and the hand-off between them.
14_hands_and_face
A woman applying red lipstick while looking into a small round handheld mirror, her fingers wrapped around the mirror rim, the reflection of one eye visible in the glass, warm bathroom lighting, extreme close-up on face and hands, photorealistic detail
Hands, lips and a reflected eye in one frame at extreme close-up.
15_full_body_fashion
Full body editorial fashion photograph of a woman in a flowing emerald green silk dress mid-stride on a marble staircase, one hand trailing on the brass railing, dramatic hard side lighting, sharp fabric texture and folds, 50mm, high fashion magazine style
Fabric folds under hard side light, and whether the stride survives.
16_group_selfie
Four friends of different ethnicities crowded around a restaurant table taking a group selfie, one holding the phone at arm's length, another leaning in making a peace sign, plates of pasta and half-full wine glasses on the table, warm indoor lighting, natural candid expressions
Four faces at once, plus the arm geometry of whoever is holding the phone.
Rank sweep, refined vs not
Ten prompts across rank 16 through 256, refined and non-refined, from the sweep documented in Test 1. Speed tables and the prompts themselves are there; these are the images.
Identity-edit LoRA
Six edits on three real photographs through the Krea 2 Identity Edit LoRA, same rank sweep. Details in Test 2.
| woman 1 | woman 2 | woman 3 |
|---|---|---|
 |
 |
 |
Single-prompt stress tests
The two early comparisons, one seed each, across all nine formats tried during development (FP8, INT8 and rank 32 are here for reference; they were never uploaded). One seed is not a ranking -- read these as "what does this format do to this image", not "which is best".
Hard case: dense multi-line text
A rainy neon diner sign with a three-line handwritten chalkboard menu.
| BF16 (reference) | INT8 + convrot |
|---|---|
 |
 |
| W4A4, no low-rank branch | SVDQuant rank 128 |
|---|---|
 |
 |
What happened at this one seed: BF16, FP8 and INT8 render the menu correctly; W4A4 with no branch duplicates a word; rank 16 is correct but shifts a nearby sign's colour; rank 32 duplicates a line; rank 64 gets a digit wrong; rank 128 lands closest to BF16; rank 256 swaps two digits. That is not a rank ordering -- it is seed sensitivity, which is precisely why the paired multi-seed sheets above exist.
All nine variants for this prompt
examples/neon_sign_text_test/ -- file names match the config
names used in the benchmark tables.
Easy case: large text, two subjects, low angle
Two people, a low camera angle, and two words of large curved text on a held object. Every checkpoint renders the text correctly here, down to W4A4 with no branch; only fine composition details vary.
| BF16 (reference) | SVDQuant rank 64 |
|---|---|
 |
 |
All nine variants for this prompt
Across both: for large signage text or no text, any checkpoint here works. For dense small
text the low-rank branch helps and does not fully close the gap to INT8 -- quantize_krea2.py --format int8 is the better choice if that is your main use case.