PiD — Research release¶
★★★★★ Basic
Development line: project:pid · thread research-release
Last event: 2026-05-25 · 1 dated since 2026-05-25 · Researched: 2026-09-05 · confidence: high
What it is¶
PiD is a pixel diffusion decoder for generative image pipelines that replaces standard VAE and RAE decoders.
- Latent decoding: decodes latents to pixels with simultaneous 4× upscale, or 8× upscale for Scale-RAE.
- Latent support: works with conventional VAE latents and semantic latents, including DINOv2 and SigLIP.
- Fast inference: distilled checkpoints decode in four steps.
NSCLv1 weights are restricted to non-commercial research or evaluation. Use PiD when you need controlled latent-to-2K/4K decoding on a supported backbone instead of a separate pixel upscaler after the VAE.
Development line¶
- 2026-05-25 — PiD research, code, and model resources were made publicly available. On 2026-05-25, PiD was released with linked research, source code, and Hugging Face model resources. These links establish public technical entry points for the project, though the release evidence does not establish a precise version or full capabilities.
What changed¶
- 2026-05-25 — Published paper, source code, and PiD weights for FLUX, FLUX.2, Z-Image, Z-Image-Turbo, SD3, DINOv2, and SigLIP.
- 2026-05-27 — Added PiD support to ComfyUI.
- 2026-06-02 — Released checkpoints for SDXL, Qwen-Image, and Qwen-Image-2512; cleaned the codebase and enabled torch.compile support.
- 2026-07-09 — Released training code, distilled and undistilled PiD v1.5 2K→4K, and v1.5 checkpoints for FLUX, Z-Image, Z-Image-Turbo, FLUX.2, and Qwen-Image.
- 2026-07-14 — Added optional support for Boogu-Image native generation and PiD decoding of its Flux-style VAE latents.
How to use this¶
From 2026-05-25, practitioners should treat PiD's research page, source repository, and Hugging Face model page as its dated public technical entry points.
- Clone the repository, create a Python 3.12/CUDA environment with
uv sync --frozenor install the dependencies, then runPYTHONPATH=. python verify_env.py. — https://github.com/nv-tlabs/PiD - Download only the checkpoints tree:
hf download nvidia/PiD --local-dir . --include "checkpoints/*". — https://github.com/nv-tlabs/PiD - Use
from_ldmwith--backbonefor prompt-to-image generation; usefrom_cleanto encode an existing image and decode it with PiD. — https://github.com/nv-tlabs/PiD - Select
--pid_ckpt_type 2kfor 2K output; choose2kto4k_v1pt5for supported 4K models, or2kto4kfor SD3 and SDXL. — https://github.com/nv-tlabs/PiD
Best practices¶
- Verify the environment with
verify_env.pybefore running inference, and run commands from the repository root withPYTHONPATH=.. — https://github.com/nv-tlabs/PiD - Do not confuse VAE files with PiD models:
PiD_*files are distilled decoder checkpoints, whileae.safetensors, VAE/RAE, and similar files are dependent encoders and decoders. — https://huggingface.co/nvidia/PiD - Choose v1.5 2K→4K for FLUX, FLUX.2, and Qwen-Image to resolve color and corner-grid artifacts; the 2K checkpoint remains sharper at exactly 2048 px. — https://github.com/nv-tlabs/PiD
- Verify the license before deployment: published weights are restricted to non-commercial research or evaluation. — https://huggingface.co/nvidia/PiD
Superseded by this¶
- 2026-07-09 — Earlier FLUX, FLUX.2, and Qwen-Image
2kto4kcheckpoints are deprecated in favor of2kto4k_v1pt5; older weights moved tocheckpoints_deprecated/. - 2026-07-09 — Advice to use v1
2kto4kfor new FLUX, FLUX.2, and Qwen-Image 4K decodes is obsolete; v12kto4kremains current for SD3 and SDXL.
Still unknown¶
- The initial README lists dates for subsequent updates, but GitHub does not publish separate versioned releases; exact commit SHAs and timestamps are not established.
- Speed and quality claims come from the authors' own benchmarks; independent reproducible evaluation on a specific workflow was not tested here.
Sources¶
| source | title | read |
|---|---|---|
| https://research.nvidia.com/labs/sil/projects/pid/ | PiD: Fast and High-Resolution Latent Decoding with Pixel Diffusion | 2026-09-05 |
| https://github.com/nv-tlabs/PiD | nv-tlabs/PiD — PiD: Pixel Diffusion Decoder | 2026-09-05 |
| https://huggingface.co/nvidia/PiD | nvidia/PiD model repository | 2026-09-05 |
| https://arxiv.org/abs/2605.23902 | PiD: Fast and High-Resolution Latent Decoding with Pixel Diffusion | 2026-09-05 |
Agent brief¶
- Subject:
project:pid, threadresearch-release, 1 dated events 2026-05-25 → 2026-05-25. - Practical note: From 2026-05-25, practitioners should treat PiD's research page, source repository, and Hugging Face model page as its dated public technical entry points.
- Confidence: high. Dated supersedes above are the authority for what is obsolete.