From 5989706f5f105ccf7ec46d4094fd7e24ea7511f1 Mon Sep 17 00:00:00 2001 From: mlzerotoheroyoutube <351383126+mlzerotoheroyoutube@users.noreply.github.com> Date: Tue, 3 Nov 2026 11:09:31 -0800 Subject: [PATCH 1/2] [docs] Fix 22 dead external links in docs/source/en Point moved docs (PyTorch, torchao, NVIDIA NeMo AutoModel, huggingface/kernels) at their current pages, update renamed repos (Tencent-Hunyuan/HunyuanVideo-1.5, PrunaAI/pruna), swap removed paper PDFs for their arXiv pages, and replace a CI preview link with the relative create_dataset link used by the other guides. Co-Authored-By: Claude Opus 5.5 --- .../en/api/models/autoencoder_kl_hunyuan_video15.md | 2 +- docs/source/en/api/models/autoencoder_same.md | 2 +- docs/source/en/api/models/autoencoderkl_cogvideox.md | 2 +- docs/source/en/api/models/cogvideox_transformer3d.md | 2 +- .../en/api/models/hunyuan_video15_transformer_3d.md | 2 +- docs/source/en/api/models/stable_audio_3_transformer.md | 2 +- docs/source/en/api/pipelines/lumina.md | 2 +- docs/source/en/api/pipelines/pix2pix.md | 2 +- docs/source/en/optimization/fp16.md | 8 ++++---- docs/source/en/optimization/pruna.md | 2 +- docs/source/en/quantization/torchao.md | 4 ++-- docs/source/en/training/controlnet.md | 2 +- docs/source/en/training/nemo_automodel.md | 6 +++--- docs/source/en/training/t2i_adapters.md | 2 +- docs/source/en/using-diffusers/text-img2vid.md | 2 +- 15 files changed, 21 insertions(+), 21 deletions(-) diff --git a/docs/source/en/api/models/autoencoder_kl_hunyuan_video15.md b/docs/source/en/api/models/autoencoder_kl_hunyuan_video15.md index 445aa3eaa7a8..2dbf3f60ea0f 100644 --- a/docs/source/en/api/models/autoencoder_kl_hunyuan_video15.md +++ b/docs/source/en/api/models/autoencoder_kl_hunyuan_video15.md @@ -11,7 +11,7 @@ specific language governing permissions and limitations under the License. --> # AutoencoderKLHunyuanVideo15 -The 3D variational autoencoder (VAE) model with KL loss used in [HunyuanVideo1.5](https://github.com/Tencent/HunyuanVideo1-1.5) by Tencent. +The 3D variational autoencoder (VAE) model with KL loss used in [HunyuanVideo1.5](https://github.com/Tencent-Hunyuan/HunyuanVideo-1.5) by Tencent. The model can be loaded with the following code snippet. diff --git a/docs/source/en/api/models/autoencoder_same.md b/docs/source/en/api/models/autoencoder_same.md index 074f4245b812..b68cbc5b600f 100644 --- a/docs/source/en/api/models/autoencoder_same.md +++ b/docs/source/en/api/models/autoencoder_same.md @@ -12,7 +12,7 @@ specific language governing permissions and limitations under the License. # AutoencoderSAME -The **SAME** (Semantically-Aligned Music Encoder) autoencoder is used by [Stable Audio 3](https://stability.ai/news/stable-audio-3) +The **SAME** (Semantically-Aligned Music Encoder) autoencoder is used by [Stable Audio 3](https://stability.ai/news-updates/meet-stable-audio-3-the-model-family-built-for-artistic-experimentation-with-open-weight-models) to compress stereo audio waveforms into a compact latent sequence and reconstruct them. The encoder stacks [`SAMETransformerResamplingBlock`] modules, each of which groups a fixed number of audio diff --git a/docs/source/en/api/models/autoencoderkl_cogvideox.md b/docs/source/en/api/models/autoencoderkl_cogvideox.md index 9d2e13758da9..170dc5cf5d1f 100644 --- a/docs/source/en/api/models/autoencoderkl_cogvideox.md +++ b/docs/source/en/api/models/autoencoderkl_cogvideox.md @@ -11,7 +11,7 @@ specific language governing permissions and limitations under the License. --> # AutoencoderKLCogVideoX -The 3D variational autoencoder (VAE) model with KL loss used in [CogVideoX](https://github.com/THUDM/CogVideo) was introduced in [CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer](https://github.com/THUDM/CogVideo/blob/main/resources/CogVideoX.pdf) by Tsinghua University & ZhipuAI. +The 3D variational autoencoder (VAE) model with KL loss used in [CogVideoX](https://github.com/THUDM/CogVideo) was introduced in [CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer](https://arxiv.org/abs/2408.06072) by Tsinghua University & ZhipuAI. The model can be loaded with the following code snippet. diff --git a/docs/source/en/api/models/cogvideox_transformer3d.md b/docs/source/en/api/models/cogvideox_transformer3d.md index f85f2929c682..bd29dea3d0f6 100644 --- a/docs/source/en/api/models/cogvideox_transformer3d.md +++ b/docs/source/en/api/models/cogvideox_transformer3d.md @@ -11,7 +11,7 @@ specific language governing permissions and limitations under the License. --> # CogVideoXTransformer3DModel -A Diffusion Transformer model for 3D data from [CogVideoX](https://github.com/THUDM/CogVideo) was introduced in [CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer](https://github.com/THUDM/CogVideo/blob/main/resources/CogVideoX.pdf) by Tsinghua University & ZhipuAI. +A Diffusion Transformer model for 3D data from [CogVideoX](https://github.com/THUDM/CogVideo) was introduced in [CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer](https://arxiv.org/abs/2408.06072) by Tsinghua University & ZhipuAI. The model can be loaded with the following code snippet. diff --git a/docs/source/en/api/models/hunyuan_video15_transformer_3d.md b/docs/source/en/api/models/hunyuan_video15_transformer_3d.md index 5403d45d1af0..58e8d1c674be 100644 --- a/docs/source/en/api/models/hunyuan_video15_transformer_3d.md +++ b/docs/source/en/api/models/hunyuan_video15_transformer_3d.md @@ -11,7 +11,7 @@ specific language governing permissions and limitations under the License. --> # HunyuanVideo15Transformer3DModel -A Diffusion Transformer model for 3D video-like data used in [HunyuanVideo1.5](https://github.com/Tencent/HunyuanVideo1-1.5). +A Diffusion Transformer model for 3D video-like data used in [HunyuanVideo1.5](https://github.com/Tencent-Hunyuan/HunyuanVideo-1.5). The model can be loaded with the following code snippet. diff --git a/docs/source/en/api/models/stable_audio_3_transformer.md b/docs/source/en/api/models/stable_audio_3_transformer.md index dc3c81d3032c..1c69383f6dd2 100644 --- a/docs/source/en/api/models/stable_audio_3_transformer.md +++ b/docs/source/en/api/models/stable_audio_3_transformer.md @@ -13,7 +13,7 @@ specific language governing permissions and limitations under the License. # StableAudio3DiTModel A rectified-flow velocity-prediction Diffusion Transformer (DiT) for audio generation, used in -[Stable Audio 3](https://stability.ai/news/stable-audio-3). +[Stable Audio 3](https://stability.ai/news-updates/meet-stable-audio-3-the-model-family-built-for-artistic-experimentation-with-open-weight-models). Each [`StableAudio3DiTBlock`] performs: diff --git a/docs/source/en/api/pipelines/lumina.md b/docs/source/en/api/pipelines/lumina.md index 762c32f645c6..dfbe92c849cd 100644 --- a/docs/source/en/api/pipelines/lumina.md +++ b/docs/source/en/api/pipelines/lumina.md @@ -13,7 +13,7 @@ specific language governing permissions and limitations under the License. # Lumina-T2X ![concepts](https://github.com/Alpha-VLLM/Lumina-T2X/assets/54879512/9f52eabb-07dc-4881-8257-6d8a5f2a0a5a) -[Lumina-Next : Making Lumina-T2X Stronger and Faster with Next-DiT](https://github.com/Alpha-VLLM/Lumina-T2X/blob/main/assets/lumina-next.pdf) from Alpha-VLLM, OpenGVLab, Shanghai AI Laboratory. +[Lumina-Next : Making Lumina-T2X Stronger and Faster with Next-DiT](https://arxiv.org/abs/2406.18583) from Alpha-VLLM, OpenGVLab, Shanghai AI Laboratory. The abstract from the paper is: diff --git a/docs/source/en/api/pipelines/pix2pix.md b/docs/source/en/api/pipelines/pix2pix.md index 0e65269afd47..e3b14f3cce9a 100644 --- a/docs/source/en/api/pipelines/pix2pix.md +++ b/docs/source/en/api/pipelines/pix2pix.md @@ -22,7 +22,7 @@ The abstract from the paper is: *We propose a method for editing images from human instructions: given an input image and a written instruction that tells the model what to do, our model follows these instructions to edit the image. To obtain training data for this problem, we combine the knowledge of two large pretrained models -- a language model (GPT-3) and a text-to-image model (Stable Diffusion) -- to generate a large dataset of image editing examples. Our conditional diffusion model, InstructPix2Pix, is trained on our generated data, and generalizes to real images and user-written instructions at inference time. Since it performs edits in the forward pass and does not require per example fine-tuning or inversion, our model edits images quickly, in a matter of seconds. We show compelling editing results for a diverse collection of input images and written instructions.* -You can find additional information about InstructPix2Pix on the [project page](https://www.timothybrooks.com/instruct-pix2pix), [original codebase](https://github.com/timothybrooks/instruct-pix2pix), and try it out in a [demo](https://huggingface.co/spaces/timbrooks/instruct-pix2pix). +You can find additional information about InstructPix2Pix in the [paper](https://arxiv.org/abs/2211.09800), [original codebase](https://github.com/timothybrooks/instruct-pix2pix), and try it out in a [demo](https://huggingface.co/spaces/timbrooks/instruct-pix2pix). > [!TIP] > Make sure to check out the Schedulers [guide](../../using-diffusers/schedulers) to learn how to explore the tradeoff between scheduler speed and quality, and see the [reuse components across pipelines](../../using-diffusers/loading#reusing-models-in-multiple-pipelines) section to learn how to efficiently load the same components into multiple pipelines. diff --git a/docs/source/en/optimization/fp16.md b/docs/source/en/optimization/fp16.md index d3a73aac8595..8ea2a1aefae8 100644 --- a/docs/source/en/optimization/fp16.md +++ b/docs/source/en/optimization/fp16.md @@ -252,10 +252,10 @@ The [diffusers-torchao](https://github.com/sayakpaul/diffusers-torchao#benchmark [Kernels](https://huggingface.co/docs/kernels/index) is a library for building, distributing, and loading optimized compute kernels on the [Hub](https://huggingface.co/kernels-community). It supports [attention](./attention_backends#setattentionbackend) kernels and custom CUDA kernels for operations like RMSNorm, GEGLU, RoPE, and AdaLN. -The [Diffusers Pipeline Integration](https://github.com/huggingface/kernels/blob/main/skills/cuda-kernels/references/diffusers-integration.md) guide shows how to integrate a kernel with the [add cuda-kernels](https://github.com/huggingface/kernels/blob/main/skills/cuda-kernels/SKILL.md) skill. This skill enables an agent, like Claude or Codex, to write custom kernels targeted towards a specific model and your hardware. +The [Diffusers Pipeline Integration](https://github.com/huggingface/kernels/blob/main/kernel-builder/skills/cuda-kernels/references/diffusers-integration.md) guide shows how to integrate a kernel with the [add cuda-kernels](https://github.com/huggingface/kernels/blob/main/kernel-builder/skills/cuda-kernels/SKILL.md) skill. This skill enables an agent, like Claude or Codex, to write custom kernels targeted towards a specific model and your hardware. > [!TIP] -> Install the [add cuda-kernels](https://github.com/huggingface/kernels/blob/main/skills/cuda-kernels/SKILL.md) skill to teach an agent how to write a kernel. The [Custom kernels for all from Codex and Claude](https://huggingface.co/blog/custom-cuda-kernels-agent-skills) blog post covers this in more detail. +> Install the [add cuda-kernels](https://github.com/huggingface/kernels/blob/main/kernel-builder/skills/cuda-kernels/SKILL.md) skill to teach an agent how to write a kernel. The [Custom kernels for all from Codex and Claude](https://huggingface.co/blog/custom-cuda-kernels-agent-skills) blog post covers this in more detail. For example, a custom RMSNorm kernel (generated by the `add cuda-kernels` skill) with [torch.compile](#torchcompile) speeds up LTX-Video generation 1.43x on an H100. @@ -268,9 +268,9 @@ For example, a custom RMSNorm kernel (generated by the `add cuda-kernels` skill) ## Dynamic quantization -[Dynamic quantization](https://pytorch.org/tutorials/recipes/recipes/dynamic_quantization.html) improves inference speed by reducing precision to enable faster math operations. This particular type of quantization determines how to scale the activations based on the data at runtime rather than using a fixed scaling factor. As a result, the scaling factor is more accurately aligned with the data. +[Dynamic quantization](https://docs.pytorch.org/ao/main/api_reference/generated/torchao.quantization.Int8DynamicActivationInt8WeightConfig.html) improves inference speed by reducing precision to enable faster math operations. This particular type of quantization determines how to scale the activations based on the data at runtime rather than using a fixed scaling factor. As a result, the scaling factor is more accurately aligned with the data. -The example below applies [dynamic int8 quantization](https://pytorch.org/tutorials/recipes/recipes/dynamic_quantization.html) to the UNet and VAE with the [torchao](../quantization/torchao) library. +The example below applies [dynamic int8 quantization](https://docs.pytorch.org/ao/main/api_reference/generated/torchao.quantization.Int8DynamicActivationInt8WeightConfig.html) to the UNet and VAE with the [torchao](../quantization/torchao) library. > [!TIP] > Refer to our [torchao](../quantization/torchao) docs to learn more about how to use the Diffusers torchao integration. diff --git a/docs/source/en/optimization/pruna.md b/docs/source/en/optimization/pruna.md index dfb42cb441e1..599eb570a996 100644 --- a/docs/source/en/optimization/pruna.md +++ b/docs/source/en/optimization/pruna.md @@ -180,7 +180,7 @@ Now that you have seen how to optimize and evaluate your models, you can start u ## Reference -- [Pruna](https://github.com/pruna-ai/pruna) +- [Pruna](https://github.com/PrunaAI/pruna) - [Pruna optimization](https://docs.pruna.ai/en/stable/docs_pruna/user_manual/configure.html#configure-algorithms) - [Pruna evaluation](https://docs.pruna.ai/en/stable/docs_pruna/user_manual/evaluate.html) - [Pruna tutorials](https://docs.pruna.ai/en/stable/docs_pruna/tutorials/index.html) diff --git a/docs/source/en/quantization/torchao.md b/docs/source/en/quantization/torchao.md index 2baf7e64d8fe..7dff72bd5971 100644 --- a/docs/source/en/quantization/torchao.md +++ b/docs/source/en/quantization/torchao.md @@ -19,9 +19,9 @@ Make sure Pytorch 2.5+ and torchao are installed with the command below. uv pip install -U torch torchao ``` -Each quantization dtype is available as a separate instance of a [AOBaseConfig](https://docs.pytorch.org/ao/main/api_ref_quantization.html#inference-apis-for-quantize) class. This provides more flexible configuration options by exposing more available arguments. +Each quantization dtype is available as a separate instance of a [AOBaseConfig](https://docs.pytorch.org/ao/main/api_reference/generated/torchao.core.config.AOBaseConfig.html) class. This provides more flexible configuration options by exposing more available arguments. -Pass the `AOBaseConfig` of a quantization dtype, like [Int4WeightOnlyConfig](https://docs.pytorch.org/ao/main/generated/torchao.quantization.Int4WeightOnlyConfig) to [`TorchAoConfig`] in [`~ModelMixin.from_pretrained`]. +Pass the `AOBaseConfig` of a quantization dtype, like [Int4WeightOnlyConfig](https://docs.pytorch.org/ao/main/api_reference/generated/torchao.quantization.Int4WeightOnlyConfig.html) to [`TorchAoConfig`] in [`~ModelMixin.from_pretrained`]. ```py import torch diff --git a/docs/source/en/training/controlnet.md b/docs/source/en/training/controlnet.md index 9cb7526dd131..998198979f09 100644 --- a/docs/source/en/training/controlnet.md +++ b/docs/source/en/training/controlnet.md @@ -95,7 +95,7 @@ As with the script parameters, a general walkthrough of the training script is p The training script has a [`make_train_dataset`](https://github.com/huggingface/diffusers/blob/64603389da01082055a901f2883c4810d1144edb/examples/controlnet/train_controlnet.py#L582) function for preprocessing the dataset with image transforms and caption tokenization. You'll see that in addition to the usual caption tokenization and image transforms, the script also includes transforms for the conditioning image. > [!TIP] -> If you're streaming a dataset on a TPU, performance may be bottlenecked by the ๐Ÿค— Datasets library which is not optimized for images. To ensure maximum throughput, you're encouraged to explore other dataset formats like [WebDataset](https://webdataset.github.io/webdataset/), [TorchData](https://github.com/pytorch/data), and [TensorFlow Datasets](https://www.tensorflow.org/datasets/tfless_tfds). +> If you're streaming a dataset on a TPU, performance may be bottlenecked by the ๐Ÿค— Datasets library which is not optimized for images. To ensure maximum throughput, you're encouraged to explore other dataset formats like [WebDataset](https://github.com/webdataset/webdataset), [TorchData](https://github.com/pytorch/data), and [TensorFlow Datasets](https://www.tensorflow.org/datasets/tfless_tfds). ```py conditioning_image_transforms = transforms.Compose( diff --git a/docs/source/en/training/nemo_automodel.md b/docs/source/en/training/nemo_automodel.md index 0d6c30006b86..4a815b24e362 100644 --- a/docs/source/en/training/nemo_automodel.md +++ b/docs/source/en/training/nemo_automodel.md @@ -118,7 +118,7 @@ Preprocessing produces a cache directory organized by resolution bucket. NeMo Au ``` > [!TIP] -> See the [Diffusion Dataset Preparation](https://docs.nvidia.com/nemo/automodel/latest/guides/diffusion/dataset.html) guide for caption formats, input data requirements, and all available preprocessing arguments. +> See the [Diffusion Dataset Preparation](https://docs.nvidia.com/nemo/automodel/latest/datasets/diffusion-dataset) guide for caption formats, input data requirements, and all available preprocessing arguments. ## Training configuration @@ -372,7 +372,7 @@ This integration provides several benefits for Diffusers users: ## Resources - [NeMo Automodel GitHub](https://github.com/NVIDIA-NeMo/Automodel) -- [Diffusion Fine-Tuning Guide](https://docs.nvidia.com/nemo/automodel/latest/guides/diffusion/finetune.html) -- [Diffusion Dataset Preparation](https://docs.nvidia.com/nemo/automodel/latest/guides/diffusion/dataset.html) +- [Diffusion Fine-Tuning Guide](https://docs.nvidia.com/nemo/automodel/latest/recipes-e2e-examples/diffusion-fine-tuning) +- [Diffusion Dataset Preparation](https://docs.nvidia.com/nemo/automodel/latest/datasets/diffusion-dataset) - [Diffusion Model Coverage](https://docs.nvidia.com/nemo/automodel/latest/model-coverage/diffusion.html) - [NeMo Automodel for Transformers (LLM/VLM fine-tuning)](https://huggingface.co/docs/transformers/en/community_integrations/nemo_automodel_finetuning) diff --git a/docs/source/en/training/t2i_adapters.md b/docs/source/en/training/t2i_adapters.md index 19c2059aa687..4e18438a0938 100644 --- a/docs/source/en/training/t2i_adapters.md +++ b/docs/source/en/training/t2i_adapters.md @@ -149,7 +149,7 @@ If you want to learn more about how the training loop works, check out the [Unde Now youโ€™re ready to launch the training script! ๐Ÿš€ -For this example training, you'll use the [fusing/fill50k](https://huggingface.co/datasets/fusing/fill50k) dataset. You can also create and use your own dataset if you want (see the [Create a dataset for training](https://moon-ci-docs.huggingface.co/docs/diffusers/pr_5512/en/training/create_dataset) guide). +For this example training, you'll use the [fusing/fill50k](https://huggingface.co/datasets/fusing/fill50k) dataset. You can also create and use your own dataset if you want (see the [Create a dataset for training](create_dataset) guide). Set the environment variable `MODEL_DIR` to a model id on the Hub or a path to a local model and `OUTPUT_DIR` to where you want to save the model. diff --git a/docs/source/en/using-diffusers/text-img2vid.md b/docs/source/en/using-diffusers/text-img2vid.md index 8a7ab648d694..f289c00e884e 100644 --- a/docs/source/en/using-diffusers/text-img2vid.md +++ b/docs/source/en/using-diffusers/text-img2vid.md @@ -411,7 +411,7 @@ export_to_video(output, "output.mp4", fps=16) ## Inference speed -[torch.compile](https://pytorch.org/tutorials/intermediate/torch_compile_tutorial_.html) can speedup inference by using optimized kernels. Compilation takes longer the first time, but once compiled, it is much faster. It is best to compile the pipeline once, and then use the pipeline multiple times without changing anything. A change, such as in the image size, triggers recompilation. +[torch.compile](https://docs.pytorch.org/tutorials/intermediate/torch_compile_tutorial.html) can speedup inference by using optimized kernels. Compilation takes longer the first time, but once compiled, it is much faster. It is best to compile the pipeline once, and then use the pipeline multiple times without changing anything. A change, such as in the image size, triggers recompilation. The example below compiles the transformer in the pipeline and uses the `"max-autotune"` mode to maximize performance. From 46088c0d40c4fea8236a46483c02736b99432c4f Mon Sep 17 00:00:00 2001 From: mlzerotoheroyoutube <351383126+mlzerotoheroyoutube@users.noreply.github.com> Date: Tue, 3 Nov 2026 18:14:15 -0800 Subject: [PATCH 2/2] [docs] Use huggingface.co/papers links for the replaced paper PDFs Co-Authored-By: Claude Opus 5.5 --- docs/source/en/api/models/autoencoderkl_cogvideox.md | 2 +- docs/source/en/api/models/cogvideox_transformer3d.md | 2 +- docs/source/en/api/pipelines/lumina.md | 2 +- docs/source/en/api/pipelines/pix2pix.md | 2 +- 4 files changed, 4 insertions(+), 4 deletions(-) diff --git a/docs/source/en/api/models/autoencoderkl_cogvideox.md b/docs/source/en/api/models/autoencoderkl_cogvideox.md index 170dc5cf5d1f..6c90e8556a2a 100644 --- a/docs/source/en/api/models/autoencoderkl_cogvideox.md +++ b/docs/source/en/api/models/autoencoderkl_cogvideox.md @@ -11,7 +11,7 @@ specific language governing permissions and limitations under the License. --> # AutoencoderKLCogVideoX -The 3D variational autoencoder (VAE) model with KL loss used in [CogVideoX](https://github.com/THUDM/CogVideo) was introduced in [CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer](https://arxiv.org/abs/2408.06072) by Tsinghua University & ZhipuAI. +The 3D variational autoencoder (VAE) model with KL loss used in [CogVideoX](https://github.com/THUDM/CogVideo) was introduced in [CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer](https://huggingface.co/papers/2408.06072) by Tsinghua University & ZhipuAI. The model can be loaded with the following code snippet. diff --git a/docs/source/en/api/models/cogvideox_transformer3d.md b/docs/source/en/api/models/cogvideox_transformer3d.md index bd29dea3d0f6..113569c151d0 100644 --- a/docs/source/en/api/models/cogvideox_transformer3d.md +++ b/docs/source/en/api/models/cogvideox_transformer3d.md @@ -11,7 +11,7 @@ specific language governing permissions and limitations under the License. --> # CogVideoXTransformer3DModel -A Diffusion Transformer model for 3D data from [CogVideoX](https://github.com/THUDM/CogVideo) was introduced in [CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer](https://arxiv.org/abs/2408.06072) by Tsinghua University & ZhipuAI. +A Diffusion Transformer model for 3D data from [CogVideoX](https://github.com/THUDM/CogVideo) was introduced in [CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer](https://huggingface.co/papers/2408.06072) by Tsinghua University & ZhipuAI. The model can be loaded with the following code snippet. diff --git a/docs/source/en/api/pipelines/lumina.md b/docs/source/en/api/pipelines/lumina.md index dfbe92c849cd..688d11b844f9 100644 --- a/docs/source/en/api/pipelines/lumina.md +++ b/docs/source/en/api/pipelines/lumina.md @@ -13,7 +13,7 @@ specific language governing permissions and limitations under the License. # Lumina-T2X ![concepts](https://github.com/Alpha-VLLM/Lumina-T2X/assets/54879512/9f52eabb-07dc-4881-8257-6d8a5f2a0a5a) -[Lumina-Next : Making Lumina-T2X Stronger and Faster with Next-DiT](https://arxiv.org/abs/2406.18583) from Alpha-VLLM, OpenGVLab, Shanghai AI Laboratory. +[Lumina-Next : Making Lumina-T2X Stronger and Faster with Next-DiT](https://huggingface.co/papers/2406.18583) from Alpha-VLLM, OpenGVLab, Shanghai AI Laboratory. The abstract from the paper is: diff --git a/docs/source/en/api/pipelines/pix2pix.md b/docs/source/en/api/pipelines/pix2pix.md index e3b14f3cce9a..a8de49c898e0 100644 --- a/docs/source/en/api/pipelines/pix2pix.md +++ b/docs/source/en/api/pipelines/pix2pix.md @@ -22,7 +22,7 @@ The abstract from the paper is: *We propose a method for editing images from human instructions: given an input image and a written instruction that tells the model what to do, our model follows these instructions to edit the image. To obtain training data for this problem, we combine the knowledge of two large pretrained models -- a language model (GPT-3) and a text-to-image model (Stable Diffusion) -- to generate a large dataset of image editing examples. Our conditional diffusion model, InstructPix2Pix, is trained on our generated data, and generalizes to real images and user-written instructions at inference time. Since it performs edits in the forward pass and does not require per example fine-tuning or inversion, our model edits images quickly, in a matter of seconds. We show compelling editing results for a diverse collection of input images and written instructions.* -You can find additional information about InstructPix2Pix in the [paper](https://arxiv.org/abs/2211.09800), [original codebase](https://github.com/timothybrooks/instruct-pix2pix), and try it out in a [demo](https://huggingface.co/spaces/timbrooks/instruct-pix2pix). +You can find additional information about InstructPix2Pix in the [paper](https://huggingface.co/papers/2211.09800), [original codebase](https://github.com/timothybrooks/instruct-pix2pix), and try it out in a [demo](https://huggingface.co/spaces/timbrooks/instruct-pix2pix). > [!TIP] > Make sure to check out the Schedulers [guide](../../using-diffusers/schedulers) to learn how to explore the tradeoff between scheduler speed and quality, and see the [reuse components across pipelines](../../using-diffusers/loading#reusing-models-in-multiple-pipelines) section to learn how to efficiently load the same components into multiple pipelines.