mlsanityData to 7 Oct 2026

OPRO: Orthogonal Panel-Relative Operators for Panel-Aware In-Context Image Generation

arXiv 2603.27637 ↗First posted 29 Mar 2026cs.CVcited by 0

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

We introduce a parameter-efficient adaptation method for panel-aware in-context image generation with pre-trained diffusion transformers. The key idea is to compose learnable, panel-specific orthogonal operators onto the backbone's frozen positional encodings. This design provides two desirable properties: (1) isometry, which preserves the geometry of internal features, and (2) same-panel invariance, which maintains the model's pre-trained intra-panel synthesis behavior. Through controlled experiments, we demonstrate that the effectiveness of our adaptation method is not tied to a specific positional encoding design but generalizes across diverse positional encoding regimes. By enabling effective panel-relative conditioning, the proposed method consistently improves in-context image-based instructional editing pipelines, including state-of-the-art approaches.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 38 of its 42 references that are in the map. First posted on arXiv 29 Mar 2026.

Builds on

38 of 42 references.

Closest ancestors · 9

Same direction, newest first

  1. 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformer29 Apr
  2. 2024In-Context LoRA for Diffusion Transformers31 Oct
  3. 2024Group Diffusion Transformers are Unsupervised Multitask Learners19 Oct
  4. 2023Improving In-Context Learning in Diffusion Models with Visual Context-Modulated Prompts3 Dec
  5. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Models13 Aug
  6. 2023In-Context Learning Unlocked for Diffusion Models1 May
  7. 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
  8. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Models17 Nov
  9. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation25 Aug

Other references · 29

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  5. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  6. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  7. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  8. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  9. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  10. 2022Scalable Diffusion Models with Transformerscited by 5,931
  11. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  12. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
17 more
  1. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  2. 2022Emergent Abilities of Large Language Modelscited by 2,483
  3. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
  4. 2024Mixtral of Expertscited by 1,785
  5. 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,295
  6. 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 854
  7. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 615
  8. 2024Rotary Position Embedding for Vision Transformercited by 226
  9. 2019RAVEN: A Dataset for Relational and Analogical Visual rEasoNingcited by 225
  10. 2025Less-to-More Generalization: Unlocking More Controllability by In-Context Generationcited by 153
  11. 2019Cheap Orthogonal Constraints in Neural Networks: A Simple Parametrization of the Orthogonal and Unitary Groupcited by 133
  12. 2025ACE++: Instruction-Based Image Creation and Editing via Context-Aware Content Fillingcited by 95
  13. 2025Insert Anything: Image Insertion via In-Context Editing in DiTcited by 61
  14. 2024Large-Scale Text-to-Image Model with Inpainting is a Zero-Shot Subject-Driven Image Generatorcited by 48
  15. 2023Context Diffusion: In-Context Aware Image Generationcited by 20
  16. 2024LieRE: Lie Rotational Positional Encodingscited by 16
  17. 2025ComRoPE: Scalable and Robust Rotary Position Embedding Parameterized by Trainable Commuting Angle Matricescited by 16

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Semantically Aligned Gradient-Driven Context-Preserving Image Editing
  2. 2025Context-Aware Autoregressive Models for Multi-Conditional Image Generation
  3. 2025Region-Constraint In-Context Generation for Instructional Video Editing
  4. 2026InstructionCrafter: Generating Consistent and High-Fidelity Visual Instructions
  5. 2024UNIC-Adapter: Unified Image-instruction Adapter with Multi-modal Transformer for Image Generation
  6. 2025Control and Realism: Best of Both Worlds in Layout-to-Image without Training
  7. 2025TIDE: Achieving Balanced Subject-Driven Image Generation via Target-Instructed Diffusion Enhancement
  8. 2025EditAR: Unified Conditional Generation with Autoregressive Models