mlsanityData to 14 Oct 2026

Chop & Learn: Recognizing and Generating Object-State Compositions

arXiv 2309.14339 ↗First posted 25 Sep 2023cs.CVcited by 13

Not on the map. Why?

Abstract (arXiv)

Recognizing and generating object-state compositions has been a challenging task, especially when generalizing to unseen compositions. In this paper, we study the task of cutting objects in different styles and the resulting object state changes. We propose a new benchmark suite Chop & Learn, to accommodate the needs of learning objects and different cut styles using multiple viewpoints. We also propose a new task of Compositional Image Generation, which can transfer learned cut styles to different objects, by generating novel object-state images. Moreover, we also use the videos for Compositional Action Recognition, and show valuable uses of this dataset for multiple video tasks. Project website: https://chopnlearn.github.io.

Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 54 of its 76 references that are in the map. First posted on arXiv 25 Sep 2023.

Builds on

54 of 76 references.

References · 54

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
  5. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
  6. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  7. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  8. 2022Classifier-Free Diffusion Guidancecited by 5,847
  9. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  10. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
  11. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  12. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
38 more
  1. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
  2. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  3. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
  4. 2019LXMERT: Learning Cross-Modality Encoder Representations from Transformerscited by 1,553
  5. 2019HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video Clipscited by 950
  6. 2018Scaling Egocentric Vision: The EPIC-KITCHENS Datasetcited by 795
  7. 2016NTU RGB+D: A Large Scale Dataset for 3D Human Activity Analysiscited by 686
  8. 2019End-to-End Learning of Visual Representations from Uncurated Instructional Videoscited by 507
  9. 2019COIN: A Large-scale Dataset for Comprehensive Instructional Video Analysiscited by 318
  10. 2023RealFusion: 360deg Reconstruction of Any Object from a Single Imagecited by 306
  11. 2018Videos as Space-Time Region Graphscited by 221
  12. 2019Cross-task weakly supervised learning from instructional videoscited by 199
  13. 2017Learning Spatio-Temporal Features with 3D Residual Networks for Action Recognitioncited by 178
  14. 2022EPIC-KITCHENS VISOR Benchmark: VIdeo Segmentations and Object Relationscited by 140
  15. 2014Cross-view Action Modeling, Learning and Recognitioncited by 134
  16. 2019Task-Driven Modular Networks for Zero-Shot Compositional Learningcited by 121
  17. 2019Something-Else: Compositional Action Recognition with Spatial-Temporal Interaction Networkscited by 114
  18. 2020EGO-TOPO: Environment Affordances from Egocentric Videocited by 111
  19. 2021Open World Compositional Zero-Shot Learningcited by 101
  20. 2021Learning to Predict Visual Attributes in the Wildcited by 96
  21. 2020Symmetry and Group in Attribute-Object Compositionscited by 89
  22. 2023Align and Attend: Multimodal Summarization with Dual Contrastive Lossescited by 65
  23. 2019VideoGraph: Recognizing Minutes-Long Human Activities in Videoscited by 57
  24. 2022Disentangling Visual Embeddings for Attributes and Objectscited by 55
  25. 2021Learning Graph Embeddings for Open World Compositional Zero-Shot Learningcited by 49
  26. 2018Weakly-Supervised Video Object Grounding from Text by Loss Weighting and Object Interactioncited by 40
  27. 2022ASM-Loc: Action-aware Segment Modeling for Weakly-Supervised Temporal Action Localizationcited by 40
  28. 2022Look for the Change: Learning Object States and State-Modifying Actions from Untrimmed Web Videoscited by 39
  29. 2018Time-Agnostic Prediction: Predicting Predictable Video Framescited by 37
  30. 2023Towards Scalable Neural Representation for Diverse Videoscited by 37
  31. 2020Would Mega-scale Datasets Further Enhance Spatiotemporal 3D CNNs?cited by 31
  32. 2017Joint Discovery of Object States and Manipulation Actionscited by 28
  33. 2020GTA: Global Temporal Attention for Video Action Understandingcited by 20
  34. 2021Relation-aware Compositional Zero-shot Learning for Attribute-Object Pair Recognitioncited by 19
  35. 2021Revisiting spatio-temporal layouts for compositional action recognitioncited by 19
  36. 2021Learning Temporal Dynamics from Cycles in Narrated Videocited by 13
  37. 2019Task-Aware Feature Generation for Zero-Shot Compositional Learningcited by 11
  38. 2022Multi-Task Learning of Object State Changes from Uncurated Videoscited by 10

50 most cited of 54 All 54 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 3; 2024: 5; 2025: 3; 2026: 2.

13 papers.

Sort:

By area:

  1. 2023GenHowTo: Learning to Generate Actions and State Transformations from Instructional Videoscited by 40
  2. 2023Learning Object State Changes in Videos: An Open-World Perspectivecited by 36
  3. 2024SCHEMA: State CHangEs MAtter for Procedure Planning in Instructional Videoscited by 24
  4. 2024OSCaR: Object State Captioning and State Change Representationcited by 16
  5. 2023PICTURE: PhotorealistIC virtual Try-on from UnconstRained dEsignscited by 14
  6. 2024Active Object Detection with Knowledge Aggregation and Distillation from Large Modelscited by 8
  7. 2025What Changed and What Could Have Changed? State-Change Counterfactuals for Procedure-Aware Video Representation Learningcited by 6
  8. 2025STATUS Bench: A Rigorous Benchmark for Evaluating Object State Understanding in Vision-Language Modelscited by 3
  9. 2024Anticipating Object State Changes in Long Procedural Videoscited by 2
  10. 2024Real-World Cooking Robot System from Recipes Based on Food State Recognition Using Foundation Models and PDDLcited by 2
  11. 2025Vision-Based Mistake Analysis in Procedural Activities: A Review of Advances and Challengescited by 0
  12. 2026Do Egocentric Video-Language Models Capture Both Hand- and Object-Centric Cues?cited by 0
1 more
  1. 2026Cooking beyond Frames: A Stereo Event Camera Dataset in the Kitchencited by 0