mlsanityData to 14 Oct 2026

Bridging Geographic Bias in Urban Streetscape Inference via Lifelong Learning with Visual-Semantic Pivoting

arXiv 2606.15055 ↗First posted 13 Jun 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Visual perception of urban streetscapes underpins evidence-based decisions in landscape planning, public health, and place-making. Yet models trained on a few well-photographed metropolises systematically misjudge underrepresented districts, propagating geographic bias into downstream policy. We address this gap with HVSP-LL, a lifelong learning framework that couples a stratified visual-semantic pivoting module with an equity-aware rehearsal mechanism. The pivoting module organises landscape concepts along a three-tier ontology (macro structure, meso composition, micro element) and aligns image features to learnable semantic anchors at each tier, providing transferable representations that resist distributional drift. The lifelong adaptation component sequentially absorbs new urban regions while constraining inter-region perception gaps through a worst-region sample-reweighting objective and a structurally-aware exemplar buffer. We evaluate HVSP-LL on a panoramic streetscape benchmark assembled from twelve cities across four continents and seven perceptual dimensions. The framework attains 0.834 Spearman correlation on the held-out city sequence, an absolute 6.1 point improvement over the strongest continual baseline, and shrinks the inter-city perception gap to 0.094 -- a 38% reduction relative to the strongest continual baseline (0.151) and a 57% reduction relative to a representative regularisation baseline (0.218). Ablations confirm that each tier of the pivoting hierarchy contributes monotonically, and the equity-aware rehearsal converts mean backward transfer from -0.038 (without retention) to +0.013, eliminating catastrophic forgetting on the held-out sequence. Our results indicate that hierarchical anchoring is a practical pathway toward geographically equitable streetscape inference at city scale.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 46 of its 80 references that are in the map. First posted on arXiv 13 Jun 2026.

Builds on

46 of 80 references.

References · 46

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  5. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
  6. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  7. 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
  8. 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
  9. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
  10. 2017Prototypical Networks for Few-shot Learningcited by 3,015
  11. 2020Supervised Contrastive Learningcited by 2,829
  12. 2016Pyramid Scene Parsing Networkcited by 2,479
34 more
  1. 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,333
  2. 2019A Survey on Bias and Fairness in Machine Learningcited by 1,917
  3. 2017Gradient Episodic Memory for Continual Learningcited by 1,898
  4. 2020WILDS: A Benchmark of in-the-Wild Distribution Shiftscited by 1,375
  5. 2018Continual Lifelong Learning with Neural Networks: A Reviewcited by 1,330
  6. 2019Class-Balanced Loss Based on Effective Number of Samplescited by 1,245
  7. 2017Memory Aware Synapses: Learning what (not) to forgetcited by 1,105
  8. 2020In Search of Lost Domain Generalizationcited by 1,054
  9. 2021Learning to Prompt for Continual Learningcited by 944
  10. 2020Dark Experience for General Continual Learning: a Strong, Simple Baselinecited by 911
  11. 2021Generalizing to Unseen Domains: A Survey on Domain Generalizationcited by 766
  12. 2022DualPrompt: Complementary Prompting for Rehearsal-free Continual Learningcited by 642
  13. 2018Learning Not to Learn: Training Deep Neural Networks with Biased Datacited by 255
  14. 2019Towards Fairness in Visual Recognition: Effective Strategies for Bias Mitigationcited by 252
  15. 2020Fair Attribute Classification through Latent Space De-biasingcited by 125
  16. 2016Deep Learning the City : Quantifying Urban Perception At A Global Scalecited by 65
  17. 2026ReTrack: Evidence-Driven Dual-Stream Directional Anchor Calibration Network for Composed Video Retrievalcited by 41
  18. 2024StitchFusion: Weaving Any Visual Modalities to Enhance Multimodal Semantic Segmentationcited by 39
  19. 2025Chat-Driven Text Generation and Interaction for Person Retrievalcited by 34
  20. 2025Exploring Efficient Open-Vocabulary Segmentation in the Remote Sensingcited by 31
  21. 2026Delving Deeper: Hierarchical Visual Perception for Robust Video-Text Retrievalcited by 23
  22. 2025Reasoning in Computer Vision: Taxonomy, Models, Tasks, and Methodologiescited by 17
  23. 2025Skyfall-GS: Synthesizing Immersive 3D Urban Scenes from Satellite Imagerycited by 17
  24. 2025Exploring the Underwater World Segmentation without Extra Trainingcited by 16
  25. 2024Learn from Global Correlations: Enhancing Evolutionary Algorithm via Spectral GNNcited by 15
  26. 2025MARIS: Marine Open-Vocabulary Instance Segmentation with Geometric Enhancement and Semantic Alignmentcited by 15
  27. 2026CONQUER: Context-Aware Representation with Query Enhancement for Text-Based Person Searchcited by 15
  28. 2025ChatMotion: A Multimodal Multi-Agent for Human Motion Analysiscited by 14
  29. 2026Advances in Global Solvers for 3D Visioncited by 13
  30. 2026RAM: Recover Any 3D Human Motion in-the-Wildcited by 12
  31. 2024Graph Canvas for Controllable 3D Scene Generationcited by 11
  32. 2025From Physics to Foundation Models: A Review of AI-Driven Quantitative Remote Sensing Inversioncited by 8
  33. 2025STG-Avatar: Animatable Human Avatars via Spacetime Gaussiancited by 8
  34. 2024Adaptive Masking Enhances Visual Groundingcited by 6

Built on by

Not cited yet.