Bridging Geographic Bias in Urban Streetscape Inference via Lifelong Learning with Visual-Semantic Pivoting
Not on the map. Why?
Abstract (arXiv)
Visual perception of urban streetscapes underpins evidence-based decisions in landscape planning, public health, and place-making. Yet models trained on a few well-photographed metropolises systematically misjudge underrepresented districts, propagating geographic bias into downstream policy. We address this gap with HVSP-LL, a lifelong learning framework that couples a stratified visual-semantic pivoting module with an equity-aware rehearsal mechanism. The pivoting module organises landscape concepts along a three-tier ontology (macro structure, meso composition, micro element) and aligns image features to learnable semantic anchors at each tier, providing transferable representations that resist distributional drift. The lifelong adaptation component sequentially absorbs new urban regions while constraining inter-region perception gaps through a worst-region sample-reweighting objective and a structurally-aware exemplar buffer. We evaluate HVSP-LL on a panoramic streetscape benchmark assembled from twelve cities across four continents and seven perceptual dimensions. The framework attains 0.834 Spearman correlation on the held-out city sequence, an absolute 6.1 point improvement over the strongest continual baseline, and shrinks the inter-city perception gap to 0.094 -- a 38% reduction relative to the strongest continual baseline (0.151) and a 57% reduction relative to a representative regularisation baseline (0.218). Ablations confirm that each tier of the pivoting hierarchy contributes monotonically, and the equity-aware rehearsal converts mean backward transfer from -0.038 (without retention) to +0.013, eliminating catastrophic forgetting on the held-out sequence. Our results indicate that hierarchical anchoring is a practical pathway toward geographically equitable streetscape inference at city scale.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 46 of its 80 references that are in the map. First posted on arXiv 13 Jun 2026.
Builds on
46 of 80 references.
References · 46
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
- 2017Prototypical Networks for Few-shot Learningcited by 3,015
- 2020Supervised Contrastive Learningcited by 2,829
- 2016Pyramid Scene Parsing Networkcited by 2,479
34 more
- 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,333
- 2019A Survey on Bias and Fairness in Machine Learningcited by 1,917
- 2017Gradient Episodic Memory for Continual Learningcited by 1,898
- 2020WILDS: A Benchmark of in-the-Wild Distribution Shiftscited by 1,375
- 2018Continual Lifelong Learning with Neural Networks: A Reviewcited by 1,330
- 2019Class-Balanced Loss Based on Effective Number of Samplescited by 1,245
- 2017Memory Aware Synapses: Learning what (not) to forgetcited by 1,105
- 2020In Search of Lost Domain Generalizationcited by 1,054
- 2021Learning to Prompt for Continual Learningcited by 944
- 2020Dark Experience for General Continual Learning: a Strong, Simple Baselinecited by 911
- 2021Generalizing to Unseen Domains: A Survey on Domain Generalizationcited by 766
- 2022DualPrompt: Complementary Prompting for Rehearsal-free Continual Learningcited by 642
- 2018Learning Not to Learn: Training Deep Neural Networks with Biased Datacited by 255
- 2019Towards Fairness in Visual Recognition: Effective Strategies for Bias Mitigationcited by 252
- 2020Fair Attribute Classification through Latent Space De-biasingcited by 125
- 2016Deep Learning the City : Quantifying Urban Perception At A Global Scalecited by 65
- 2026ReTrack: Evidence-Driven Dual-Stream Directional Anchor Calibration Network for Composed Video Retrievalcited by 41
- 2024StitchFusion: Weaving Any Visual Modalities to Enhance Multimodal Semantic Segmentationcited by 39
- 2025Chat-Driven Text Generation and Interaction for Person Retrievalcited by 34
- 2025Exploring Efficient Open-Vocabulary Segmentation in the Remote Sensingcited by 31
- 2026Delving Deeper: Hierarchical Visual Perception for Robust Video-Text Retrievalcited by 23
- 2025Reasoning in Computer Vision: Taxonomy, Models, Tasks, and Methodologiescited by 17
- 2025Skyfall-GS: Synthesizing Immersive 3D Urban Scenes from Satellite Imagerycited by 17
- 2025Exploring the Underwater World Segmentation without Extra Trainingcited by 16
- 2024Learn from Global Correlations: Enhancing Evolutionary Algorithm via Spectral GNNcited by 15
- 2025MARIS: Marine Open-Vocabulary Instance Segmentation with Geometric Enhancement and Semantic Alignmentcited by 15
- 2026CONQUER: Context-Aware Representation with Query Enhancement for Text-Based Person Searchcited by 15
- 2025ChatMotion: A Multimodal Multi-Agent for Human Motion Analysiscited by 14
- 2026Advances in Global Solvers for 3D Visioncited by 13
- 2026RAM: Recover Any 3D Human Motion in-the-Wildcited by 12
- 2024Graph Canvas for Controllable 3D Scene Generationcited by 11
- 2025From Physics to Foundation Models: A Review of AI-Driven Quantitative Remote Sensing Inversioncited by 8
- 2025STG-Avatar: Animatable Human Avatars via Spacetime Gaussiancited by 8
- 2024Adaptive Masking Enhances Visual Groundingcited by 6
Built on by
Not cited yet.