mlsanityData to 14 Oct 2026

ALF: Advertiser Large Foundation Model for Multi-Modal Advertiser Understanding

arXiv 2504.18785 ↗First posted 26 Apr 2025cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

We present ALF (Advertiser Large Foundation model), a multi-modal transformer architecture for understanding advertiser behavior and intent across text, image, video, and structured data modalities. Through contrastive learning and multi-task optimization, ALF creates unified advertiser representations that capture both content and behavioral patterns. Our model achieves state-of-the-art performance on critical tasks including fraud detection, policy violation identification, and advertiser similarity matching. In production deployment, ALF demonstrates significant real-world impact by delivering simultaneous gains in both precision and recall, for instance boosting recall by over 40 percentage points on one critical policy and increasing precision to 99.8% on another. The architecture's effectiveness stems from its novel combination of multi-modal transformations, inter-sample attention mechanism, spectrally normalized projections, and calibrated probabilistic outputs.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 30 of its 45 references that are in the map. First posted on arXiv 26 Apr 2025.

Builds on

30 of 45 references.

References · 30

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
  3. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
  4. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
  5. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  6. 2018Spectral Normalization for Generative Adversarial Networkscited by 1,636
  7. 2016Deep Variational Information Bottleneckcited by 930
  8. 2021Revisiting Deep Learning Models for Tabular Datacited by 740
  9. 2021FLAVA: A Foundational Language And Vision Alignment Modelcited by 649
  10. 2020Language-agnostic BERT Sentence Embeddingcited by 627
  11. 2021VLMo: Unified Vision-Language Pre-Training with Mixture-of-Modality-Expertscited by 425
  12. 2020TabTransformer: Tabular Data Modeling Using Contextual Embeddingscited by 409
18 more
  1. 2020Simple and Principled Uncertainty Estimation with Deterministic Deep Learning via Distance Awarenesscited by 389
  2. 2020DCN V2: Improved Deep & Cross Network and Practical Lessons for Web-scale Learning to Rank Systemscited by 327
  3. 2021SAINT: Improved Neural Networks for Tabular Data via Row Attention and Contrastive Pre-Trainingcited by 319
  4. 2022OmniVL:One Foundation Model for Image-Language and Video-Language Taskscited by 143
  5. 2021Self-Attention Between Datapoints: Going Beyond Individual Input-Output Pairs in Deep Learningcited by 113
  6. 2019One ticket to win them all: generalizing lottery ticket initializations across datasets and optimizerscited by 102
  7. 2017Automatic Understanding of Image and Video Advertisementscited by 68
  8. 2024OmniPred: Language Models as Universal Regressorscited by 34
  9. 2021Learning to Remove: Towards Isotropic Pre-trained BERT Embeddingcited by 23
  10. 2023Revisiting Graph-Based Fraud Detection in Sight of Heterophily and Spectrumcited by 20
  11. 2019Graph-RISE: Graph-Regularized Image Semantic Embeddingcited by 15
  12. 2024The Vizier Gaussian Process Bandit Algorithmcited by 14
  13. 2022Yggdrasil Decision Forests: A Fast and Extensible Decision Forests Librarycited by 13
  14. 2024Improving Pre-trained Self-Supervised Embeddings Through Effective Entropy Maximizationcited by 6
  15. 2023Efficient Uncertainty Estimation with Gaussian Process for Reliable Dialog Response Retrievalcited by 2
  16. 2024The Performance of Sequential Deep Learning Models in Detecting Phishing Websites Using Contextual Features of URLscited by 2
  17. 2023Using Foundation Models to Detect Policy Violations with Minimal Supervisioncited by 1
  18. 2024Multi-task CNN Behavioral Embedding Model For Transaction Fraud Detectioncited by 1

Built on by

Not cited yet.