You Do Not Need a Bigger Boat: Recommendations at Reasonable Scale in a (Mostly) Serverless and Open Stack
Not on the map. Why?
Abstract (arXiv)
We argue that immature data pipelines are preventing a large portion of industry practitioners from leveraging the latest research on recommender systems. We propose our template data stack for machine learning at "reasonable scale", and show how many challenges are solved by embracing a serverless paradigm. Leveraging our experience, we detail how modern open source can provide a pipeline processing terabytes of data with limited infrastructure work.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 9 of its 24 references that are in the map. First posted on arXiv 15 Jul 2021.
Builds on
9 of 24 references.
References · 9
- 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,242
- 2020Beyond Accuracy: Behavioral Testing of NLP models with CheckListcited by 979
- 2018Horovod: fast and easy distributed deep learning in TensorFlowcited by 275
- 2020Fantastic Embeddings and How to Align Them: Zero-Shot Inference in a Multi-Shop Scenariocited by 16
- 2021Towards Demystifying Serverless Machine Learning Trainingcited by 16
- 2020A Transformer-based Embedding Model for Personalized Product Searchcited by 15
- 2021SIGIR 2021 E-Commerce Workshop Data Challengecited by 11
- 2020How to Grow a (Product) Tree: Personalized Category Suggestions for eCommerce Type-Aheadcited by 6
- 2020Shopping in the Multiverse: A Counterfactual Approach to In-Session Attributioncited by 5
Built on by
Citing papers per year: 2021: 2; 2022: 1; 2023: 2.
5 papers.
- 2022Contrastive language and vision learning of general fashion conceptscited by 41
- 2021Beyond NDCG: behavioral testing of recommender systems with RecListcited by 8
- 2021DAG Card is the new Model Cardcited by 5
- 2023Reasonable Scale Machine Learning with Open-Source Metaflowcited by 5
- 2023(Vector) Space is Not the Final Frontier: Product Search as Program Synthesiscited by 0
- 2023(Vector) Space is Not the Final Frontier: Product Search as Program Synthesis22 Apr 2023
- 2023Reasonable Scale Machine Learning with Open-Source Metaflow21 Mar 2023
- 2022Contrastive language and vision learning of general fashion concepts8 Apr 2022
- 2021Beyond NDCG: behavioral testing of recommender systems with RecList18 Nov 2021
- 2021DAG Card is the new Model Card24 Oct 2021