{"list":"other","total":81,"rows":[{"id":"2407.21783","title":"The Llama 3 Herd of Models","created":"2024-07-31","cited_by_count":14715},{"id":"2304.08485","title":"Visual Instruction Tuning","created":"2023-04-17","cited_by_count":7869},{"id":"2403.05530","title":"Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context","created":"2024-03-08","cited_by_count":3224},{"id":"2304.10592","title":"MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Models","created":"2023-04-20","cited_by_count":2711},{"id":"2308.12966","title":"Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyond","created":"2023-08-24","cited_by_count":2224},{"id":"2311.16502","title":"MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI","created":"2023-11-27","cited_by_count":2080},{"id":"2404.14219","title":"Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone","created":"2024-04-22","cited_by_count":1917},{"id":"2305.10355","title":"Evaluating Object Hallucination in Large Vision-Language Models","created":"2023-05-17","cited_by_count":1729},{"id":"2310.02255","title":"MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts","created":"2023-10-03","cited_by_count":1614},{"id":"2203.10244","title":"ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoning","created":"2022-03-19","cited_by_count":1479},{"id":"1504.00325","title":"Microsoft COCO Captions: Data Collection and Evaluation Server","created":"2015-04-01","cited_by_count":1462},{"id":"2405.21075","title":"Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis","created":"2024-05-31","cited_by_count":1413},{"id":"2311.10122","title":"Video-LLaVA: Learning United Visual Representation by Alignment Before Projection","created":"2023-11-16","cited_by_count":1402},{"id":"2311.17005","title":"MVBench: A Comprehensive Multi-modal Video Understanding Benchmark","created":"2023-11-28","cited_by_count":1109},{"id":"2306.14824","title":"Kosmos-2: Grounding Multimodal Large Language Models to the World","created":"2023-06-26","cited_by_count":1089},{"id":"2312.11805","title":"Gemini: A Family of Highly Capable Multimodal Models","created":"2023-12-19","cited_by_count":872},{"id":"2305.06355","title":"VideoChat: Chat-Centric Video Understanding","created":"2023-05-10","cited_by_count":857},{"id":"2406.07476","title":"VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMs","created":"2024-06-11","cited_by_count":771},{"id":"2306.08568","title":"WizardCoder: Empowering Code Large Language Models with Evol-Instruct","created":"2023-06-14","cited_by_count":733},{"id":"2403.05525","title":"DeepSeek-VL: Towards Real-World Vision-Language Understanding","created":"2024-03-08","cited_by_count":733},{"id":"2311.03079","title":"CogVLM: Visual Expert for Pretrained Language Models","created":"2023-11-06","cited_by_count":708},{"id":"2407.07726","title":"PaliGemma: A versatile 3B VLM for transfer","created":"2024-07-10","cited_by_count":696},{"id":"1709.00103","title":"Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learning","created":"2017-08-31","cited_by_count":687},{"id":"2310.09478","title":"MiniGPT-v2: large language model as a unified interface for vision-language multi-task learning","created":"2023-10-14","cited_by_count":625},{"id":"2308.01390","title":"OpenFlamingo: An Open-Source Framework for Training Large Autoregressive Vision-Language Models","created":"2023-08-02","cited_by_count":565},{"id":"2109.00122","title":"FinQA: A Dataset of Numerical Reasoning over Financial Data","created":"2021-09-01","cited_by_count":562},{"id":"2311.17043","title":"LLaMA-VID: An Image is Worth 2 Tokens in Large Language Models","created":"2023-11-28","cited_by_count":546},{"id":"1508.00305","title":"Compositional Semantic Parsing on Semi-Structured Tables","created":"2015-08-03","cited_by_count":515},{"id":"2310.07704","title":"Ferret: Refer and Ground Anything Anywhere at Any Granularity","created":"2023-10-11","cited_by_count":509},{"id":"2305.11175","title":"VisionLLM: Large Language Model is also an Open-Ended Decoder for Vision-Centric Tasks","created":"2023-05-18","cited_by_count":501},{"id":"2309.05653","title":"MAmmoTH: Building Math Generalist Models through Hybrid Instruction Tuning","created":"2023-09-11","cited_by_count":487},{"id":"2305.07895","title":"OCRBench: On the Hidden Mystery of OCR in Large Multimodal Models","created":"2023-05-13","cited_by_count":476},{"id":"1811.00491","title":"A Corpus for Reasoning About Natural Language Grounded in Photographs","created":"2018-11-01","cited_by_count":459},{"id":"1909.02164","title":"TabFact: A Large-scale Dataset for Table-based Fact Verification","created":"2019-09-05","cited_by_count":428},{"id":"2202.08906","title":"ST-MoE: Designing Stable and Transferable Sparse Expert Models","created":"2022-02-17","cited_by_count":399},{"id":"2403.18814","title":"Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models","created":"2024-03-27","cited_by_count":365},{"id":"2306.09344","title":"DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Data","created":"2023-06-15","cited_by_count":337},{"id":"2405.02246","title":"What matters when building vision-language models?","created":"2024-05-03","cited_by_count":326},{"id":"2404.16994","title":"PLLaVA : Parameter-free LLaVA Extension from Images to Videos for Video Dense Captioning","created":"2024-04-25","cited_by_count":322},{"id":"2307.03601","title":"GPT4RoI: Instruction Tuning Large Language Model on Region-of-Interest","created":"2023-07-07","cited_by_count":302},{"id":"2306.05425","title":"MIMIC-IT: Multi-Modal In-Context Instruction Tuning","created":"2023-06-08","cited_by_count":267},{"id":"2402.14658","title":"OpenCodeInterpreter: Integrating Code Generation with Execution and Refinement","created":"2024-02-22","cited_by_count":247},{"id":"2403.12895","title":"mPLUG-DocOwl 1.5: Unified Structure Learning for OCR-free Document Understanding","created":"2024-03-19","cited_by_count":220},{"id":"2408.16500","title":"CogVLM2: Visual Language Models for Image and Video Understanding","created":"2024-08-29","cited_by_count":217},{"id":"2405.09711","title":"STAR: A Benchmark for Situated Reasoning in Real-World Videos","created":"2024-05-15","cited_by_count":213},{"id":"2403.11703","title":"LLaVA-UHD: an LMM Perceiving Any Aspect Ratio and High-Resolution Images","created":"2024-03-18","cited_by_count":195},{"id":"2407.03320","title":"InternLM-XComposer-2.5: A Versatile Large Vision Language Model Supporting Long-Contextual Input and Output","created":"2024-07-03","cited_by_count":195},{"id":"2404.05719","title":"Ferret-UI: Grounded Mobile UI Understanding with Multimodal LLMs","created":"2024-04-08","cited_by_count":176},{"id":"2408.12637","title":"Building and better understanding vision-language models: insights and future directions","created":"2024-08-22","cited_by_count":173},{"id":"2407.02392","title":"TokenPacker: Efficient Visual Projector for Multimodal LLM","created":"2024-07-02","cited_by_count":172},{"id":"2307.05222","title":"Emu: Generative Pretraining in Multimodality","created":"2023-07-11","cited_by_count":157},{"id":"2403.03163","title":"Design2Code: Benchmarking Multimodal Code Generation for Automated Front-End Engineering","created":"2024-03-05","cited_by_count":152},{"id":"2402.14830","title":"Orca-Math: Unlocking the potential of SLMs in Grade School Math","created":"2024-02-16","cited_by_count":151},{"id":"2403.00231","title":"Multimodal ArXiv: A Dataset for Improving Scientific Comprehension of Large Vision-Language Models","created":"2024-03-01","cited_by_count":139},{"id":"2403.09029","title":"Unlocking the conversion of Web Screenshots into HTML Code with the WebSight Dataset","created":"2024-03-14","cited_by_count":129},{"id":"2407.15841","title":"SlowFast-LLaVA: A Strong Training-Free Baseline for Video Large Language Models","created":"2024-07-22","cited_by_count":125},{"id":"2108.06712","title":"HiTab: A Hierarchical Table Dataset for Question Answering and Natural Language Generation","created":"2021-08-15","cited_by_count":118},{"id":"1808.10584","title":"Learning to Describe Differences Between Pairs of Similar Images","created":"2018-08-31","cited_by_count":114},{"id":"2312.12241","title":"GeomVerse: A Systematic Evaluation of Large Models for Geometric Reasoning","created":"2023-12-19","cited_by_count":108},{"id":"2305.18279","title":"Contextual Object Detection with Multimodal Large Language Models","created":"2023-05-29","cited_by_count":100},{"id":"2403.18406","title":"An Image Grid Can Be Worth a Video: Zero-shot Video Question Answering Using a VLM","created":"2024-03-27","cited_by_count":97},{"id":"2404.07973","title":"Ferret-v2: An Improved Baseline for Referring and Grounding with Large Language Models","created":"2024-04-11","cited_by_count":97},{"id":"2402.16641","title":"Towards Open-ended Visual Quality Comparison","created":"2024-02-26","cited_by_count":85},{"id":"2405.17430","title":"Matryoshka Multimodal Models","created":"2024-05-27","cited_by_count":84},{"id":"2310.00367","title":"AutomaTikZ: Text-Guided Synthesis of Scientific Vector Graphics with TikZ","created":"2023-09-30","cited_by_count":79},{"id":"2010.09142","title":"Chart-to-Text: Generating Natural Language Descriptions for Charts by Adapting the Transformer Model","created":"2020-10-18","cited_by_count":78},{"id":"2406.08487","title":"Beyond LLaVA-HD: Diving into High-Resolution Large Multimodal Models","created":"2024-06-12","cited_by_count":76},{"id":"2406.04334","title":"DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effective for LMMs","created":"2024-06-06","cited_by_count":75},{"id":"2404.17176","title":"MovieChat+: Question-aware Sparse Memory for Long Video Question Answering","created":"2024-04-26","cited_by_count":73},{"id":"2209.08199","title":"ScreenQA: Large-Scale Question-Answer Pairs over Mobile App Screenshots","created":"2022-09-16","cited_by_count":66},{"id":"2404.12803","title":"TextSquare: Scaling up Text-Centric Visual Instruction Tuning","created":"2024-04-19","cited_by_count":62},{"id":"2406.08418","title":"OmniCorpus: A Unified Multimodal Corpus of 10 Billion-Level Images Interleaved with Text","created":"2024-06-12","cited_by_count":59},{"id":"1909.04101","title":"Neural Naturalist: Generating Fine-Grained Image Comparisons","created":"2019-09-09","cited_by_count":36},{"id":"2403.13164","title":"VL-ICL Bench: The Devil in the Details of Multimodal In-Context Learning","created":"2024-03-19","cited_by_count":36},{"id":"2405.15738","title":"ConvLLaVA: Hierarchical Backbones as Visual Encoder for Large Multimodal Models","created":"2024-05-24","cited_by_count":26},{"id":"2408.02034","title":"Mini-Monkey: Alleviating the Semantic Sawtooth Effect for Lightweight MLLMs via Complementary Image Pyramid","created":"2024-08-04","cited_by_count":26},{"id":"2407.17453","title":"VILA$^2$: VILA Augmented VILA","created":"2024-07-24","cited_by_count":25},{"id":"2407.21075","title":"Apple Intelligence Foundation Language Models","created":"2024-07-29","cited_by_count":24},{"id":"2404.01331","title":"LLaVA-Gemma: Accelerating Multimodal Foundation Models with a Compact Language Model","created":"2024-03-29","cited_by_count":14},{"id":"2406.00977","title":"Dragonfly: Multi-Resolution Zoom-In Encoding Enhances Vision-Language Models","created":"2024-06-03","cited_by_count":8},{"id":"2402.07116","title":"Q-Bench+: A Benchmark for Multi-modal Foundation Models on Low-level Vision from Single Images to Pairs","created":"2024-02-11","cited_by_count":7}],"next_cursor":null}