{"list":"other","total":127,"rows":[{"id":"2005.14165","title":"Language Models are Few-Shot Learners","created":"2020-05-28","cited_by_count":32419},{"id":"2304.08485","title":"Visual Instruction Tuning","created":"2023-04-17","cited_by_count":7869},{"id":"2301.12597","title":"BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models","created":"2023-01-30","cited_by_count":6137},{"id":"2212.10560","title":"Self-Instruct: Aligning Language Models with Self-Generated Instructions","created":"2022-12-20","cited_by_count":2724},{"id":"2304.10592","title":"MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Models","created":"2023-04-20","cited_by_count":2711},{"id":"2303.18223","title":"A Survey of Large Language Models","created":"2023-03-31","cited_by_count":2576},{"id":"2308.12966","title":"Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyond","created":"2023-08-24","cited_by_count":2224},{"id":"2209.09513","title":"Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering","created":"2022-09-20","cited_by_count":1919},{"id":"2404.14219","title":"Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone","created":"2024-04-22","cited_by_count":1917},{"id":"2307.02483","title":"Jailbroken: How Does LLM Safety Training Fail?","created":"2023-07-05","cited_by_count":1651},{"id":"2310.02255","title":"MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts","created":"2023-10-03","cited_by_count":1614},{"id":"2203.10244","title":"ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoning","created":"2022-03-19","cited_by_count":1479},{"id":"2405.21075","title":"Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis","created":"2024-05-31","cited_by_count":1413},{"id":"2306.00890","title":"LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Day","created":"2023-06-01","cited_by_count":1305},{"id":"2404.07972","title":"OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments","created":"2024-04-11","cited_by_count":1195},{"id":"2402.14008","title":"OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problems","created":"2024-02-21","cited_by_count":1136},{"id":"2305.17926","title":"Large Language Models are not Fair Evaluators","created":"2023-05-29","cited_by_count":1085},{"id":"2403.20330","title":"Are We on the Right Way for Evaluating Large Vision-Language Models?","created":"2024-03-29","cited_by_count":914},{"id":"2312.11805","title":"Gemini: A Family of Highly Capable Multimodal Models","created":"2023-12-19","cited_by_count":872},{"id":"2311.03079","title":"CogVLM: Visual Expert for Pretrained Language Models","created":"2023-11-06","cited_by_count":708},{"id":"2304.03277","title":"Instruction Tuning with GPT-4","created":"2023-04-06","cited_by_count":686},{"id":"2308.09126","title":"EgoSchema: A Diagnostic Benchmark for Very Long-form Video Language Understanding","created":"2023-08-17","cited_by_count":680},{"id":"2311.07919","title":"Qwen-Audio: Advancing Universal Audio Understanding via Unified Large-Scale Audio-Language Models","created":"2023-11-14","cited_by_count":608},{"id":"2403.14624","title":"MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?","created":"2024-03-21","cited_by_count":586},{"id":"2312.14150","title":"DriveLM: Driving with Graph Visual Question Answering","created":"2023-12-21","cited_by_count":536},{"id":"2402.14804","title":"Measuring Multimodal Mathematical Reasoning with MATH-Vision Dataset","created":"2024-02-22","cited_by_count":526},{"id":"2409.02813","title":"MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmark","created":"2024-09-04","cited_by_count":512},{"id":"2310.07704","title":"Ferret: Refer and Ground Anything Anywhere at Any Granularity","created":"2023-10-11","cited_by_count":509},{"id":"2402.12289","title":"DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Models","created":"2024-02-19","cited_by_count":490},{"id":"2305.07895","title":"OCRBench: On the Hidden Mystery of OCR in Large Multimodal Models","created":"2023-05-13","cited_by_count":476},{"id":"2003.10286","title":"PathVQA: 30000+ Questions for Medical Visual Question Answering","created":"2020-03-07","cited_by_count":475},{"id":"2405.14573","title":"AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agents","created":"2024-05-23","cited_by_count":468},{"id":"1811.00491","title":"A Corpus for Reasoning About Natural Language Grounded in Photographs","created":"2018-11-01","cited_by_count":459},{"id":"2407.11691","title":"VLMEvalKit: An Open-Source Toolkit for Evaluating Large Multi-Modality Models","created":"2024-07-16","cited_by_count":455},{"id":"2306.14565","title":"Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuning","created":"2023-06-26","cited_by_count":445},{"id":"2312.13771","title":"AppAgent: Multimodal Agents as Smartphone Users","created":"2023-12-21","cited_by_count":415},{"id":"2312.00849","title":"RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedback","created":"2023-12-01","cited_by_count":412},{"id":"2406.08035","title":"LVBench: An Extreme Long Video Understanding Benchmark","created":"2024-06-12","cited_by_count":410},{"id":"2403.00476","title":"TempCompass: Do Video LLMs Really Understand Videos?","created":"2024-03-01","cited_by_count":363},{"id":"2304.09842","title":"Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models","created":"2023-04-19","cited_by_count":356},{"id":"2305.10415","title":"PMC-VQA: Visual Instruction Tuning for Medical Visual Question Answering","created":"2023-05-17","cited_by_count":338},{"id":"1710.07300","title":"FigureQA: An Annotated Figure Dataset for Visual Reasoning","created":"2017-10-19","cited_by_count":319},{"id":"2210.07474","title":"SQA3D: Situated Question Answering in 3D Scenes","created":"2022-10-14","cited_by_count":314},{"id":"2311.07397","title":"AMBER: An LLM-free Multi-dimensional Benchmark for MLLMs Hallucination Evaluation","created":"2023-11-13","cited_by_count":300},{"id":"2401.16158","title":"Mobile-Agent: Autonomous Multi-Modal Mobile Device Agent with Visual Perception","created":"2024-01-29","cited_by_count":293},{"id":"2406.04264","title":"MLVU: Benchmarking Multi-task Long Video Understanding","created":"2024-06-06","cited_by_count":292},{"id":"2407.01284","title":"We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning?","created":"2024-07-01","cited_by_count":286},{"id":"2305.16934","title":"On Evaluating Adversarial Robustness of Large Vision-Language Models","created":"2023-05-26","cited_by_count":284},{"id":"2309.14181","title":"Q-Bench: A Benchmark for General-Purpose Foundation Models on Low-level Vision","created":"2023-09-25","cited_by_count":249},{"id":"2305.18752","title":"GPT4Tools: Teaching Large Language Model to Use Tools via Self-instruction","created":"2023-05-30","cited_by_count":248},{"id":"2406.18521","title":"CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs","created":"2024-06-26","cited_by_count":234},{"id":"2310.16045","title":"Woodpecker: Hallucination Correction for Multimodal Large Language Models","created":"2023-10-24","cited_by_count":226},{"id":"2307.15266","title":"RSGPT: A Remote Sensing Vision Language Model and Benchmark","created":"2023-07-28","cited_by_count":207},{"id":"2305.17100","title":"BiomedGPT: A Generalist Vision-Language Foundation Model for Diverse Biomedical Tasks","created":"2023-05-26","cited_by_count":201},{"id":"2407.01523","title":"MMLongBench-Doc: Benchmarking Long-context Document Understanding with Visualizations","created":"2024-07-01","cited_by_count":183},{"id":"2406.14515","title":"MMBench-Video: A Long-Form Multi-Shot Benchmark for Holistic Video Understanding","created":"2024-06-20","cited_by_count":182},{"id":"2308.02463","title":"Towards Generalist Foundation Model for Radiology by Leveraging Web-scale 2D&3D Medical Data","created":"2023-08-04","cited_by_count":179},{"id":"2404.05719","title":"Ferret-UI: Grounded Mobile UI Understanding with Multimodal LLMs","created":"2024-04-08","cited_by_count":176},{"id":"2306.06687","title":"LAMM: Language-Assisted Multi-Modal Instruction-Tuning Dataset, Framework, and Benchmark","created":"2023-06-11","cited_by_count":169},{"id":"2311.17842","title":"Look Before You Leap: Unveiling the Power of GPT-4V in Robotic Vision-Language Planning","created":"2023-11-29","cited_by_count":161},{"id":"2009.09941","title":"PP-OCR: A Practical Ultra Lightweight OCR System","created":"2020-09-21","cited_by_count":151},{"id":"2312.14115","title":"LingoQA: Visual Question Answering for Autonomous Driving","created":"2023-12-21","cited_by_count":145},{"id":"1909.10838","title":"Talk2Car: Taking Control of Your Self-Driving Car","created":"2019-09-24","cited_by_count":142},{"id":"2311.03287","title":"Holistic Analysis of Hallucination in GPT-4V(ision): Bias and Interference Challenges","created":"2023-11-06","cited_by_count":131},{"id":"2406.09961","title":"ChartMimic: Evaluating LMM's Cross-Modal Reasoning Capability via Chart-to-Code Generation","created":"2024-06-14","cited_by_count":129},{"id":"2312.03661","title":"Reason2Drive: Towards Interpretable and Chain-based Reasoning for Autonomous Driving","created":"2023-12-06","cited_by_count":123},{"id":"2406.12384","title":"VRSBench: A Versatile Vision-Language Benchmark Dataset for Remote Sensing Image Understanding","created":"2024-06-18","cited_by_count":121},{"id":"2210.03929","title":"EgoTaskQA: Understanding Human Tasks in Egocentric Videos","created":"2022-10-08","cited_by_count":115},{"id":"2309.04379","title":"Language Prompt for Autonomous Driving","created":"2023-09-08","cited_by_count":111},{"id":"2306.05179","title":"M3Exam: A Multilingual, Multimodal, Multilevel Benchmark for Examining Large Language Models","created":"2023-06-08","cited_by_count":110},{"id":"2311.16101","title":"How Many Unicorns Are in This Image? A Safety Evaluation Benchmark for Vision LLMs","created":"2023-11-27","cited_by_count":108},{"id":"2101.09465","title":"WebSRC: A Dataset for Web-Based Structural Reading Comprehension","created":"2021-01-23","cited_by_count":100},{"id":"2308.15126","title":"Evaluation and Analysis of Hallucination in Large Vision-Language Models","created":"2023-08-29","cited_by_count":99},{"id":"2402.04615","title":"ScreenAI: A Vision-Language Model for UI and Infographics Understanding","created":"2024-02-07","cited_by_count":98},{"id":"2408.03361","title":"GMAI-MMBench: A Comprehensive Multimodal Evaluation Benchmark Towards General Medical AI","created":"2024-08-06","cited_by_count":96},{"id":"2010.04295","title":"Widget Captioning: Generating Natural Language Description for Mobile User Interface Elements","created":"2020-10-08","cited_by_count":95},{"id":"2405.11985","title":"MTVQA: Benchmarking Multilingual Text-Centric Visual Question Answering","created":"2024-05-20","cited_by_count":93},{"id":"2406.16338","title":"VideoHallucer: Evaluating Intrinsic and Extrinsic Hallucinations in Large Video-Language Models","created":"2024-06-24","cited_by_count":90},{"id":"2311.05332","title":"On the Road with GPT-4V(ision): Early Explorations of Visual-Language Model on Autonomous Driving","created":"2023-11-09","cited_by_count":80},{"id":"2311.12015","title":"GPT-4V(ision) for Robotics: Multimodal Task Planning from Human Demonstration","created":"2023-11-20","cited_by_count":77},{"id":"2406.11069","title":"WildVision: Evaluating Vision-Language Models in the Wild with Human Preferences","created":"2024-06-16","cited_by_count":76},{"id":"2402.03190","title":"Unified Hallucination Detection for Multimodal Large Language Models","created":"2024-02-05","cited_by_count":75},{"id":"2406.20098","title":"Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMs","created":"2024-06-28","cited_by_count":74},{"id":"2406.01326","title":"TabPedia: Towards Comprehensive Visual Table Understanding with Concept Synergy","created":"2024-06-03","cited_by_count":71},{"id":"2402.14683","title":"Visual Hallucinations of Multi-modal Large Language Models","created":"2024-02-22","cited_by_count":68},{"id":"2312.07472","title":"MP5: A Multi-modal Open-ended Embodied System in Minecraft via Active Perception","created":"2023-12-12","cited_by_count":67},{"id":"2209.08199","title":"ScreenQA: Large-Scale Question-Answer Pairs over Mobile App Screenshots","created":"2022-09-16","cited_by_count":66},{"id":"2406.12742","title":"Benchmarking Multi-Image Understanding in Vision and Language Models: Perception, Knowledge, Reasoning, and Multi-Hop Reasoning","created":"2024-06-18","cited_by_count":54},{"id":"2406.07057","title":"MultiTrust: A Comprehensive Benchmark Towards Trustworthy Multimodal Large Language Models","created":"2024-06-11","cited_by_count":53},{"id":"2406.16866","title":"Revisiting Referring Expression Comprehension Evaluation in the Era of Large Multimodal Models","created":"2024-06-24","cited_by_count":53},{"id":"2401.13649","title":"VisualWebArena: Evaluating Multimodal Agents on Realistic Visual Web Tasks","created":"2024-01-24","cited_by_count":47},{"id":"2407.01525","title":"ScanReason: Empowering 3D Visual Grounding with Reasoning Capabilities","created":"2024-07-01","cited_by_count":47},{"id":"2310.16809","title":"Exploring OCR Capabilities of GPT-4V(ision) : A Quantitative and In-depth Evaluation","created":"2023-10-25","cited_by_count":46},{"id":"2403.11116","title":"PhD: A ChatGPT-Prompted Visual hallucination Evaluation Dataset","created":"2024-03-17","cited_by_count":45},{"id":"2403.17918","title":"AgentStudio: A Toolkit for Building General Virtual Agents","created":"2024-03-26","cited_by_count":45},{"id":"2406.08702","title":"VLind-Bench: Measuring Language Priors in Large Vision-Language Models","created":"2024-06-13","cited_by_count":45},{"id":"2108.06543","title":"MMOCR: A Comprehensive Toolbox for Text Detection, Recognition and Understanding","created":"2021-08-14","cited_by_count":40},{"id":"2404.10335","title":"Efficient Generation of Targeted and Transferable Adversarial Examples for Vision-Language Models Via Diffusion Models","created":"2024-04-16","cited_by_count":38},{"id":"2406.09367","title":"Needle In A Video Haystack: A Scalable Synthetic Evaluator for Video MLLMs","created":"2024-06-13","cited_by_count":37},{"id":"2404.13306","title":"FakeBench: Probing Explainable Fake Image Detection via Large Multimodal Models","created":"2024-04-20","cited_by_count":36}],"next_cursor":"100"}