Daily Arxiv

전 세계에서 발간되는 인공지능 관련 논문을 정리하는 페이지 입니다.
본 페이지는 Google Gemini를 활용해 요약 정리하며, 비영리로 운영 됩니다.
논문에 대한 저작권은 저자 및 해당 기관에 있으며, 공유 시 출처만 명기하면 됩니다.

Defining and Quantifying Creative Behavior in Popular Image Generators

TS-SNN: Temporal Shift Module for Spiking Neural Networks

IntelliCardiac: An Intelligent Platform for Cardiac Image Segmentation and Classification

AI-Powered Agile Analog Circuit Design and Optimization

Demonstrating ViSafe: Vision-enabled Safety for High-speed Detect and Avoid

Motion-compensated cardiac MRI using low-rank diffeomorphic flow (DMoCo)

RADLADS: Rapid Attention Distillation to Linear Attention Decoders at Scale

T2S: High-resolution Time Series Generation with Text-to-Series Diffusion Models

Optimizing LLMs for Resource-Constrained Environments: A Survey of Model Compression Techniques

Humans can learn to detect AI-generated texts, or at least learn when they can't

Large Language Models Understanding: an Inherent Ambiguity Barrier

Data Therapist: Eliciting Domain Knowledge from Subject Matter Experts Using Large Language Models

SeriesBench: A Benchmark for Narrative-Driven Drama Series Understanding

Nexus-Gen: A Unified Model for Image Understanding, Generation, and Editing

PINN-MEP: Continuous Neural Representations for Minimum-Energy Path Discovery in Molecular Systems

Building Trustworthy Multimodal AI: A Review of Fairness, Transparency, and Ethics in Vision-Language Tasks

GeoUni: A Unified Model for Generating Geometry Diagrams, Problems and Problem Solutions

A highly maneuverable flying squirrel drone with agility-improving foldable wings

VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning

FindAnything: Open-Vocabulary and Object-Centric Mapping for Robot Exploration in Any Environment

Perils of Label Indeterminacy: A Case Study on Prediction of Neurological Recovery After Cardiac Arrest

CodeIF-Bench: Evaluating Instruction-Following Capabilities of Large Language Models in Interactive Code Generation

Novel Deep Neural OFDM Receiver Architectures for LLR Estimation

NaFM: Pre-training a Foundation Model for Small-Molecule Natural Products

Benchmarking Open-Source Large Language Models on Healthcare Text Classification Tasks

Atyaephyra at SemEval-2025 Task 4: Low-Rank Negative Preference Optimization

Integrating AI for Human-Centric Breast Cancer Diagnostics: A Multi-Scale and Multi-View Swin Transformer Framework

Negotiative Alignment: Embracing Disagreement to Achieve Fairer Outcomes -- Insights from Urban Studies

Large Language Models for Outpatient Referral: Problem Definition, Benchmarking and Challenges

Semantic Shift Estimation via Dual-Projection and Classifier Reconstruction for Exemplar-Free Class-Incremental Learning

LIVS: A Pluralistic Alignment Dataset for Inclusive Public Spaces

Faster, Cheaper, Better: Multi-Objective Hyperparameter Optimization for LLM and RAG Systems

FLARE: A Framework for Stellar Flare Forecasting using Stellar Physical Properties and Historical Records

TLOB: A Novel Transformer Model with Dual Attention for Price Trend Prediction with Limit Order Book Data

Correcting Noisy Multilabel Predictions: Modeling Label Noise through Latent Space Shifts

Safety Evaluation of DeepSeek Models in Chinese Contexts

DejAIvu: Identifying and Explaining AI Art on the Web in Real-Time with Saliency Maps

Texture Image Synthesis Using Spatial GAN Based on Vision Transformers

Toward Task Generalization via Memory Augmentation in Meta-Reinforcement Learning

The Right to AI

Communicating Activations Between Language Model Agents

Guaranteed Recovery of Unambiguous Clusters

ValuesRAG: Enhancing Cultural Alignment Through Retrieval-Augmented Contextual Learning

Vision Transformers for Efficient Indoor Pathloss Radio Map Prediction

Quantifying Risk Propensities of Large Language Models: Ethical Focus and Bias Detection through Role-Play

E2E-AFG: An End-to-End Model with Adaptive Filtering for Retrieval-Augmented Generation

Jailbreaking and Mitigation of Vulnerabilities in Large Language Models

WorldCuisines: A Massive-Scale Benchmark for Multilingual and Multicultural Visual Question Answering on Global Cuisines

CATCH: Channel-Aware multivariate Time Series Anomaly Detection via Frequency Patching

Learning to Compare Hardware Designs for High-Level Synthesis

To CoT or not to CoT? Chain-of-thought helps mainly on math and symbolic reasoning

Automated detection of underdiagnosed medical conditions via opportunistic imaging

Exploring the Trade-Offs: Quantization Methods, Task Difficulty, and Model Size in Large Language Models From Edge to Giant

On Synthetic Texture Datasets: Challenges, Creation, and Curation

Lexicon3D: Probing Visual Foundation Models for Complex 3D Scene Understanding

XG-NID: Dual-Modality Network Intrusion Detection using a Heterogeneous Graph Neural Network and Large Language Model

Recite, Reconstruct, Recollect: Memorization in LMs as a Multifaceted Phenomenon

Enhancing Differential Testing With LLMs For Testing Deep Learning Libraries

HORAE: A Domain-Agnostic Language for Automated Service Regulation

DEGAP: Dual Event-Guided Adaptive Prefixes for Templated-Based Event Argument Extraction with Slot Querying

Analyzing Consumer IoT Traffic from Security and Privacy Perspectives: a Comprehensive Survey

DyCE: Dynamically Configurable Exiting for Deep Learning Compression and Real-time Scaling

The Inadequacy of Similarity-based Privacy Metrics: Privacy Attacks against "Truly Anonymous" Synthetic Datasets

Connecting NTK and NNGP: A Unified Theoretical Framework for Wide Neural Network Learning Dynamics

An automated end-to-end deep learning-based framework for lung cancer diagnosis by detecting and classifying the lung nodules

Label-Efficient Deep Learning in Medical Image Analysis: Challenges and Future Directions

Transformer-based assignment decision network for multiple object tracking

An alignment safety case sketch based on debate

The Power of Stories: Narrative Priming Shapes How LLM Agents Collaborate and Compete

A Survey of Slow Thinking-based Reasoning LLMs using Reinforced Learning and Inference-time Scaling Law

Agentic Neurodivergence as a Contingent Solution to the AI Alignment Problem

Theoretical Foundations for Semantic Cognition in Artificial Intelligence

Approximate Lifted Model Construction

MultiMind: Enhancing Werewolf Agents with Multimodal Reasoning and Theory of Mind

Advancing Embodied Agent Security: From Safety Benchmarks to Input Moderation

Do We Truly Need So Many Samples? Multi-LLM Repeated Sampling Efficiently Scales Test-Time Compute

Recursive Inference Scaling: A Winning Path to Scalable Inference in Language and Multimodal Systems

Generating Symbolic World Models via Test-time Scaling of Large Language Models

Imagining and building wise machines: The centrality of AI metacognition

Public Perceptions of Fairness Metrics Across Borders

Combating Confirmation Bias: A Unified Pseudo-Labeling Framework for Entity Alignment

Flow-GRPO: Training Flow Matching Models via Online RL

StreamBridge: Turning Your Offline Video Large Language Model into a Proactive Streaming Assistant

ComPO: Preference Alignment via Comparison Oracles

TransProQA: an LLM-based literary Translation evaluation metric with Professional Question Answering

TokLIP: Marry Visual Tokens to CLIP for Multimodal Comprehension and Generation

Reasoning Models Don't Always Say What They Think

Crosslingual Reasoning through Test-Time Scaling

CART-ELC: Oblique Decision Tree Induction via Exhaustive Search

Threshold Modulation for Online Test-Time Adaptation of Spiking Neural Networks

Time of the Flight of the Gaussians: Optimizing Depth Indirectly in Dynamic Radiance Fields

High-fidelity Grain Growth Modeling: Leveraging Deep Learning for Fast Computations

Feature-Augmented Deep Networks for Multiscale Building Segmentation in High-Resolution UAV and Satellite Imagery

Mapping User Trust in Vision Language Models: Research Landscape, Challenges, and Prospects

Scalable Chain of Thoughts via Elastic Reasoning

Benchmarking Ophthalmology Foundation Models for Clinically Significant Age Macular Degeneration Detection

PlaceIt3D: Language-Guided Object Placement in Real 3D Scenes

Software Development Life Cycle Perspective: A Survey of Benchmarks for CodeLLMs and Agents

T-T: Table Transformer for Tagging-based Aspect Sentiment Triplet Extraction

Enhancing Cooperative Multi-Agent Reinforcement Learning with State Modelling and Adversarial Exploration

Software Development Life Cycle Perspective: A Survey of Benchmarks for CodeLLMs and Agents

Created by

Haebom

저자

Kaixin Wang, Tianlin Li, Xiaoyu Zhang, Chong Wang, Weisong Sun, Yang Liu, Bin Shi

개요

본 논문은 CodeLLMs(Code Large Language Models)와 에이전트의 성능 평가를 위한 벤치마크에 대한 종합적인 검토를 제공합니다. 461편의 관련 논문에서 발췌한 181개의 벤치마크를 분석하여 소프트웨어 개발 생명주기(SDLC)의 다양한 단계를 살펴봅니다. 분석 결과, 현재 벤치마크의 약 60%가 소프트웨어 개발 단계에 집중되어 있으며, 요구사항 공학 및 소프트웨어 설계 단계는 각각 5%와 3%로 매우 적은 비중을 차지하고 있음을 밝힙니다. 또한, Python이 검토된 벤치마크에서 가장 많이 사용되는 프로그래밍 언어임을 확인했습니다. 마지막으로, 현재 연구의 과제를 강조하고 CodeLLMs와 에이전트의 이론적 역량과 실제 시나리오 적용 간의 격차를 줄이기 위한 미래 방향을 제시합니다.

시사점, 한계점

•

시사점: CodeLLMs 및 에이전트 벤치마크에 대한 종합적인 분석을 통해 SDLC 단계별 벤치마크의 불균형을 밝히고, 향후 연구 방향을 제시함으로써 CodeLLMs 및 에이전트의 실제 적용 가능성을 높이는 데 기여합니다. Python이 주요 언어로 사용됨을 확인하여 향후 연구 및 개발 방향 설정에 도움을 줍니다.

•

한계점: 현재 벤치마크들이 소프트웨어 개발 단계에 편중되어 있고, 요구사항 공학 및 소프트웨어 설계 단계에 대한 벤치마크가 부족하다는 점입니다. 이는 CodeLLMs 및 에이전트의 전 생명주기적 평가에 대한 한계를 시사합니다. 또한, 분석 대상이 된 벤치마크의 품질과 다양성에 따라 결과의 일반화 가능성에 제한이 있을 수 있습니다.

Made with Slashpage