[공지사항]을 빙자한 안부와 근황

Show more

Daily Arxiv

전 세계에서 발간되는 인공지능 관련 논문을 정리하는 페이지 입니다.
본 페이지는 Google Gemini를 활용해 요약 정리하며, 비영리로 운영 됩니다.
논문에 대한 저작권은 저자 및 해당 기관에 있으며, 공유 시 출처만 명기하면 됩니다.

SystolicAttention: Fusing FlashAttention within a Single Systolic Array

Automated Novelty Evaluation of Academic Paper: A Collaborative Approach Integrating Human and Large Language Model Knowledge

"Is it always watching? Is it always listening?" Exploring Contextual Privacy and Security Concerns Toward Domestic Social Robots

A Group Theoretic Analysis of the Symmetries Underlying Base Addition and Their Learnability by Neural Networks

GHPO: Adaptive Guidance for Stable and Efficient LLM Reinforcement Learning

Extension OL-MDISF: Online Learning from Mix-Typed, Drifted, and Incomplete Streaming Features

When and Where do Data Poisons Attack Textual Inversion?

Truth Sleuth and Trend Bender: AI Agents to fact-check YouTube videos and influence opinions

NLP Meets the World: Toward Improving Conversations With the Public About Natural Language Processing Research

Accurate generation of chemical reaction transition states by conditional flow matching

Benchmarking and Evaluation of AI Models in Biology: Outcomes and Recommendations from the CZI Virtual Cells Workshop

A PBN-RL-XAI Framework for Discovering a "Hit-and-Run" Therapeutic Strategy in Melanoma

NeuTSFlow: Modeling Continuous Functions Behind Time Series Forecasting

THOR: Transformer Heuristics for On-Demand Retrieval

Towards Agentic RAG with Deep Reasoning: A Survey of RAG-Reasoning Systems in LLMs

Bridging Literature and the Universe Via A Multi-Agent Large Language Model System

Magneto-radiative modelling and artificial neural network optimization of biofluid flow in a stenosed arterial domain

Symbiosis: Multi-Adapter Inference and Fine-Tuning

Rethinking Data Protection in the (Generative) Artificial Intelligence Era

SoK: Semantic Privacy in Large Language Models

FedRef: Communication-Efficient Bayesian Fine Tuning with Reference Model

Predictable Scale: Part II, Farseer: A Refined Scaling Law in Large Language Models

Position Prediction Self-Supervised Learning for Multimodal Satellite Imagery Semantic Segmentation

ScaleRTL: Scaling LLMs with Reasoning Data and Test-Time Compute for Accurate RTL Code Generation

HueManity: Probing Fine-Grained Visual Perception in MLLMs

AKReF: An argumentative knowledge representation framework for structured argumentation

Large Language Models Often Know When They Are Being Evaluated

Dynamic Risk Assessments for Offensive Cybersecurity Agents

How Hungry is AI? Benchmarking Energy, Water, and Carbon Footprint of LLM Inference

Diffused Responsibility: Analyzing the Energy Consumption of Generative Text-to-Audio Diffusion Models

Flow-GRPO: Training Flow Matching Models via Online RL

On the Need for a Statistical Foundation in Scenario-Based Testing of Autonomous Vehicles

What's Pulling the Strings? Evaluating Integrity and Attribution in AI Training and Inference through Concept Shift

TD-EVAL: Revisiting Task-Oriented Dialogue Evaluation by Combining Turn-Level Precision with Dialogue-Level Comparisons

MobileCity: An Efficient Framework for Large-Scale Urban Behavior Simulation

Semantic Adapter for Universal Text Embeddings: Diagnosing and Mitigating Negation Blindness to Enhance Universality

Leveraging LLMs for User Stories in AI Systems: UStAI Dataset

Large Language Models are Unreliable for Cyber Threat Intelligence

AnnoPage Dataset: Dataset of Non-Textual Elements in Documents with Fine-Grained Categorization

A Thorough Assessment of the Non-IID Data Impact in Federated Learning

Visual Position Prompt for MLLM based Visual Grounding

Neurons: Emulating the Human Visual Cortex Improves Fidelity and Interpretability in fMRI-to-Video Reconstruction

FADE: Why Bad Descriptions Happen to Good Features

FlipConcept: Tuning-Free Multi-Concept Personalization for Text-to-Image Generation

LUMINA-Net: Low-light Upgrade through Multi-stage Illumination and Noise Adaptation Network for Image Enhancement

Towards Geo-Culturally Grounded LLM Generations

Learning to Reason at the Frontier of Learnability

Flexible and Efficient Grammar-Constrained Decoding

PATCH: a deep learning method to assess heterogeneity of artistic practice in historical paintings

The Impact of Modern AI in Metadata Management

Learning an Effective Premise Retrieval Model for Efficient Mathematical Formalization

ChipAlign: Instruction Alignment in Large Language Models for Chip Design via Geodesic Interpolation

Many Objective Problems Where Crossover is Provably Essential

Patherea: Cell Detection and Classification for the 2020s

ViTally Consistent: Scaling Biological Representation Learning for Cell Microscopy

TextDestroyer: A Training- and Annotation-Free Diffusion Method for Destroying Anomal Text from Images

Quantifying calibration error in modern neural networks through evidence based theory

Multi-view biomedical foundation models for molecule-target and property prediction

Reinforced Imitative Trajectory Planning for Urban Automated Driving

Distilling Invariant Representations with Dual Augmentation

Tackling the Abstraction and Reasoning Corpus with Vision Transformers: the Importance of 2D Representation, Positions, and Objects

Linearly-Interpretable Concept Embedding Models for Text Analysis

Towards Understanding Link Predictor Generalizability Under Distribution Shifts

StreakNet-Arch: An Anti-scattering Network-based Architecture for Underwater Carrier LiDAR-Radar Imaging

Enhancing Trust in Autonomous Agents: An Architecture for Accountability and Explainability through Blockchain and Large Language Models

On the Statistical Properties of Generative Adversarial Models for Low Intrinsic Data Dimension

Programming Distributed Collective Processes in the eXchange Calculus

Holistic analysis on the sustainability of Federated Learning across AI product lifecycle

Mathematical Introduction to Deep Learning: Methods, Implementations, and Theory

Epic-Sounds: A Large-scale Dataset of Actions That Sound

From Semantic Web and MAS to Agentic AI: A Unified Narrative of the Web of Agents

On Gradual Semantics for Assumption-Based Argumentation

The Challenge of Teaching Reasoning to LLMs Without RL or Distillation

Continuous Classification Aggregation

Can Prompt Difficulty be Online Predicted for Accelerating RL Finetuning of Reasoning Models?

macOSWorld: A Multilingual Interactive Benchmark for GUI Agents

GeoChain: Multimodal Chain-of-Thought for Geographic Reasoning

Lost in Transmission: When and Why LLMs Fail to Reason Globally

A Survey of Frontiers in LLM Reasoning: Inference Scaling, Learning to Reason, and Agentic Systems

System 0/1/2/3: Quad-process theory for multi-timescale embodied collective cognitive systems

Practical Principles for AI Cost and Compute Accounting

Generative Emergent Communication: Large Language Model is a Collective World Model

Proactive Agents for Multi-Turn Text-to-Image Generation Under Uncertainty

Learning Lifted STRIPS Models from Action Traces Alone: A Simple, General, and Scalable Solution

Hallucination Detox: Sensitivity Dropout (SenD) for Large Language Model Training

Life, uh, Finds a Way: Hyperadaptability by Behavioral Search

Governance of Generative Artificial Intelligence for Companies

RACER: Rational Artificial Intelligence Car-following-model Enhanced by Reality

Artificial Intelligence Governance for Businesses

Interpreting Radiologist's Intention from Eye Movements in Chest X-ray Diagnosis

S2WTM: Spherical Sliced-Wasserstein Autoencoder for Topic Modeling

LLM-Based Config Synthesis requires Disambiguation

Characterizing State Space Model (SSM) and SSM-Transformer Hybrid Language Model Performance with Long Context Length

EgoVLA: Learning Vision-Language-Action Models from Egocentric Human Videos

Can We Predict Alignment Before Models Finish Thinking? Towards Monitoring Misaligned Reasoning Models

Unit-Based Histopathology Tissue Segmentation via Multi-Level Feature Representation

Advancing Retrieval-Augmented Generation for Structured Enterprise and Internal Data

Mixture of Raytraced Experts

QuRe: Query-Relevant Retrieval through Hard Negative Sampling in Composed Image Retrieval

AutoVDC: Automated Vision Data Cleaning Using Vision-Language Models

TD-EVAL: Revisiting Task-Oriented Dialogue Evaluation by Combining Turn-Level Precision with Dialogue-Level Comparisons

Created by

Haebom

저자

Emre Can Acikgoz, Carl Guo, Suvodip Dey, Akul Datta, Takyoung Kim, Gokhan Tur, Dilek Hakkani-Tur

개요

본 논문은 대규모 언어 모델(LLM) 기반의 작업 지향 대화(TOD) 시스템 평가 방법론의 한계를 지적하고, 회전(turn) 수준과 대화 수준 모두를 평가하는 새로운 평가 프레임워크인 TD-EVAL을 제안한다. TD-EVAL은 회전 수준에서는 대화 응집성, 백엔드 지식 일관성, 정책 준수 등 세 가지 차원을 평가하고, 대화 수준에서는 쌍대 비교를 통해 대화 품질을 측정하는 TOD Agent Arena를 사용한다. MultiWOZ 2.4와 τ-Bench 데이터셋을 사용한 실험 결과, TD-EVAL은 기존 지표가 놓치는 대화 오류를 효과적으로 식별하고, 인간 판단과의 일치도가 더 높음을 보여준다. 따라서 TD-EVAL은 향후 TOD 시스템 평가를 위한 새로운 패러다임을 제시한다.

시사점, 한계점

•

시사점:

◦

기존 자동 평가 지표의 한계를 극복하는 새로운 TOD 시스템 평가 프레임워크(TD-EVAL) 제시

◦

회전 수준과 대화 수준의 분석을 통합하여 보다 정교한 평가 가능

◦

인간 판단과의 높은 일치도를 통해 평가의 신뢰성 향상

◦

플러그 앤 플레이 방식으로 향후 연구에 쉽게 적용 가능

•

한계점:

◦

TD-EVAL의 세 가지 회전 수준 평가 차원(대화 응집성, 백엔드 지식 일관성, 정책 준수)이 모든 TOD 시스템에 적용 가능한지에 대한 추가 연구 필요

◦

TOD Agent Arena의 쌍대 비교 방식의 효율성 및 확장성에 대한 추가적인 검증 필요

◦

특정 데이터셋에 대한 성능 평가 결과이므로, 다른 데이터셋이나 다양한 TOD 시스템에 대한 일반화 가능성 검증 필요

Made with Slashpage