Daily Arxiv

世界中で発行される人工知能関連の論文をまとめるページです。
このページはGoogle Geminiを活用して要約し、非営利で運営しています。
論文の著作権は著者および関連機関にあり、共有する際は出典を明記してください。

SACL: Understanding and Combating Textual Bias in Code Retrieval with Semantic-Augmented Reranking and Localization

Towards Provable (In)Secure Model Weight Release Schemes

Semantic Scene Graph for Ultrasound Image Explanation and Scanning Guidance

IndieFake Dataset: A Benchmark Dataset for Audio Deepfake Detection

These Are Not All the Features You Are Looking For: A Fundamental Bottleneck in Supervised Pretraining

In-Context Learning Strategies Emerge Rationally

Fake it till You Make it: Reward Modeling as Discriminative Prediction

Semantic Preprocessing for LLM-based Malware Analysis

PCDVQ: Enhancing Vector Quantization for Large Language Models via Polar Coordinate Decoupling

TracLLM: A Generic Framework for Attributing Long Context LLMs

TaxaDiffusion: Progressively Trained Diffusion Model for Fine-Grained Species Generation

Composite Flow Matching for Reinforcement Learning with Shifted-Dynamics Data

Explainability of Large Language Models using SMILE: Statistical Model-agnostic Interpretability with Local Explanations

Thinkless: LLM Learns When to Think

A3: an Analytical Low-Rank Approximation Framework for Attention

Search and Refine During Think: Autonomous Retrieval-Augmented Reasoning of LLMs

JointDiT: Enhancing RGB-Depth Joint Modeling with Diffusion Transformers

Energy Matching: Unifying Flow Matching and Energy-Based Models for Generative Modeling

AI-Driven Sentiment Analytics: Unlocking Business Value in the E-Commerce Landscape

Towards Adaptive Memory-Based Optimization for Enhanced Retrieval-Augmented Generation

AirCache: Activating Inter-modal Relevancy KV Cache Compression for Efficient Large Vision-Language Model Inference

Will LLMs be Professional at Fund Investment? DeepFund: A Live Arena Perspective

Revealing higher-order neural representations of uncertainty with the Noise Estimation through Reinforcement-based Diffusion (NERD) model

Zero-TIG: Temporal Consistency-Aware Zero-Shot Illumination-Guided Low-light Video Enhancement

PP-DocBee: Improving Multimodal Document Understanding Through a Bag of Tricks

CREStE: Scalable Mapless Navigation with Internet Scale Priors and Counterfactual Guidance

Markets with Heterogeneous Agents: Dynamics and Survival of Bayesian vs. No-Regret Learners

Reward-Guided Speculative Decoding for Efficient LLM Reasoning

UP-VLA: A Unified Understanding and Prediction Model for Embodied Agent

DisCoPatch: Taming Adversarially-driven Batch Statistics for Improved Out-of-Distribution Detection

Materialist: Physically Based Editing Using Single-Image Inverse Rendering

Representation Learning of Lab Values via Masked AutoEncoders

Lagrangian Index Policy for Restless Bandits with Average Reward

SIDA: Social Media Image Deepfake Detection, Localization and Explanation with Large Multimodal Model

InfiniCube: Unbounded and Controllable Dynamic 3D Driving Scene Generation with World-Guided Video Models

Pretrained Reversible Generation as Unsupervised Visual Representation Learning

MvKeTR: Chest CT Report Generation with Multi-View Perception and Knowledge Enhancement

GASP: Efficient Black-Box Generation of Adversarial Suffixes for Jailbreaking LLMs

ToolScan: A Benchmark for Characterizing Errors in Tool-Use LLMs

Recall and Refine: A Simple but Effective Source-free Open-set Domain Adaptation Framework

InterFormer: Effective Heterogeneous Interaction Learning for Click-Through Rate Prediction

Prompting with Phonemes: Enhancing LLMs' Multilinguality for Non-Latin Script Languages

Advanced computer vision for extracting georeferenced vehicle trajectories from drone imagery

Rapid Gyroscope Calibration: A Deep Learning Approach

HERMES: temporal-coHERent long-forM understanding with Episodes and Semantics

A GREAT Architecture for Edge-Based Graph Problems Like TSP

ClimateIQA: A New Dataset and Benchmark to Advance Vision-Language Models in Meteorology Anomalies Analysis

MockLLM: A Multi-Agent Behavior Collaboration Framework for Online Job Seeking and Recruiting

Is my Data in your AI Model? Membership Inference Test with Application to Face Images

PuriDefense: Randomized Local Implicit Adversarial Purification for Defending Black-box Query-based Attacks

Continual Learning as Computationally Constrained Reinforcement Learning

Efficient Image Generation with Variadic Attention Heads

Smart Ride and Delivery Services with Electric Vehicles: Leveraging Bidirectional Charging for Profit Optimisation

From Memories to Maps: Mechanisms of In-Context Reinforcement Learning in Transformers

Graphs Meet AI Agents: Taxonomy, Progress, and Future Opportunities

Taming the Untamed: Graph-Based Knowledge Retrieval and Reasoning for MLLMs to Conquer the Unknown

Exploring Big Five Personality and AI Capability Effects in LLM-Simulated Negotiation Dialogues

Doppelganger Method: Breaking Role Consistency in LLM Agent via Prompt-based Transferable Adversarial Attack

Metis-RISE: RL Incentivizes and SFT Enhances Multimodal Reasoning Model Learning

Fast Monte Carlo Tree Diffusion: 100x Speedup via Parallel Sparse Planning

NFISiS: New Perspectives on Fuzzy Inference Systems for Renewable Energy Forecasting

The State of Large Language Models for African Languages: Progress and Challenges

Structuring the Unstructured: A Multi-Agent System for Extracting and Querying Financial KPIs and Guidance

Super Co-alignment for Sustainable Symbiotic Society

Improving Human-AI Coordination through Online Adversarial Training and Generative Models

WiS Platform: Enhancing Evaluation of LLM-Based Multi-Agent Systems Through Game-Based Analysis

Review learning: Real world validation of privacy preserving continual learning across medical institutions

Whole-Body Conditioned Egocentric Video Prediction

MTSBench: Benchmarking Multivariate Time Series Anomaly Detection and Model Selection at Scale

HalluSegBench: Counterfactual Visual Reasoning for Segmentation Hallucination Evaluation

WorldVLA: Towards Autoregressive Action World Model

"What's Up, Doc?": Analyzing How Users Seek Health Information in Large-Scale Conversational AI Datasets

Potemkin Understanding in Large Language Models

SkLEP: A Slovak General Language Understanding Benchmark

Process mining-driven modeling and simulation to enhance fault diagnosis in cyber-physical systems

TITAN: Query-Token based Domain Adaptive Adversarial Learning

SmoothSinger: A Conditional Diffusion Model for Singing Voice Synthesis with Multi-Resolution Architecture

Optimising 4th-Order Runge-Kutta Methods: A Dynamic Heuristic Approach for Efficiency and Low Storage

Domain Knowledge-Enhanced LLMs for Fraud and Concept Drift Detection

Scalable Bayesian Low-Rank Adaptation of Large Language Models via Stochastic Variational Subspace Inference

Leveraging LLM-Assisted Query Understanding for Live Retrieval-Augmented Generation

Temporal-Aware Graph Attention Network for Cryptocurrency Transaction Fraud Detection

Pay Attention to Small Weights

Real-time and personalized product recommendations for large e-commerce platforms

RQdia: Regularizing Q-Value Distributions With Image Augmentation

CA-I2P: Channel-Adaptive Registration Network with Global Optimal Selection

A Systematic Review of Human-AI Co-Creativity

Holistic Surgical Phase Recognition with Hierarchical Input Dependent State Space Models

On Uniform Weighted Deep Polynomial approximation

Exploring Adapter Design Tradeoffs for Low Resource Music Generation

Detecting Referring Expressions in Visually Grounded Dialogue with Autoregressive Language Models

Small Encoders Can Rival Large Decoders in Detecting Groundedness

Hyperspherical Variational Autoencoders Using Efficient Spherical Cauchy Distribution

Integrating Vehicle Acoustic Data for Enhanced Urban Traffic Management: A Study on Speed Classification in Suzhou

DiLoCoX: A Low-Communication Large-Scale Training Framework for Decentralized Cluster

Agent-RewardBench: Towards a Unified Benchmark for Reward Modeling across Perception, Planning, and Safety in Real-World Multimodal Agents

From On-chain to Macro: Assessing the Importance of Data Source Diversity in Cryptocurrency Market Forecasting

$T^3$: Multi-level Tree-based Automatic Program Repair with Large Language Models

BitMark for Infinity: Watermarking Bitwise Autoregressive Image Generative Models

Task-Aware KV Compression For Cost-Effective Long Video Understanding

TracLLM: A Generic Framework for Attributing Long Context LLMs

Created by

Haebom

作者

Yanting Wang, Wei Zou, Runpeng Geng, Jinyuan Jia

概要

この論文は、文脈の文脈を理解する大規模言語モデル（LLM）の出力に寄与する文脈内のテキスト（文章、段落など）を正確に見つける「コンテキストトレースバック」の問題について説明します。既存の特徴寄与方法論の効率と精度の限界を指摘し、長文コンテキストLLMに特化した新しいコンテキストトラッキングフレームワークであるTracLLMを提案します。 TracLLMは、情報ベースの検索アルゴリズムと貢献スコアアンサンブル/ノイズ除去技術を活用して効率と精度を向上させ、LLMベースのシステムデバッグ、攻撃分析、ユーザー信頼性の向上など、さまざまな実際のアプリケーションに適用できます。

Takeaways、Limitations

•

Takeaways：

◦

長文コンテキストLLMの出力のコンテキストトラッキングのための効率的で正確なフレームワークであるTracLLMを提示します。

◦

既存の特徴貢献方法論の効率性と精度の問題を解決するのに貢献する。

◦

LLMベースのシステムデバッグ、攻撃分析、ユーザー信頼性の向上など、さまざまなアプリケーションに利用可能性を提供します。

◦

情報ベースの検索アルゴリズムと貢献スコアアンサンブル/ノイズ除去技術により、パフォーマンスの向上を実現します。

•

Limitations：

◦

TracLLMのパフォーマンスは、使用されているLLMとデータセットによって異なります。さまざまなLLMとデータセットの追加の実験が必要です。

◦

現在公開されているコードとデータの範囲、およびTracLLMの一般化の可能性に関する追加の検証が必要です。

◦

非常に長いコンテキストまたは複雑なコンテキストでのパフォーマンスの低下の可能性の分析が必要です。

Made with Slashpage