Daily Arxiv

전 세계에서 발간되는 인공지능 관련 논문을 정리하는 페이지 입니다.
본 페이지는 Google Gemini를 활용해 요약 정리하며, 비영리로 운영 됩니다.
논문에 대한 저작권은 저자 및 해당 기관에 있으며, 공유 시 출처만 명기하면 됩니다.

End-to-End Text-to-SQL with Dataset Selection: Leveraging LLMs for Adaptive Query Generation

Fourier-VLM: Compressing Vision Tokens in the Frequency Domain for Large Vision-Language Models

LAG: Logic-Augmented Generation from a Cartesian Perspective

Echo: Decoupling Inference and Training for Large-Scale RL Alignment on Heterogeneous Swarms

FDC-Net: Rethinking the association between EEG artifact removal and multi-dimensional affective computing

Fairness in Dysarthric Speech Synthesis: Understanding Intrinsic Bias in Dysarthric Speech Cloning using F5-TTS

RCR-Router: Efficient Role-Aware Context Routing for Multi-Agent LLM Systems with Structured Memory

DS$^2$Net: Detail-Semantic Deep Supervision Network for Medical Image Segmentation

LLMDistill4Ads: Using Cross-Encoders to Distill from LLM Signals for Advertiser Keyphrase Recommendations at eBay

When Cars Have Stereotypes: Auditing Demographic Bias in Objects from Text-to-Image Models

HiTeC: Hierarchical Contrastive Learning on Text-Attributed Hypergraph with Semantic-Aware Augmentation

SpectrumFM: Redefining Spectrum Cognition via Foundation Modeling

Dynamic Robot-Assisted Surgery with Hierarchical Class-Incremental Semantic Segmentation

A novel language model for predicting serious adverse event results in clinical trials from their prospective registrations

A Bit of Freedom Goes a Long Way: Classical and Quantum Algorithms for Reinforcement Learning under a Generative Model

aLLoyM: A large language model for alloy phase diagram prediction

Learning Phonetic Context-Dependent Viseme for Enhancing Speech-Driven 3D Facial Animation

Are Vision Foundation Models Ready for Out-of-the-Box Medical Image Registration?

SystolicAttention: Fusing FlashAttention within a Single Systolic Array

RAPNet: A Receptive-Field Adaptive Convolutional Neural Network for Pansharpening

AMix-1: A Pathway to Test-Time Scalable Protein Foundation Model

Bridging the Last Mile of Prediction: Enhancing Time Series Forecasting with Conditional Guided Flow Matching

Speckle2Self: Self-Supervised Ultrasound Speckle Reduction Without Clean Data

LIRA: Inferring Segmentation in Large Multi-modal Models with Local Interleaved Region Assistance

Addressing The Devastating Effects Of Single-Task Data Poisoning In Exemplar-Free Continual Learning

Foundation versus Domain-specific Models: Performance Comparison, Fusion, and Explainability in Face Recognition

Probabilistic Optimality for Inference-time Scaling

ARAG: Agentic Retrieval Augmented Generation for Personalized Recommendation

Exploring Adapter Design Tradeoffs for Low Resource Music Generation

CycleDistill: Bootstrapping Machine Translation using LLMs with Cyclical Distillation

Robust Anomaly Detection in Network Traffic: Evaluating Machine Learning Models on CICIDS2017

Robust Behavior Cloning Via Global Lipschitz Regularization

Granular-Ball-Induced Multiple Kernel K-Means

DRAMA-X: A Fine-grained Intent Prediction and Risk Reasoning Benchmark For Driving

MMET: A Multi-Input and Multi-Scale Transformer for Efficient PDEs Solving

A Two-stage Optimization Method for Wide-range Single-electron Quantum Magnetic Sensing

Physics-Informed Teleconnection-Aware Transformer for Global Subseasonal-to-Seasonal Forecasting

AI-Generated Compromises for Coalition Formation

MLOps with Microservices: A Case Study on the Maritime Domain

Winner-takes-all for Multivariate Probabilistic Time Series Forecasting

Leaps Beyond the Seen: Reinforced Reasoning Augmented Generation for Clinical Notes

Learning to Diagnose Privately: DP-Powered LLMs for Radiology Report Classification

HERGC: Heterogeneous Experts Representation and Generative Completion for Multimodal Knowledge Graphs

Verbal Werewolf: Engage Users with Verbalized Agentic Werewolf Game Framework

MaCP: Minimal yet Mighty Adaptation via Hierarchical Cosine Projection

CADRE: Customizable Assurance of Data Readiness in Privacy-Preserving Federated Learning

FP4 All the Way: Fully Quantized Training of LLMs

Improving LLM Outputs Against Jailbreak Attacks with Expert Model Integration

Extracting Probabilistic Knowledge from Large Language Models for Bayesian Network Parameterization

RIDGECUT: Learning Graph Partitioning with Rings and Wedges

Uniform Loss vs. Specialized Optimization: A Comparative Analysis in Multi-Task Learning

Can LLM-based Financial Investing Strategies Outperform the Market in Long Run?

A Multimodal Deep Learning Approach for White Matter Shape Prediction in Diffusion MRI Tractography

Sparsity Outperforms Low-Rank Projections in Few-Shot Adaptation

Bidirectional Hierarchical Protein Multi-Modal Representation Learning

How Post-Training Reshapes LLMs: A Mechanistic View on Knowledge, Truthfulness, Refusal, and Confidence

$\mu$KE: Matryoshka Unstructured Knowledge Editing of Large Language Models

Learning 3D-Gaussian Simulators from RGB Videos

Learning Adaptive Dexterous Grasping from Single Demonstrations

A Theory of Learning with Autoregressive Chain of Thought

FunGraph: Functionality Aware 3D Scene Graphs for Language-Prompted Scene Interaction

From Reusing to Forecasting: Accelerating Diffusion Models with TaylorSeers

ElementaryNet: A Non-Strategic Neural Network for Predicting Human Behavior in Normal-Form Games

Collective Reasoning Among LLMs: A Framework for Answer Validation Without Ground Truth

Advancing AI-Powered Medical Image Synthesis: Insights from MedVQA-GI Challenge Using CLIP, Fine-Tuned Stable Diffusion, and Dream-Booth + LoRA

Predicting Depression in Screening Interviews from Interactive Multi-Theme Collaboration

Schema-Guided Scene-Graph Reasoning based on Multi-Agent Large Language Model System

MQuant: Unleashing the Inference Potential of Multimodal Large Language Models via Full Static Quantization

Mitigating Traffic Oscillations in Mixed Traffic Flow with Scalable Deep Koopman Predictive Control

Improving Your Model Ranking on Chatbot Arena by Vote Rigging

FIT-Print: Towards False-claim-resistant Model Ownership Verification via Targeted Fingerprint

Softplus Attention with Re-weighting Boosts Length Extrapolation in Large Language Models

Ehrenfeucht-Haussler Rank and Chain of Thought

WebWalker: Benchmarking LLMs in Web Traversal

Generative AI for Cel-Animation: A Survey

Toward Intelligent and Secure Cloud: Large Language Model Empowered Proactive Defense

MomentMix Augmentation with Length-Aware DETR for Temporally Robust Moment Retrieval

POEX: Towards Policy Executable Jailbreak Attacks Against the LLM-based Robots

B-VLLM: A Vision Large Language Model with Balanced Spatio-Temporal Tokens

LoRA.rar: Learning to Merge LoRAs via Hypernetworks for Subject-Style Conditioned Image Generation

Understanding and Mitigating Memorization in Generative Models via Sharpness of Probability Landscapes

Steering AI-Driven Personalization of Scientific Text for General Audiences

Zero-Shot Voice Conversion via Content-Aware Timbre Ensemble and Conditional Flow Matching

EfficientEQA: An Efficient Approach to Open-Vocabulary Embodied Question Answering

UoMo: A Universal Model of Mobile Traffic Forecasting for Wireless Network Optimization

MaCP: Minimal yet Mighty Adaptation via Hierarchical Cosine Projection

Exploring Spatial Representation to Enhance LLM Reasoning in Aerial Vision-Language Navigation

A Closer Look at Machine Unlearning for Large Language Models

In-Situ Fine-Tuning of Wildlife Models in IoT-Enabled Camera Traps for Efficient Adaptation

EEG-Language Pretraining for Highly Label-Efficient Clinical Phenotyping

A Practice of Post-Training on Llama-3 70B with Optimal Selection of Additional Language Mixture Ratio

Reward-Directed Score-Based Diffusion Models via q-Learning

Chain of Thought Still Thinks Fast: APriCoT Helps with Thinking Slow

A Survey on Model MoErging: Recycling and Routing Among Specialized Experts for Collaborative Learning

AI-AI Bias: large language models favor communications generated by large language models

LVBench: An Extreme Long Video Understanding Benchmark

From Spikes to Heavy Tails: Unveiling the Spectral Evolution of Neural Networks

Fractured Glass, Failing Cameras: Simulating Physics-Based Adversarial Samples for Autonomous Driving Systems

Runtime Monitoring and Enforcement of Conditional Fairness in Generative AIs

On the Sample Efficiency of Abstractions and Potential-Based Reward Shaping in Reinforcement Learning

A Theory of Learning with Autoregressive Chain of Thought

Created by

Haebom

저자

Nirmit Joshi, Gal Vardi, Adam Block, Surbhi Goel, Zhiyuan Li, Theodor Misiakiewicz, Nathan Srebro

개요

본 논문은 시퀀스를 다음 토큰으로 생성하는 기본 클래스가 주어졌을 때, 시간 불변 생성기를 여러 단계 반복하여 사고 과정(chain-of-thought)을 생성하고 최종 토큰을 답으로 사용하는 프롬프트-답변 매핑 학습을 고려합니다. 사고 과정이 관측되는 경우와 프롬프트-답변 쌍만으로 학습하는 경우(사고 과정이 잠재적인 경우) 모두에 대한 학습 문제를 공식화하고, 기본 클래스의 일반적인 특성(예: VC 차원) 및 선형 임계값과 같은 특정 기본 클래스에 대해 표본 및 계산 복잡도를 분석합니다. 보편적인 표현이 가능하고 계산적으로 다루기 쉬운 사고 과정 학습을 허용하는 간단한 기본 클래스를 제시하며, 시간 불변성으로 인해 사고 과정의 길이와 무관한 표본 복잡도를 갖는다는 점이 핵심입니다. 본 연구에서 어텐션(Attention)은 자연스럽게 도출됩니다.

시사점, 한계점

•

시사점:

◦

시간 불변 생성기를 이용한 사고 과정 학습의 표본 복잡도가 사고 과정의 길이에 의존하지 않음을 보임으로써, 긴 사고 과정을 효율적으로 학습할 수 있는 가능성을 제시합니다.

◦

보편적인 표현이 가능하고 계산적으로 효율적인 사고 과정 학습을 위한 새로운 기본 클래스를 제안합니다.

◦

어텐션 메커니즘이 자연스럽게 유도되는 새로운 프레임워크를 제공합니다.

•

한계점:

◦

제안된 기본 클래스의 실제 성능 및 일반화 능력에 대한 실험적 검증이 부족합니다.

◦

시간 불변성이라는 가정이 실제 문제에 적용될 때의 한계가 명확하지 않습니다.

◦

복잡한 사고 과정을 효과적으로 모델링하기 위한 추가적인 연구가 필요합니다.

Made with Slashpage