Daily Arxiv

전 세계에서 발간되는 인공지능 관련 논문을 정리하는 페이지 입니다.
본 페이지는 Google Gemini를 활용해 요약 정리하며, 비영리로 운영 됩니다.
논문에 대한 저작권은 저자 및 해당 기관에 있으며, 공유 시 출처만 명기하면 됩니다.

Geo-Registration of Terrestrial LiDAR Point Clouds with Satellite Images without GNSS

Empowering Bridge Digital Twins by Bridging the Data Gap with a Unified Synthesis Framework

AI Agent Smart Contract Exploit Generation

ModelCitizens: Representing Community Voices in Online Safety

Sequential Attention-based Sampling for Histopathological Analysis

Classification of autoimmune diseases from Peripheral blood TCR repertoires by multimodal multi-instance learning

From Video to EEG: Adapting Joint Embedding Predictive Architecture to Uncover Visual Concepts in Brain Signal Analysis

Reinforcement Learning-based Feature Generation Algorithm for Scientific Data

RefineX: Learning to Refine Pre-training Data at Scale from Expert-Guided Programs

On Jailbreaking Quantized Language Models Through Fault Injection Attacks

PBa-LLM: Privacy- and Bias-aware NLP using Named-Entity Recognition (NER)

DriveMRP: Enhancing Vision-Language Models with Synthetic Motion Data for Motion Risk Prediction

Probing and Steering Evaluation Awareness of Language Models

Generating Heterogeneous Multi-dimensional Data : A Comparative Study

Autonomy by Design: Preserving Human Autonomy in AI Decision-Support

PBCAT: Patch-based composite adversarial training against physically realizable attacks on object detection

Federated Breast Cancer Detection Enhanced by Synthetic Ultrasound Image Augmentation

XY-Tokenizer: Mitigating the Semantic-Acoustic Conflict in Low-Bitrate Speech Codecs

DeepTalk: Towards Seamless and Smart Speech Interaction with Adaptive Modality-Specific MoE

SWE-SQL: Illuminating LLM Pathways to Solve User SQL Issues in Real-World Applications

LLM Agent for Hyper-Parameter Optimization

MedSyn: Enhancing Diagnostics with Human-AI Collaboration

Evaluating and Improving Robustness in Large Language Models: A Survey and Future Directions

ConTextTab: A Semantics-Aware Tabular In-Context Learner

QUITE: A Query Rewrite System Beyond Rules with LLM Agents

Saffron-1: Safety Inference Scaling

hdl2v: A Code Translation Dataset for Enhanced LLM Verilog Generation

Knockout LLM Assessment: Using Large Language Models for Evaluations through Iterative Pairwise Comparisons

Humanoid World Models: Open World Foundation Models for Humanoid Robotics

EMORL: Ensemble Multi-Objective Reinforcement Learning for Efficient and Flexible LLM Fine-Tuning

Adaptive Elicitation of Latent Information Using Natural Language

Substance over Style: Evaluating Proactive Conversational Coaching Agents

Real AI Agents with Fake Memories: Fatal Context Manipulation Attacks on Web3 Agents

Sparse Autoencoder as a Zero-Shot Classifier for Concept Erasing in Text-to-Image Diffusion Models

Safer or Luckier? LLMs as Safety Evaluators Are Not Robust to Artifacts

UniF$^2$ace: Fine-grained Face Understanding and Generation with Unified Multimodal Models

DynamicID: Zero-Shot Multi-ID Image Personalization with Flexible Facial Editability

GMLM: Bridging Graph Neural Networks and Language Models for Heterophilic Node Classification

Towards Enterprise-Ready Computer Using Generalist Agent

Oscillation-Reduced MXFP4 Training for Vision Transformers

Understanding Fixed Predictions via Confined Regions

Multi-Attribute Steering of Language Models via Targeted Intervention

Teaching LLMs According to Their Aptitude: Adaptive Reasoning for Mathematical Problem Solving

Theme-Explanation Structure for Table Summarization using Large Language Models: A Case Study on Korean Tabular Data

Scaling 4D Representations

AutoPrep: Natural Language Question-Aware Data Preparation with a Multi-Agent Framework

CHAI for LLMs: Improving Code-Mixed Translation in Large Language Models through Reinforcement Learning with AI Feedback

Vital Insight: Assisting Experts' Context-Driven Sensemaking of Multi-modal Personal Tracking Data Using Visualization and Human-In-The-Loop LLM

Hespi: A pipeline for automatically detecting information from hebarium specimen sheets

Diversifying Robot Locomotion Behaviors with Extrinsic Behavioral Curiosity

Pullback Flow Matching on Data Manifolds

The Impact of Generative AI on Collaborative Open-Source Software Development: Evidence from GitHub Copilot

Breaking PEFT Limitations: Leveraging Weak-to-Strong Knowledge Transfer for Backdoor Attacks in LLMs

Tokenization for Molecular Foundation Models

DilateQuant: Accurate and Efficient Diffusion Quantization via Weight Dilation

PersonaFlow: Designing LLM-Simulated Expert Perspectives for Enhanced Research Ideation

Disentangling Uncertainty for Safe Social Navigation using Deep Reinforcement Learning

CodeMirage: Hallucinations in Code Generated by Large Language Models

A Policy-Gradient Approach to Solving Imperfect-Information Games with Best-Iterate Convergence

Diffusion-Driven Semantic Communication for Generative Models with Bandwidth Constraints

Semantic Augmentation in Images using Language

Geometric Constraints in Deep Learning Frameworks: A Survey

Enhancing Plasticity for First Session Adaptation Continual Learning

Efficient Transfer Learning via Causal Bounds

FEVO: Financial Knowledge Expansion and Reasoning Evolution for Large Language Models

A Wireless Foundation Model for Multi-Task Prediction

GTA1: GUI Test-time Scaling Agent

Modeling (Deontic) Modal Operators With the s(CASP) Goal-directed Predicate Answer Set Programming System

Fuzzy Classification Aggregation for a Continuum of Agents

MedGellan: LLM-Generated Medical Guidance to Support Physicians

Animation Needs Attention: A Holistic Approach to Slides Animation Comprehension with Visual-Language Models

Establishing Best Practices for Building Rigorous Agentic Benchmarks

SHADE-Arena: Evaluating Sabotage and Monitoring in LLM Agents

TRiSM for Agentic AI: A Review of Trust, Risk, and Security Management in LLM-based Agentic Multi-Agent Systems

The end of radical concept nativism

AI-Driven Scholarly Peer Review via Persistent Workflow Prompting, Meta-Prompting, and Meta-Reasoning

Do Larger Language Models Imply Better Generalization? A Pretraining Scaling Law for Implicit Reasoning

SagaLLM: Context Management, Validation, and Transaction Guarantees for Multi-Agent LLM Planning

Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Models

ROCKET-2: Steering Visuomotor Policy via Cross-View Goal Alignment

Hybrid Quantum-Classical Multi-Agent Pathfinding

FinSphere, a Real-Time Stock Analysis Agent Powered by Instruction-Tuned LLMs and Domain Tools

Multi-Agent Pathfinding Under Team-Connected Communication Constraint via Adaptive Path Expansion and Dynamic Leading

Can adversarial attacks by large language models be attributed?

Planning Anything with Rigor: General-Purpose Zero-Shot Planning with LLM-based Formalized Programming

OpenRLHF: An Easy-to-use, Scalable and High-performance RLHF Framework

Stepwise functional refoundation of relational concept analysis

A Survey on Event Prediction Methods from a Systems Perspective: Bringing Together Disparate Research Areas

An AI Approach for Learning the Spectrum of the Laplace-Beltrami Operator

Latent Acoustic Mapping for Direction of Arrival Estimation: A Self-Supervised Approach

DeepRetro: Retrosynthetic Pathway Discovery using Iterative LLM Reasoning

Comparative Analysis of CNN and Transformer Architectures with Heart Cycle Normalization for Automated Phonocardiogram Classification

A Novel Hybrid Deep Learning Technique for Speech Emotion Detection using Feature Engineering

Advances in Intelligent Hearing Aids: Deep Learning Approaches to Selective Noise Cancellation

Modeling Heterogeneity across Varying Spatial Extents: Discovering Linkages between Sea Ice Retreat and Ice Shelve Melt in the Antarctic

Surrogate Model for Heat Transfer Prediction in Impinging Jet Arrays using Dynamic Inlet/Outlet and Flow Rate Control

PLAME: Leveraging Pretrained Language Models to Generate Enhanced Protein Multiple Sequence Alignments

Design and Implementation of an OCR-Powered Pipeline for Table Extraction from Invoices

FlexOlmo: Open Language Models for Flexible Data Use

Generating Multi-Table Time Series EHR from Latent Space with Minimal Preprocessing

xGen-small Technical Report

Created by

Haebom

저자

Erik Nijkamp, Bo Pang, Egor Pakhomov, Akash Gokul, Jin Qu, Silvio Savarese, Yingbo Zhou, Caiming Xiong

개요

xGen-small은 긴 문맥을 다루는 데 최적화된 4B 및 9B 파라미터 크기의 Transformer 디코더 모델 계열입니다. 도메인 균형 및 주파수 인식 데이터 큐레이션, 품질 어닐링 및 최대 128k 토큰까지의 길이 확장을 포함하는 다단계 사전 훈련, 그리고 지도 학습 미세 조정, 선호도 학습, 온라인 강화 학습을 통한 목표 지향적 사후 훈련을 결합한 수직 통합 파이프라인을 사용합니다. xGen-small은 다양한 작업, 특히 수학 및 코딩 도메인에서 강력한 성능을 제공하며, 긴 문맥 벤치마크에서 뛰어난 성능을 보입니다.

시사점, 한계점

•

시사점:

◦

긴 문맥 응용 프로그램을 위한 효율적이고 강력한 Transformer 모델을 제시합니다.

◦

수학 및 코딩 도메인에서 우수한 성능을 보여줍니다.

◦

다양한 사전 훈련 및 사후 훈련 기법을 통합하여 성능을 향상시켰습니다.

◦

128k 토큰까지의 긴 문맥 처리가 가능합니다.

•

한계점:

◦

특정 도메인(수학 및 코딩)에 대한 편향이 존재할 수 있습니다.

◦

모델의 크기가 커서 메모리 및 연산 자원이 많이 필요할 수 있습니다.

◦

제시된 결과의 일반화 성능에 대한 추가적인 검증이 필요합니다.

◦

구체적인 벤치마크 결과 및 비교 대상 모델에 대한 정보가 부족합니다.

Made with Slashpage