Daily Arxiv

전 세계에서 발간되는 인공지능 관련 논문을 정리하는 페이지 입니다.
본 페이지는 Google Gemini를 활용해 요약 정리하며, 비영리로 운영 됩니다.
논문에 대한 저작권은 저자 및 해당 기관에 있으며, 공유 시 출처만 명기하면 됩니다.

End-to-End Text-to-SQL with Dataset Selection: Leveraging LLMs for Adaptive Query Generation

Fourier-VLM: Compressing Vision Tokens in the Frequency Domain for Large Vision-Language Models

LAG: Logic-Augmented Generation from a Cartesian Perspective

Echo: Decoupling Inference and Training for Large-Scale RL Alignment on Heterogeneous Swarms

FDC-Net: Rethinking the association between EEG artifact removal and multi-dimensional affective computing

Fairness in Dysarthric Speech Synthesis: Understanding Intrinsic Bias in Dysarthric Speech Cloning using F5-TTS

RCR-Router: Efficient Role-Aware Context Routing for Multi-Agent LLM Systems with Structured Memory

DS$^2$Net: Detail-Semantic Deep Supervision Network for Medical Image Segmentation

LLMDistill4Ads: Using Cross-Encoders to Distill from LLM Signals for Advertiser Keyphrase Recommendations at eBay

When Cars Have Stereotypes: Auditing Demographic Bias in Objects from Text-to-Image Models

HiTeC: Hierarchical Contrastive Learning on Text-Attributed Hypergraph with Semantic-Aware Augmentation

SpectrumFM: Redefining Spectrum Cognition via Foundation Modeling

Dynamic Robot-Assisted Surgery with Hierarchical Class-Incremental Semantic Segmentation

A novel language model for predicting serious adverse event results in clinical trials from their prospective registrations

A Bit of Freedom Goes a Long Way: Classical and Quantum Algorithms for Reinforcement Learning under a Generative Model

aLLoyM: A large language model for alloy phase diagram prediction

Learning Phonetic Context-Dependent Viseme for Enhancing Speech-Driven 3D Facial Animation

Are Vision Foundation Models Ready for Out-of-the-Box Medical Image Registration?

SystolicAttention: Fusing FlashAttention within a Single Systolic Array

RAPNet: A Receptive-Field Adaptive Convolutional Neural Network for Pansharpening

AMix-1: A Pathway to Test-Time Scalable Protein Foundation Model

Bridging the Last Mile of Prediction: Enhancing Time Series Forecasting with Conditional Guided Flow Matching

Speckle2Self: Self-Supervised Ultrasound Speckle Reduction Without Clean Data

LIRA: Inferring Segmentation in Large Multi-modal Models with Local Interleaved Region Assistance

Addressing The Devastating Effects Of Single-Task Data Poisoning In Exemplar-Free Continual Learning

Foundation versus Domain-specific Models: Performance Comparison, Fusion, and Explainability in Face Recognition

Probabilistic Optimality for Inference-time Scaling

ARAG: Agentic Retrieval Augmented Generation for Personalized Recommendation

Exploring Adapter Design Tradeoffs for Low Resource Music Generation

CycleDistill: Bootstrapping Machine Translation using LLMs with Cyclical Distillation

Robust Anomaly Detection in Network Traffic: Evaluating Machine Learning Models on CICIDS2017

Robust Behavior Cloning Via Global Lipschitz Regularization

Granular-Ball-Induced Multiple Kernel K-Means

DRAMA-X: A Fine-grained Intent Prediction and Risk Reasoning Benchmark For Driving

MMET: A Multi-Input and Multi-Scale Transformer for Efficient PDEs Solving

A Two-stage Optimization Method for Wide-range Single-electron Quantum Magnetic Sensing

Physics-Informed Teleconnection-Aware Transformer for Global Subseasonal-to-Seasonal Forecasting

AI-Generated Compromises for Coalition Formation

MLOps with Microservices: A Case Study on the Maritime Domain

Winner-takes-all for Multivariate Probabilistic Time Series Forecasting

Leaps Beyond the Seen: Reinforced Reasoning Augmented Generation for Clinical Notes

Learning to Diagnose Privately: DP-Powered LLMs for Radiology Report Classification

HERGC: Heterogeneous Experts Representation and Generative Completion for Multimodal Knowledge Graphs

Verbal Werewolf: Engage Users with Verbalized Agentic Werewolf Game Framework

MaCP: Minimal yet Mighty Adaptation via Hierarchical Cosine Projection

CADRE: Customizable Assurance of Data Readiness in Privacy-Preserving Federated Learning

FP4 All the Way: Fully Quantized Training of LLMs

Improving LLM Outputs Against Jailbreak Attacks with Expert Model Integration

Extracting Probabilistic Knowledge from Large Language Models for Bayesian Network Parameterization

RIDGECUT: Learning Graph Partitioning with Rings and Wedges

Uniform Loss vs. Specialized Optimization: A Comparative Analysis in Multi-Task Learning

Can LLM-based Financial Investing Strategies Outperform the Market in Long Run?

A Multimodal Deep Learning Approach for White Matter Shape Prediction in Diffusion MRI Tractography

Sparsity Outperforms Low-Rank Projections in Few-Shot Adaptation

Bidirectional Hierarchical Protein Multi-Modal Representation Learning

How Post-Training Reshapes LLMs: A Mechanistic View on Knowledge, Truthfulness, Refusal, and Confidence

$\mu$KE: Matryoshka Unstructured Knowledge Editing of Large Language Models

Learning 3D-Gaussian Simulators from RGB Videos

Learning Adaptive Dexterous Grasping from Single Demonstrations

A Theory of Learning with Autoregressive Chain of Thought

FunGraph: Functionality Aware 3D Scene Graphs for Language-Prompted Scene Interaction

From Reusing to Forecasting: Accelerating Diffusion Models with TaylorSeers

ElementaryNet: A Non-Strategic Neural Network for Predicting Human Behavior in Normal-Form Games

Collective Reasoning Among LLMs: A Framework for Answer Validation Without Ground Truth

Advancing AI-Powered Medical Image Synthesis: Insights from MedVQA-GI Challenge Using CLIP, Fine-Tuned Stable Diffusion, and Dream-Booth + LoRA

Predicting Depression in Screening Interviews from Interactive Multi-Theme Collaboration

Schema-Guided Scene-Graph Reasoning based on Multi-Agent Large Language Model System

MQuant: Unleashing the Inference Potential of Multimodal Large Language Models via Full Static Quantization

Mitigating Traffic Oscillations in Mixed Traffic Flow with Scalable Deep Koopman Predictive Control

Improving Your Model Ranking on Chatbot Arena by Vote Rigging

FIT-Print: Towards False-claim-resistant Model Ownership Verification via Targeted Fingerprint

Softplus Attention with Re-weighting Boosts Length Extrapolation in Large Language Models

Ehrenfeucht-Haussler Rank and Chain of Thought

WebWalker: Benchmarking LLMs in Web Traversal

Generative AI for Cel-Animation: A Survey

Toward Intelligent and Secure Cloud: Large Language Model Empowered Proactive Defense

MomentMix Augmentation with Length-Aware DETR for Temporally Robust Moment Retrieval

POEX: Towards Policy Executable Jailbreak Attacks Against the LLM-based Robots

B-VLLM: A Vision Large Language Model with Balanced Spatio-Temporal Tokens

LoRA.rar: Learning to Merge LoRAs via Hypernetworks for Subject-Style Conditioned Image Generation

Understanding and Mitigating Memorization in Generative Models via Sharpness of Probability Landscapes

Steering AI-Driven Personalization of Scientific Text for General Audiences

Zero-Shot Voice Conversion via Content-Aware Timbre Ensemble and Conditional Flow Matching

EfficientEQA: An Efficient Approach to Open-Vocabulary Embodied Question Answering

UoMo: A Universal Model of Mobile Traffic Forecasting for Wireless Network Optimization

MaCP: Minimal yet Mighty Adaptation via Hierarchical Cosine Projection

Exploring Spatial Representation to Enhance LLM Reasoning in Aerial Vision-Language Navigation

A Closer Look at Machine Unlearning for Large Language Models

In-Situ Fine-Tuning of Wildlife Models in IoT-Enabled Camera Traps for Efficient Adaptation

EEG-Language Pretraining for Highly Label-Efficient Clinical Phenotyping

A Practice of Post-Training on Llama-3 70B with Optimal Selection of Additional Language Mixture Ratio

Reward-Directed Score-Based Diffusion Models via q-Learning

Chain of Thought Still Thinks Fast: APriCoT Helps with Thinking Slow

A Survey on Model MoErging: Recycling and Routing Among Specialized Experts for Collaborative Learning

AI-AI Bias: large language models favor communications generated by large language models

LVBench: An Extreme Long Video Understanding Benchmark

From Spikes to Heavy Tails: Unveiling the Spectral Evolution of Neural Networks

Fractured Glass, Failing Cameras: Simulating Physics-Based Adversarial Samples for Autonomous Driving Systems

Runtime Monitoring and Enforcement of Conditional Fairness in Generative AIs

On the Sample Efficiency of Abstractions and Potential-Based Reward Shaping in Reinforcement Learning

aLLoyM: A large language model for alloy phase diagram prediction

Created by

Haebom

저자

Yuna Oikawa, Guillaume Deffrennes, Taichi Abe, Ryo Tamura, Koji Tsuda

개요

본 논문은 재료 과학 분야에 적용 가능한 대규모 언어 모델(LLM)인 aLLoyM을 소개한다. aLLoyM은 합금 조성, 온도 및 해당 상 정보에 대해 특별히 미세 조정된 LLM이다. 오픈소스 계산 상 다이어그램 데이터베이스(CPDDB)와 CALPHAD(CALculation of PHAse Diagrams)를 기반으로 이진 및 삼원 상 다이어그램에 대한 질문과 답변(Q&A) 쌍을 큐레이션하여 개발되었다. 오픈소스 사전 훈련된 LLM인 Mistral을 다중 선택 및 단답형 두 가지 Q&A 형식으로 미세 조정했다. 벤치마크 평가 결과, 미세 조정은 다중 선택 상 다이어그램 질문에 대한 성능을 상당히 향상시킨다는 것을 보여준다. 또한, aLLoyM의 단답형 모델은 구성 요소만으로 새로운 상 다이어그램을 생성할 수 있는 능력을 보여주어 이전에 탐구되지 않은 재료 시스템의 발견을 가속화할 가능성을 강조한다. 추가 연구 및 채택을 촉진하기 위해 단답형 미세 조정된 aLLoyM 버전과 완벽한 벤치마킹 Q&A 데이터 세트를 Hugging Face에 공개했다.

시사점, 한계점

•

시사점:

◦

오픈소스 LLM을 활용하여 재료 과학 분야의 문제 해결에 효과적으로 적용할 수 있는 모델을 개발했다.

◦

aLLoyM은 다중 선택 및 단답형 질문 모두에서 우수한 성능을 보이며, 특히 단답형 모델은 새로운 상 다이어그램 생성 능력을 보여준다.

◦

개발된 모델과 데이터셋을 공개하여 추가 연구 및 활용을 장려한다.

◦

새로운 재료 시스템 발견을 가속화할 가능성을 제시한다.

•

한계점:

◦

현재는 이진 및 삼원 상 다이어그램에 대한 데이터만 사용하여 훈련되었으므로, 더 복잡한 시스템에는 적용이 제한적일 수 있다.

◦

모델의 정확도 및 일반화 성능에 대한 추가적인 평가 및 검증이 필요하다.

◦

CPDDB와 CALPHAD에 의존하는 데이터의 정확성과 완전성에 대한 의존성이 존재한다.

Made with Slashpage