Daily Arxiv

전 세계에서 발간되는 인공지능 관련 논문을 정리하는 페이지 입니다.
본 페이지는 Google Gemini를 활용해 요약 정리하며, 비영리로 운영 됩니다.
논문에 대한 저작권은 저자 및 해당 기관에 있으며, 공유 시 출처만 명기하면 됩니다.

VideoPDE: Unified Generative PDE Solving via Video Inpainting Diffusion Models

Prefix-Tuning+: Modernizing Prefix-Tuning by Decoupling the Prefix from Attention

Graph-Convolutional-Beta-VAE for Synthetic Abdominal Aorta Aneurysm Generation

A Production Scheduling Framework for Reinforcement Learning Under Real-World Constraints

ROSAQ: Rotation-based Saliency-Aware Weight Quantization for Efficiently Compressing Large Language Models

Seewo's Submission to MLC-SLM: Lessons learned from Speech Reasoning Language Models

SeqPE: Transformer with Sequential Position Encoding

No-Regret Learning Under Adversarial Resource Constraints: A Spending Plan Is All You Need!

AI-Facilitated Analysis of Abstracts and Conclusions: Flagging Unsubstantiated Claims and Ambiguous Pronouns

IKDiffuser: Fast and Diverse Inverse Kinematics Solution Generation for Multi-arm Robotic Systems

Delving into Instance-Dependent Label Noise in Graph Data: A Comprehensive Study and Benchmark

Deep Learning Model Acceleration and Optimization Strategies for Real-Time Recommendation Systems

Adaptive Composition of Machine Learning as a Service (MLaaS) for IoT Environments

Discrete Audio Tokens: More Than a Survey!

FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation

Inherently Faithful Attention Maps for Vision Transformers

Reparameterized LLM Training via Orthogonal Equivalence Transformation

MultiMatch: Multihead Consistency Regularization Matching for Semi-Supervised Text Classification

SPARQ: Synthetic Problem Generation for Reasoning via Quality-Diversity Algorithms

CellCLIP -- Learning Perturbation Effects in Cell Painting via Text-Guided Contrastive Learning

EuroLLM-9B: Technical Report

Incentivizing Reasoning for Advanced Instruction-Following of Large Language Models

EEG2TEXT-CN: An Exploratory Study of Open-Vocabulary Chinese Text-EEG Alignment via Large Language Model and Contrastive Learning on ChineseEEG

MMedAgent-RL: Optimizing Multi-Agent Collaboration for Multimodal Medical Reasoning

CSVQA: A Chinese Multimodal Benchmark for Evaluating STEM Reasoning Capabilities of VLMs

KGMark: A Diffusion Watermark for Knowledge Graphs

Representing local protein environments with atomistic foundation models

Accelerating RLHF Training with Reward Variance Increase

FlowAlign: Trajectory-Regularized, Inversion-Free Flow-based Image Editing

PartInstruct: Part-level Instruction Following for Fine-grained Robot Manipulation

REAL-Prover: Retrieval Augmented Lean Prover for Mathematical Reasoning

MSVIT: Improving Spiking Vision Transformer Using Multi-scale Attention Fusion

Abacus: A Cost-Based Optimizer for Semantic Operator Systems

IP Leakage Attacks Targeting LLM-Based Multi-Agent Systems

CAPTURE: Context-Aware Prompt Injection Testing and Robustness Enhancement

Chatting with Papers: A Hybrid Approach Using LLMs and Knowledge Graphs

Patho-R1: A Multimodal Reinforcement Learning-Based Pathology Expert Reasoner

LongCodeBench: Evaluating Coding LLMs at 1M Context Windows

H$^3$DP: Triply-Hierarchical Diffusion Policy for Visuomotor Learning

Convert Language Model into a Value-based Strategic Planner

Graph RAG for Legal Norms: A Hierarchical, Temporal and Deterministic Approach

CAPO: Cost-Aware Prompt Optimization

Spatiotemporal Learning of Brain Dynamics from fMRI Using Frequency-Specific Multi-Band Attention for Cognitive and Psychiatric Applications

The Backfiring Effect of Weak AI Safety Regulation

Assessing Consistency and Reproducibility in the Outputs of Large Language Models: Evidence Across Diverse Finance and Accounting Tasks

Achieving Unbiased Multi-Instance Learning via Balanced Fine-Grained Positive-Unlabeled Learning

Conformal Prediction Sets for Deep Generative Models via Reduction to Conformal Regression

SOPBench: Evaluating Language Agents at Following Standard Operating Procedures and Constraints

Effect of Selection Format on LLM Performance

Reward Shaping to Mitigate Reward Hacking in RLHF

SAE-V: Interpreting Multimodal Models for Enhanced Alignment

LongSpec: Long-Context Lossless Speculative Decoding with Efficient Drafting and Verification

Target Speaker Extraction through Comparing Noisy Positive and Negative Audio Enrollments

Hardware-Friendly Static Quantization Method for Video Diffusion Transformers

PredictaBoard: Benchmarking LLM Score Predictability

Towards Geo-Culturally Grounded LLM Generations

Diverse Topology Optimization using Modulated Neural Fields

Counterfactual-Consistency Prompting for Relative Temporal Understanding in Large Language Models

NAROCE: A Neural Algorithmic Reasoner Framework for Online Complex Event Detection

Bridging Voting and Deliberation with Algorithms: Field Insights from vTaiwan and Kultur Komitee

From tools to thieves: Measuring and understanding public perceptions of AI through crowdsourced metaphors

The Alternative Annotator Test for LLM-as-a-Judge: How to Statistically Justify Replacing Human Annotators with LLMs

Language and Planning in Robotic Navigation: A Multilingual Evaluation of State-of-the-Art Models

Agent Laboratory: Using LLM Agents as Research Assistants

LLMs Help Alleviate the Cross-Subject Variability in Brain Signal and Language Alignment

Uncertainty-Aware Critic Augmentation for Hierarchical Multi-Agent EV Charging Control

Parallel Greedy Best-First Search with a Bound on Expansions Relative to Sequential Search

PunchBench: Benchmarking MLLMs in Multimodal Punchline Comprehension

BESSTIE: A Benchmark for Sentiment and Sarcasm Classification for Varieties of English

LARP: Tokenizing Videos with a Learned Autoregressive Generative Prior

Geometric Signatures of Compositionality Across a Language Model's Lifetime

AssistantX: An LLM-Powered Proactive Assistant in Collaborative Human-Populated Environment

MSDNet: Multi-Scale Decoder for Few-Shot Semantic Segmentation via Transformer-Guided Prototyping

What is the Right Notion of Distance between Predict-then-Optimize Tasks?

QuantFactor REINFORCE: Mining Steady Formulaic Alpha Factors with Variance-bounded REINFORCE

MALSIGHT: Exploring Malicious Source Code and Benign Pseudocode for Iterative Binary Malware Summarization

Bridging Social Media and Search Engines: Dredge Words and the Detection of Unreliable Domains

Vul-RAG: Enhancing LLM-based Vulnerability Detection via Knowledge-level RAG

Quality-aware Masked Diffusion Transformer for Enhanced Music Generation

InkSight: Offline-to-Online Handwriting Conversion by Teaching Vision-Language Models to Read and Write

Exploring news intent and its application: A theory-driven approach

Learning Multi-modal Representations by Watching Hundreds of Surgical Video Lectures

AgentOrchestra: A Hierarchical Multi-Agent Framework for General-Purpose Task Solving

ConsistencyChecker: Tree-based Evaluation of LLM Generalization Capabilities

A Conjecture on a Fundamental Trade-Off between Certainty and Scope in Symbolic and Generative AI

Comment on The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexity

TIP-Search: Time-Predictable Inference Scheduling for Market Prediction under Uncertain Load

AgentCPM-GUI: Building Mobile-Use Agents with Reinforcement Fine-Tuning

Large Language Models' Reasoning Stalls: An Investigation into the Capabilities of Frontier Models

OrgAccess: A Benchmark for Role Based Access Control in Organization Scale LLMs

SeePhys: Does Seeing Help Thinking? -- Benchmarking Vision-Based Physics Reasoning

Scaling Computer-Use Grounding via User Interface Decomposition and Synthesis

Arbitrarily Applicable Same/Opposite Relational Responding with NARS

ShorterBetter: Guiding Reasoning Models to Find Optimal Inference Length for Efficient Reasoning

Behaviour Discovery and Attribution for Explainable Reinforcement Learning

Verification Learning: Make Unsupervised Neuro-Symbolic System Feasible

Chain-of-Thought Reasoning In The Wild Is Not Always Faithful

Activation Space Interventions Can Be Transferred Between Large Language Models

Planning of Heuristics: Strategic Planning on Large Language Models with Monte Carlo Tree Search for Automating Heuristic Optimization

MAGELLAN: Metacognitive predictions of learning progress guide autotelic LLM agents in large goal spaces

PatentScore: Multi-dimensional Evaluation of LLM-Generated Patent Claims

Created by

Haebom

저자

Yongmin Yoo, Qiongkai Xu, Longbing Cao

개요

본 논문은 대규모 언어 모델(LLM)이 생성한 특허 청구항의 품질 평가를 위한 다차원 평가 프레임워크인 PatentScore를 제안한다. 기존의 자연어 생성(NLG) 평가 지표는 특허 문서의 구조적, 법적 특성에 적합하지 않다는 점을 고려하여, PatentScore는 청구항 분석을 위한 계층적 분해, 법적 및 기술적 표준에 기반한 도메인 특정 검증 패턴, 구조적, 의미론적, 법적 차원에 걸친 점수 매기기를 통합한다. GPT-4, Claude-3.5-Haiku, Gemini-1.5-flash 등 다양한 LLM로 생성된 400개의 청구항 1에 대한 평가 결과 전문가 평가와 높은 상관관계(Pearson correlation $r = 0.819$)를 보이며, 기존 NLG 지표보다 우수한 성능을 나타낸다.

시사점, 한계점

•

시사점:

◦

LLM 기반 특허 생성 기술의 발전에 필수적인, 특허 청구항 평가를 위한 새로운 프레임워크를 제시한다.

◦

기존 NLG 지표의 한계를 극복하고, 특허 문서의 구조적, 법적 특성을 고려한 평가를 가능하게 한다.

◦

다양한 LLM에 대한 평가 결과를 통해 PatentScore의 견고성과 일반화 가능성을 확인한다.

◦

전문가 평가와의 높은 상관관계를 통해 PatentScore의 유효성을 입증한다.

•

한계점:

◦

현재는 청구항 1에 대한 평가에 국한되어 있으며, 다른 청구항 유형이나 특허 문서의 다른 부분에 대한 적용 가능성은 추가 연구가 필요하다.

◦

사용된 LLM의 종류가 제한적일 수 있으며, 더 다양한 LLM에 대한 평가가 필요하다.

◦

전문가 평가의 주관성이 결과에 영향을 미칠 수 있다.

◦

PatentScore의 계산 과정 및 구체적인 알고리즘에 대한 상세한 설명이 부족할 수 있다.

Made with Slashpage