[공지사항]을 빙자한 안부와 근황

Show more

Daily Arxiv

전 세계에서 발간되는 인공지능 관련 논문을 정리하는 페이지 입니다.
본 페이지는 Google Gemini를 활용해 요약 정리하며, 비영리로 운영 됩니다.
논문에 대한 저작권은 저자 및 해당 기관에 있으며, 공유 시 출처만 명기하면 됩니다.

SystolicAttention: Fusing FlashAttention within a Single Systolic Array

Automated Novelty Evaluation of Academic Paper: A Collaborative Approach Integrating Human and Large Language Model Knowledge

"Is it always watching? Is it always listening?" Exploring Contextual Privacy and Security Concerns Toward Domestic Social Robots

A Group Theoretic Analysis of the Symmetries Underlying Base Addition and Their Learnability by Neural Networks

GHPO: Adaptive Guidance for Stable and Efficient LLM Reinforcement Learning

Extension OL-MDISF: Online Learning from Mix-Typed, Drifted, and Incomplete Streaming Features

When and Where do Data Poisons Attack Textual Inversion?

Truth Sleuth and Trend Bender: AI Agents to fact-check YouTube videos and influence opinions

NLP Meets the World: Toward Improving Conversations With the Public About Natural Language Processing Research

Accurate generation of chemical reaction transition states by conditional flow matching

Benchmarking and Evaluation of AI Models in Biology: Outcomes and Recommendations from the CZI Virtual Cells Workshop

A PBN-RL-XAI Framework for Discovering a "Hit-and-Run" Therapeutic Strategy in Melanoma

NeuTSFlow: Modeling Continuous Functions Behind Time Series Forecasting

THOR: Transformer Heuristics for On-Demand Retrieval

Towards Agentic RAG with Deep Reasoning: A Survey of RAG-Reasoning Systems in LLMs

Bridging Literature and the Universe Via A Multi-Agent Large Language Model System

Magneto-radiative modelling and artificial neural network optimization of biofluid flow in a stenosed arterial domain

Symbiosis: Multi-Adapter Inference and Fine-Tuning

Rethinking Data Protection in the (Generative) Artificial Intelligence Era

SoK: Semantic Privacy in Large Language Models

FedRef: Communication-Efficient Bayesian Fine Tuning with Reference Model

Predictable Scale: Part II, Farseer: A Refined Scaling Law in Large Language Models

Position Prediction Self-Supervised Learning for Multimodal Satellite Imagery Semantic Segmentation

ScaleRTL: Scaling LLMs with Reasoning Data and Test-Time Compute for Accurate RTL Code Generation

HueManity: Probing Fine-Grained Visual Perception in MLLMs

AKReF: An argumentative knowledge representation framework for structured argumentation

Large Language Models Often Know When They Are Being Evaluated

Dynamic Risk Assessments for Offensive Cybersecurity Agents

How Hungry is AI? Benchmarking Energy, Water, and Carbon Footprint of LLM Inference

Diffused Responsibility: Analyzing the Energy Consumption of Generative Text-to-Audio Diffusion Models

Flow-GRPO: Training Flow Matching Models via Online RL

On the Need for a Statistical Foundation in Scenario-Based Testing of Autonomous Vehicles

What's Pulling the Strings? Evaluating Integrity and Attribution in AI Training and Inference through Concept Shift

TD-EVAL: Revisiting Task-Oriented Dialogue Evaluation by Combining Turn-Level Precision with Dialogue-Level Comparisons

MobileCity: An Efficient Framework for Large-Scale Urban Behavior Simulation

Semantic Adapter for Universal Text Embeddings: Diagnosing and Mitigating Negation Blindness to Enhance Universality

Leveraging LLMs for User Stories in AI Systems: UStAI Dataset

Large Language Models are Unreliable for Cyber Threat Intelligence

AnnoPage Dataset: Dataset of Non-Textual Elements in Documents with Fine-Grained Categorization

A Thorough Assessment of the Non-IID Data Impact in Federated Learning

Visual Position Prompt for MLLM based Visual Grounding

Neurons: Emulating the Human Visual Cortex Improves Fidelity and Interpretability in fMRI-to-Video Reconstruction

FADE: Why Bad Descriptions Happen to Good Features

FlipConcept: Tuning-Free Multi-Concept Personalization for Text-to-Image Generation

LUMINA-Net: Low-light Upgrade through Multi-stage Illumination and Noise Adaptation Network for Image Enhancement

Towards Geo-Culturally Grounded LLM Generations

Learning to Reason at the Frontier of Learnability

Flexible and Efficient Grammar-Constrained Decoding

PATCH: a deep learning method to assess heterogeneity of artistic practice in historical paintings

The Impact of Modern AI in Metadata Management

Learning an Effective Premise Retrieval Model for Efficient Mathematical Formalization

ChipAlign: Instruction Alignment in Large Language Models for Chip Design via Geodesic Interpolation

Many Objective Problems Where Crossover is Provably Essential

Patherea: Cell Detection and Classification for the 2020s

ViTally Consistent: Scaling Biological Representation Learning for Cell Microscopy

TextDestroyer: A Training- and Annotation-Free Diffusion Method for Destroying Anomal Text from Images

Quantifying calibration error in modern neural networks through evidence based theory

Multi-view biomedical foundation models for molecule-target and property prediction

Reinforced Imitative Trajectory Planning for Urban Automated Driving

Distilling Invariant Representations with Dual Augmentation

Tackling the Abstraction and Reasoning Corpus with Vision Transformers: the Importance of 2D Representation, Positions, and Objects

Linearly-Interpretable Concept Embedding Models for Text Analysis

Towards Understanding Link Predictor Generalizability Under Distribution Shifts

StreakNet-Arch: An Anti-scattering Network-based Architecture for Underwater Carrier LiDAR-Radar Imaging

Enhancing Trust in Autonomous Agents: An Architecture for Accountability and Explainability through Blockchain and Large Language Models

On the Statistical Properties of Generative Adversarial Models for Low Intrinsic Data Dimension

Programming Distributed Collective Processes in the eXchange Calculus

Holistic analysis on the sustainability of Federated Learning across AI product lifecycle

Mathematical Introduction to Deep Learning: Methods, Implementations, and Theory

Epic-Sounds: A Large-scale Dataset of Actions That Sound

From Semantic Web and MAS to Agentic AI: A Unified Narrative of the Web of Agents

On Gradual Semantics for Assumption-Based Argumentation

The Challenge of Teaching Reasoning to LLMs Without RL or Distillation

Continuous Classification Aggregation

Can Prompt Difficulty be Online Predicted for Accelerating RL Finetuning of Reasoning Models?

macOSWorld: A Multilingual Interactive Benchmark for GUI Agents

GeoChain: Multimodal Chain-of-Thought for Geographic Reasoning

Lost in Transmission: When and Why LLMs Fail to Reason Globally

A Survey of Frontiers in LLM Reasoning: Inference Scaling, Learning to Reason, and Agentic Systems

System 0/1/2/3: Quad-process theory for multi-timescale embodied collective cognitive systems

Practical Principles for AI Cost and Compute Accounting

Generative Emergent Communication: Large Language Model is a Collective World Model

Proactive Agents for Multi-Turn Text-to-Image Generation Under Uncertainty

Learning Lifted STRIPS Models from Action Traces Alone: A Simple, General, and Scalable Solution

Hallucination Detox: Sensitivity Dropout (SenD) for Large Language Model Training

Life, uh, Finds a Way: Hyperadaptability by Behavioral Search

Governance of Generative Artificial Intelligence for Companies

RACER: Rational Artificial Intelligence Car-following-model Enhanced by Reality

Artificial Intelligence Governance for Businesses

Interpreting Radiologist's Intention from Eye Movements in Chest X-ray Diagnosis

S2WTM: Spherical Sliced-Wasserstein Autoencoder for Topic Modeling

LLM-Based Config Synthesis requires Disambiguation

Characterizing State Space Model (SSM) and SSM-Transformer Hybrid Language Model Performance with Long Context Length

EgoVLA: Learning Vision-Language-Action Models from Egocentric Human Videos

Can We Predict Alignment Before Models Finish Thinking? Towards Monitoring Misaligned Reasoning Models

Unit-Based Histopathology Tissue Segmentation via Multi-Level Feature Representation

Advancing Retrieval-Augmented Generation for Structured Enterprise and Internal Data

Mixture of Raytraced Experts

QuRe: Query-Relevant Retrieval through Hard Negative Sampling in Composed Image Retrieval

AutoVDC: Automated Vision Data Cleaning Using Vision-Language Models

macOSWorld: A Multilingual Interactive Benchmark for GUI Agents

Created by

Haebom

저자

Pei Yang, Hai Ci, Mike Zheng Shou

개요

macOSWorld는 macOS 환경에서 GUI 에이전트를 평가하기 위한 최초의 종합적인 벤치마크입니다. 30개 애플리케이션(28개는 macOS 전용)에 걸쳐 5개 언어(영어, 중국어, 아랍어, 일본어, 러시아어)로 제공되는 202개의 다국어 상호작용 과제를 특징으로 합니다. 기존 벤치마크의 한계(영어 중심, 특정 OS 환경 집중)를 극복하고 macOS의 고유한 GUI 패턴과 애플리케이션을 포함합니다. 또한 GUI 에이전트의 속임수 공격 취약성을 고려하여 안전성 벤치마킹 하위 집합도 포함하고 있습니다. 6개의 GUI 에이전트에 대한 평가 결과, 독점적 컴퓨터 사용 에이전트는 30% 이상의 성공률을 보였지만 오픈소스 경량 연구 모델은 5% 미만의 성공률을 보여 macOS 도메인 적응의 필요성을 강조합니다. 다국어 벤치마크는 특히 아랍어에서 영어 대비 평균 28.8%의 성능 저하를 보이며 공통적인 약점을 드러냅니다. 안전성 벤치마킹 결과는 속임수 공격이 더 일반적이며 즉각적인 주의가 필요함을 강조합니다. macOSWorld는 https://github.com/showlab/macosworld 에서 이용 가능합니다.

GitHub - showlab/macosworld

Contribute to showlab/macosworld development by creating an account on GitHub.

시사점, 한계점

•

시사점:

◦

macOS 환경에서 GUI 에이전트 성능 평가를 위한 최초의 종합적인 벤치마크 제공.

◦

macOS 전용 애플리케이션 및 다국어 지원을 통한 기존 벤치마크의 한계 극복.

◦

GUI 에이전트의 속임수 공격 취약성을 보여주는 안전성 벤치마킹 결과 제시.

◦

오픈소스 모델과 독점 모델 간 성능 차이를 통한 macOS 도메인 적응의 중요성 강조.

◦

다국어 지원을 통한 언어별 성능 차이 분석 및 개선 방향 제시.

•

한계점:

◦

현재 벤치마크에 포함된 GUI 에이전트의 종류가 제한적일 수 있음.

◦

더 다양한 유형의 속임수 공격에 대한 평가가 필요할 수 있음.

◦

macOSWorld가 macOS 특유의 환경에 최적화되어 다른 OS 환경으로의 일반화에 제약이 있을 수 있음.

◦

평가에 사용된 GUI 에이전트의 종류와 특성에 대한 상세한 설명이 부족할 수 있음.

Made with Slashpage