Daily Arxiv

전 세계에서 발간되는 인공지능 관련 논문을 정리하는 페이지 입니다.
본 페이지는 Google Gemini를 활용해 요약 정리하며, 비영리로 운영 됩니다.
논문에 대한 저작권은 저자 및 해당 기관에 있으며, 공유 시 출처만 명기하면 됩니다.

IG Parser: A Software Package for the Encoding of Institutional Statements using the Institutional Grammar

One-Step Offline Distillation of Diffusion-based Models via Koopman Modeling

J4R: Learning to Judge with Equivalent Initial State Group Relative Policy Optimization

Evaluating the efficacy of LLM Safety Solutions : The Palit Benchmark Dataset

From Assistants to Adversaries: Exploring the Security Risks of Mobile LLM Agents

Leveraging LLM Inconsistency to Boost Pass@k Performance

Sinusoidal Initialization, Time for a New Start

Enhancing Channel-Independent Time Series Forecasting via Cross-Variate Patch Embedding

Any-to-Any Learning in Computational Pathology via Triplet Multimodal Pretraining

Predicting Turn-Taking and Backchannel in Human-Machine Conversations Using Linguistic, Acoustic, and Visual Signals

ChromFound: Towards A Universal Foundation Model for Single-Cell Chromatin Accessibility Data

IP Leakage Attacks Targeting LLM-Based Multi-Agent Systems

RoboFAC: A Comprehensive Framework for Robotic Failure Analysis and Correction

LLM-DSE: Searching Accelerator Parameters with LLM Agents

Online Iterative Self-Alignment for Radiology Report Generation

Reachability Barrier Networks: Learning Hamilton-Jacobi Solutions for Smooth and Flexible Control Barrier Functions

Improving Medium Range Severe Weather Prediction through Transformer Post-processing of AI Weather Forecasts

BioCube: A Multimodal Dataset for Biodiversity Research

One Shot Dominance: Knowledge Poisoning Attack on Retrieval-Augmented Generation Systems

TCC-Bench: Benchmarking the Traditional Chinese Culture Understanding Capabilities of MLLMs

FALCON: False-Negative Aware Learning of Contrastive Negatives in Vision-Language Pretraining

GRoQ-Loco: Generalist and Robot-agnostic Quadruped Locomotion Control using Offline Datasets

Who You Are Matters: Bridging Topics and Social Roles via LLM-Enhanced Logical Recommendation

Artificial Intelligence Bias on English Language Learners in Automatic Scoring

Learning Long-Context Diffusion Policies via Past-Token Prediction

Fast Text-to-Audio Generation with Adversarial Post-Training

Unified Continuous Generative Models

Can LLM-based Financial Investing Strategies Outperform the Market in Long Run?

Technical Report: Quantifying and Analyzing the Generalization Power of a DNN

Prompting Large Language Models for Training-Free Non-Intrusive Load Monitoring

On-Device LLM for Context-Aware Wi-Fi Roaming

Efficient Fine-Tuning of Quantized Models via Adaptive Rank and Bitwidth

Understanding University Students' Use of Generative AI: The Roles of Demographics and Personality Traits

Adaptive Thinking via Mode Policy Optimization for Social Language Agents

LLM-hRIC: LLM-empowered Hierarchical RAN Intelligent Control for O-RAN

On the Boolean Network Theory of Datalog$^\neg$

Learning to Reason under Off-Policy Guidance

How Effective Can Dropout Be in Multiple Instance Learning ?

Learning Joint ID-Textual Representation for ID-Preserving Image Synthesis

Walk the Talk? Measuring the Faithfulness of Large Language Model Explanations

Cross-Document Cross-Lingual NLI via RST-Enhanced Graph Fusion and Interpretability Prediction

S1-Bench: A Simple Benchmark for Evaluating System 1 Thinking Capability of Large Reasoning Models

Beyond Self-Reports: Multi-Observer Agents for Personality Assessment in Large Language Models

Scaling Video-Language Models to 10K Frames via Hierarchical Differential Distillation

Scaling Test-Time Inference with Policy-Optimized, Dynamic Retrieval-Augmented Generation via KV Caching and Decoding

Breaking Language Barriers in Visual Language Models via Multilingual Textual Regularization

LogicQA: Logical Anomaly Detection with Vision Language Model Generated Questions

Conjuring Positive Pairs for Efficient Unification of Representation Learning and Image Synthesis

CRCE: Coreference-Retention Concept Erasure in Text-to-Image Diffusion Models

LED: LLM Enhanced Open-Vocabulary Object Detection without Human Curated Data Generation

MirrorShield: Towards Universal Defense Against Jailbreaks via Entropy-Guided Mirror Crafting

HICD: Hallucination-Inducing via Attention Dispersion for Contrastive Decoding to Mitigate Hallucinations in Large Language Models

RouterEval: A Comprehensive Benchmark for Routing LLMs to Explore Model-level Scaling Up in LLMs

Language Models, Graph Searching, and Supervision Adulteration: When More Supervision is Less and How to Make More More

Cost-Optimal Grouped-Query Attention for Long-Context Modeling

Beyond Matryoshka: Revisiting Sparse Coding for Adaptive Representation

On the Vulnerability of Concept Erasure in Diffusion Models

Char-mander Use mBackdoor! A Study of Cross-lingual Backdoor Attacks in Multilingual LLMs

SQLong: Enhanced NL2SQL for Longer Contexts with LLMs

DiffSampling: Enhancing Diversity and Accuracy in Neural Text Generation

TreeCut: A Synthetic Unanswerable Math Word Problem Dataset for LLM Hallucination Evaluation

Attention Mechanism for LLM-based Agents Dynamic Diffusion under Information Asymmetry

Robust Adaptation of Large Multimodal Models for Retrieval Augmented Hateful Meme Detection

R2-KG: General-Purpose Dual-Agent Framework for Reliable Reasoning on Knowledge Graphs

DeepResonance: Enhancing Multimodal Music Understanding via Music-centric Multi-way Instruction Tuning

MomentSeeker: A Task-Oriented Benchmark For Long-Video Moment Retrieval

EquiBench: Benchmarking Large Language Models' Understanding of Program Semantics via Equivalence Checking

EssayJudge: A Multi-Granular Benchmark for Assessing Automated Essay Scoring Capabilities of Multimodal Large Language Models

Uncovering Untapped Potential in Sample-Efficient World Model Agents

MMUnlearner: Reformulating Multimodal Machine Unlearning in the Era of Multimodal Large Language Models

CoLA: Compute-Efficient Pre-Training of LLMs via Low-Rank Activation

AI-driven Personalized Privacy Assistants: a Systematic Literature Review

Early Risk Prediction of Pediatric Cardiac Arrest from Electronic Health Records via Multimodal Fused Transformer

Online Scheduling for LLM Inference with KV Cache Constraints

Uni-Retrieval: A Multi-Style Retrieval Framework for STEM's Education

Speculative Prefill: Turbocharging TTFT with Lightweight and Training-Free Token Importance Estimation

Latent Action Learning Requires Supervision in the Presence of Distractors

Redefining Machine Unlearning: A Conformal Prediction-Motivated Approach

On the Role of Transformer Feed-Forward Layers in Nonlinear In-Context Learning

People who frequently use ChatGPT for writing tasks are accurate and robust detectors of AI-generated text

NBDI: A Simple and Effective Termination Condition for Skill Extraction from Task-Agnostic Demonstrations

MMDocIR: Benchmarking Multi-Modal Retrieval for Long Documents

Building Symbiotic AI: Reviewing the AI Act for a Human-Centred, Principle-Based Framework

TiEBe: Tracking Language Model Recall of Notable Worldwide Events Through Time

xLSTM-SENet: xLSTM for Single-Channel Speech Enhancement

A Separable Self-attention Inspired by the State Space Model for Computer Vision

Cross-model Transferability among Large Language Models on the Platonic Representations of Concepts

KunServe: Efficient Parameter-centric Memory Management for LLM Serving

Hotspot-Driven Peptide Design via Multi-Fragment Autoregressive Extension

Can LLMs be Good Graph Judge for Knowledge Graph Construction?

RoCoDA: Counterfactual Data Augmentation for Data-Efficient Robot Learning from Demonstrations

Rate, Explain and Cite (REC): Enhanced Explanation and Attribution in Automatic Evaluation by Large Language Models

Knowledge-Guided Prompt Learning for Request Quality Assurance in Public Code Review

Scaling Stick-Breaking Attention: An Efficient Implementation and In-depth Study

M-RewardBench: Evaluating Reward Models in Multilingual Settings

Unlearning Backdoor Attacks for LLMs with Weak-to-Strong Knowledge Distillation

RATE: Causal Explainability of Reward Models with Imperfect Counterfactuals

Bayes Adaptive Monte Carlo Tree Search for Offline Model-based Reinforcement Learning

Large Continual Instruction Assistant

TopoTune : A Framework for Generalized Combinatorial Complex Neural Networks

Artificial Intelligence Bias on English Language Learners in Automatic Scoring

Created by

Haebom

저자

Shuchen Guo, Yun Wang, Jichao Yu, Xuansheng Wu, Bilgehan Ayik, Field M. Watts, Ehsan Latif, Ninghao Liu, Lei Liu, Xiaoming Zhai

개요

본 연구는 중학교 과학 평가에 대한 학생들의 서술형 답변을 자동 채점 시스템으로 채점할 때, 영어 학습자(ELLs)에 대한 잠재적인 채점 편향과 불균형을 조사했습니다. 특히, ELLs가 불균형적으로 포함된 훈련 데이터가 채점 편향과 불균형에 어떻게 기여하는지 조사하는 데 중점을 두었습니다. BERT 모델을 네 가지 데이터셋(1) ELLs만, (2) 비-ELLs만, (3) 실제 ELLs와 비-ELLs 비율을 반영한 불균형 데이터셋, (4) ELLs와 비-ELLs가 균등하게 포함된 균형 데이터셋)으로 미세 조정했습니다. 21개의 평가 항목(ELL 응답 약 30,000개 항목 10개, 약 1,000개 항목 5개, 약 200개 항목 6개)을 분석하여 Friedman 검정을 사용하여 편향을 확인하고 채점 정확도(Acc)를 비교했습니다. ELLs와 비-ELLs 간의 평균 점수 차이(MSGs)를 측정하고, 사람과 AI 모델 모두에서 생성된 MSGs의 차이를 계산하여 채점 불균형을 확인했습니다. 훈련 데이터셋이 충분히 클 경우(ELL = 30,000 및 ELL = 1,000) AI 편향 및 ELLs와 비-ELLs 간의 왜곡된 불균형은 발견되지 않았지만, 표본 크기가 제한적인 경우(ELL = 200) 문제가 발생할 수 있음을 발견했습니다.

시사점, 한계점

•

시사점: 충분한 크기의 ELL 데이터를 포함한 훈련 데이터셋을 사용하면 자동 채점 시스템의 ELLs에 대한 채점 편향을 최소화할 수 있습니다. 대규모 데이터셋을 활용한 AI 기반 자동 채점 시스템은 공정한 평가에 기여할 수 있습니다.

•

한계점: ELL 데이터의 크기가 작을 경우 자동 채점 시스템의 편향 및 불균형이 발생할 수 있습니다. 본 연구는 특정 연령대(중학교)와 과목(과학)에 국한되어 일반화에 제약이 있을 수 있습니다. 다양한 평가 유형과 더욱 다양한 인구 통계적 특징을 가진 데이터셋을 사용한 추가 연구가 필요합니다.

Made with Slashpage