[공지사항]을 빙자한 안부와 근황 
Show more

Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

Merge Kernel for Bayesian Optimization on Permutation Space

Created by
  • Haebom

Author

Zikai Xie, Linjiang Chen

Outline

This paper presents a Bayesian optimization (BO) algorithm for black-box optimization problems in permutation space. Existing state-of-the-art BO approaches rely on the Mallows kernel, which explicitly enumerates all pairwise comparisons and has Ω(n²) complexity. Inspired by the close relationship between the Mallows kernel and pairwise comparisons, this paper proposes a novel framework for generating kernel functions in permutation space based on sorting algorithms. Within this framework, the Mallows kernel can be viewed as a special instance derived from bubble sort. Furthermore, we present a Merge kernel constructed from merge sort, which replaces quadratic complexity with Θ(n log n) to achieve the lowest complexity. The resulting feature vector is significantly shorter and can be computed in linear-log time, while still efficiently capturing meaningful permutation distances. To improve robustness and right-hand side invariance while maintaining compactness, we additionally incorporate three lightweight, operation-independent descriptors: shift histogram, split-pair line, and sliding-window motifs. Experimental evaluations show that the proposed kernel consistently outperforms the state-of-the-art Mallows kernel on a variety of permutation optimization benchmarks. The results confirm that the Merge kernel provides a more compact and efficient solution to Bayesian optimization in permutation space.

Takeaways, Limitations

Takeaways:
A new framework for Bayesian optimization in permutation spaces: Kernel function generation based on sorting algorithms.
Solving the quadratic complexity problem of the Mallows kernel: Achieving Θ(n log n) complexity via the Merge kernel.
A more compact and efficient permutation distance measure: Efficiently capturing meaningful permutation distances with merge kernels and additional descriptors.
Achieving state-of-the-art performance on various benchmarks: The proposed kernel is demonstrated to outperform the existing Mallows kernel.
Limitations:
Further research is needed on the applicability and limitations of the proposed framework to general sorting algorithms.
Further analysis is needed on the optimal combination and generalizability of the three added descriptors.
Performance evaluation is required for certain types of permutation optimization problems.
Further experiments and analysis are needed to determine scalability in high-dimensional permutation spaces.
👍