Daily Arxiv

This page organizes papers related to artificial intelligence published around the world.
This page is summarized using Google Gemini and is operated on a non-profit basis.
The copyright of the paper belongs to the author and the relevant institution. When sharing, simply cite the source.

Quantum-Classical Hybrid Quantized Neural Network

Created by
  • Haebom

Author

Wenxin Li, Chuan Wang, Hongdong Zhu, Qi Gao, Yin Ma, Hai Wei, Kai Wen

Outline

This paper presents a novel quadratic binary optimization (QBO) model for quantified neural network training using quantum computing. Spline interpolation allows the use of arbitrary activation and loss functions. To address the challenges of nonlinearity and the multilayered structure of neural networks, we introduce the forward interval propagation (FIP) technique, which discretizes the activation function into linear subintervals. This method maintains the universal approximation properties of neural networks while enabling the optimization of complex nonlinear functions using quantum computers, broadening its applicability in artificial intelligence. From an optimization perspective, we derive the sample complexity of the empirical risk minimization problem, providing theoretical upper bounds on the approximation error and the required number of Ising spins. A key challenge in solving large-scale quadratic constrained binary optimization (QCBO) models is the presence of numerous constraints. To address this, we directly solve the QCBO problem using the quantum conditional gradient descent (QCGD) algorithm. We prove the convergence of QCGD under a quantum oracle with random and bounded variance objective function values and under the constraint of limited precision of the coefficient matrix, and provide an upper bound on the time-to-solution of the QCBO solution process. We also propose a training algorithm that incorporates single-sample bit-scale optimization.

Takeaways, Limitations

Takeaways:
A novel method for quantitative neural network training using quantum computing is presented.
Arbitrary activation and loss functions can be used via spline interpolation.
Solving nonlinear and multilayer problems using the FIP technique
Quantum computers can optimize complex nonlinear functions.
Provides theoretical upper bounds on approximation errors and the number of Ising spins
Efficient solution to the QCBO problem using the QCGD algorithm.
Proposed single-sample bit-scale optimization training algorithm
Limitations:
Difficulty in handling many constraints in large-scale QCBO problems (hyperparameter tuning problems occur when using penalty methods)
Implementation and performance evaluation of the QCGD algorithm on a real quantum computer are needed.
Experimental verification of the proposed method on a real neural network model is needed.
Analysis of the difference between the theoretical upper limit and actual performance is necessary.
👍