Can I read KAE: Kolmogorov-Arnold Auto-Encoder for Representation Learning on EtoBox?

KAE: Kolmogorov-Arnold Auto-Encoder for Representation Learning by Yu, Fangchen; Hu, Ruilizhen; Lin, Yidong; Ma, Yuqi; Huang, Zhenghao; Li, Wenye is a scholarly article available to read on EtoBox.

What is KAE: Kolmogorov-Arnold Auto-Encoder for Representation Learning about?

The Kolmogorov-Arnold Network (KAN) has recently gained attention as an alternative to traditional multi-layer perceptrons (MLPs), offering improved accuracy and interpretability by employing learnable activation functions on edges. In this paper, we introduce the Kolmogorov-Arnold Auto-Encoder (KAE), which integrates KAN with autoencoders (AEs) to enhance representation learning for retrieval, classification, and denoising tasks. Leveraging the flexible polynomial functions in KAN layers, KAE captures complex data patterns and non-linear relationships. Experiments on benchmark datasets demonstrate that KAE improves latent representation quality, reduces reconstruction errors, and achieves superior performance in downstream tasks such as retrieval, classification, and denoising, compared to standard autoencoders and other KAN variants. These results suggest KAE's potential as a useful tool for representation learning. Our code is available at \url{https://github.com/SciYu/KAE/}.

Author

Yu, Fangchen; Hu, Ruilizhen; Lin, Yidong; Ma, Yuqi; Huang, Zhenghao; Li, Wenye

Published

2024

Language

EN