TimeKAN: A Transparent KAN-Based Approach for Multivariate Time Series Forecasting
Multi-variate Time Series (MTS) Forecasting;Kolmogorov-Arnold Networks (KAN);White Box;Multi-scale modelling
Yes
No ethics review needed.
1. ​The proposed method lacks novelty and introduces a new architecture in time series prediction, but there is insufficient theoretical justification for the benefits of introducing KAN into time series prediction.​

2. The paper emphasizes that KAN has fewer parameters compared to MLP, yet it lacks a comparative analysis of parameter counts and effectiveness against existing MLP-based models such as Dlinear, Nbeats, RLinear, and Transformer-based models.

3. Experimental comparisons with baselines are not fully fair, as they lack tests on multidimensional datasets such as ECL and Traffic, which include more channels and larger data sizes.  Some advanced time series models such as iTransformer can better accommodate these prediction scenarios.

4. Ablation studies are incomplete and require a thorough comparison across all datasets, rather than just some small datasets ETT and Exchange. Moreover, the improvement from replacing MLP with KAN on existing datasets is not significant. This conclusion can be seen by the relative improvement in prediction performance.​
1. This paper attempts to introduce the KAN and a Multi-Scale Patching module  for time series forecasting, aiming to achieve lower model parameters and better prediction performance.

2. Try to explore the predictive and interpretable capabilities of the proposed method in time series.​
In this paper, TimeKAN, a Kolmogorov-Arnold network based time series model, is proposed and demonstrate state-of-the-art prediction performance on some real-world datasets.
​Lack of comprehensive explanation and analysis of the benefits of introducing new architectures in place of well-used model modules and incomplete experimental validation.​
Yes
No ethics review needed.
1. Could you give more explanation on the notations $x_1, ..., x_5$ in Figure 1 and $X_6, ..., X_{10}$ in Figure 5?
2. In the experiments, why did you choose not to use ECL and Traffic datasets? They are also well-established multivariate forecasting benchmarks similar to ETT.
3. Could you provide more discussion on the experimental results in Table 2? Why did the number of MSPs introduce such a large fluctuation in the results?
4. Could you provide some intuitive showcase of the prediction results?
1. This paper introduces Kolmogorov-Arnold Networks to time series data to improve the performance and interpretability.
2. The method is simple and intuitively effective.
The article proposes TimeKAN, a model based on Kolmogorov-Arnold Networks for multivariate time series forecasting. TimeKan employs symbolization techniques to represent the learned features and visualize the training process, addressing the interpretability challenge. Experimentally, TimeKAN outperforms state-of-the-art (SOTA) methods in terms of predictive performance.
1. The overall novelty is limited. Since the hierarchical decomposition architectures have already been studied by N-BEATS and N-HiTs, the patch size selecting method is similar to the existing TimesNet.
2. Although the authors have included some MLP-based as baselines, some highly-related works is omitted, such as N-BEATS [1] and Pathformer [2].
[1] Oreshkin, Boris N., et al. "N-BEATS: Neural basis expansion analysis for interpretable time series forecasting." ICLR 2020.
[2] Chen, Peng, et al. "Pathformer: Multi-scale transformers with adaptive pathways for time series forecasting." ICLR 2024.
3. Since the author argues that existing MLP-based and Transformer-based models lack interpretability due to their large parameter sizes (Line 15), and propose the effective TimeKAN, detailed efficiency analysis is required.
Yes
No ethics review needed.
As is commented in Weakness.
1. TimeKAN enhances model interpretability through symbolic regression, allowing for the extraction of human-readable models that explain underlying data patterns. The model achieves comparable accuracy to MLPs with significantly fewer parameters, which is beneficial for computational efficiency and model training.
2. The MSP module effectively captures multi-period dependencies between variates, allowing the model to focus on a broader spectrum of temporal patterns. And TimeKAN outperforms existing methods, including both MLP-based and Transformer-based architectures, across various datasets and forecasting horizons.
The paper introduces TimeKAN, a novel approach for multivariate time series forecasting that leverages Kolmogorov-Arnold Networks (KAN) and a Multi-Scale Patching (MSP) module. TimeKAN addresses the challenges of interpretability and parameter efficiency while maintaining high predictive accuracy. The model captures both temporal and cross-dimensional features across various scales and provides insights into its decision-making process through symbolic feature extraction.
1. TimeKAN may not be the best performer in ETTm2, as indicated by MSD-Mixer outperforming it for every output length. The effectiveness of the MSP module relies on the determination of patching sizes through FFT, which may introduce complexity in data preprocessing.
2. The paper primarily focuses on performance on seen datasets, and it is unclear how TimeKAN would generalize to unseen or significantly different data distributions. While the model is parameter-efficient, the computational cost of training and inference, especially for real-time scenarios, is not explicitly addressed.
3. The paper could benefit from a more detailed discussion on scenarios where TimeKAN may underperform or fail, which would aid in understanding its limitations.
Yes
No ethics review needed.
Computational complexity: Considering the potential overhead introduced by the MSP module, could you discuss any optimizations you are considering to improve the performance of the model on large datasets or ultra long sequences?

Symbolic representation generalization: Have you tested symbolic feature interpretation in other types of data, such as biological or industrial datasets? How common is this interpretable feature in areas outside of your experiment?

Long term prediction: How will TimeKAN's performance decline in very long-term predictions? For example, does the model maintain accuracy in predicting the next few weeks, and in these cases, how does it compare to simpler models such as DLlinear?
Originality: In the context of multivariate time series prediction, using Kolmogorov Arnold network (KAN) to bridge the gap between interpretability and accuracy is a new approach. KAN allows for symbolic representation of learned features, which improves the transparency of the model compared to deep learning models, especially in Transformer based architectures that often lack interpretability.

Quality: The design of the MSP module is particularly noteworthy as it captures temporal dependencies at different scales. By dividing the input sequence into patches of different sizes, this model can capture short-term and long-term dependencies. The experimental section clearly demonstrated that the model consistently outperforms state-of-the-art models on six benchmark datasets, including ETT, Weather, and Exchange.

Clarity: This article provides a clear explanation of the architecture innovation of TimeKAN, particularly the detailed decomposition of multi-scale patching mechanisms (pages 6-7) and the symbolic regression technique used to explain learning representations. The addition of visualization tools further increases the transparency of the model.
The paper titled "TimeKAN: A Transparent KAN based Multivariate Time Series Prediction Method" introduces TimeKAN, a new method for multivariate time series forecasting (MTSF) using Kolmogorov Arnold network (KAN). TimeKAN addresses challenges such as lack of interpretability and difficulty in capturing long-term dependencies and cross dimensional relationships in MTSF. This model introduces a Multi Scale Splicing (MSP) module to capture features at different temporal resolutions, while using symbolic techniques to enhance interpretability by visualizing the features. Extensive experiments on six real-world datasets have shown that TimeKAN outperforms state-of-the-art models in both prediction accuracy and interpretability, making it highly suitable for complex time series tasks.
Computational efficiency: Although TimeKAN has strong predictive accuracy, its computational efficiency on very large datasets or ultra long sequences may become a bottleneck. The MSP module increases the complexity of the model by generating multiple patch sizes, which may result in high computational costs, especially when applied to datasets outside of those included in the experiment. It would be beneficial to discuss in more detail the potential of parallelization or distributed training to alleviate this situation.

Extension to other fields: Although the datasets used for evaluation are diverse, they are limited to specific fields such as energy, meteorology, and finance. There is no detailed exploration of extending symbolic feature representation to other fields, such as biological or industrial time series data. Future work may include verifying the interpretability of TimeKAN in more diverse fields.
TimeKAN is an interpretable, KAN-based model for multivariate time series forecasting that uses fewer parameters and a novel multi-scale patching module to achieve state-of-the-art predictive performance.
@inproceedings{
anonymous2024timekan,
title={Time{KAN}: A Transparent {KAN}-Based Approach for Multivariate Time Series Forecasting},
author={Anonymous},
booktitle={Submitted to The Thirteenth International Conference on Learning Representations},
year={2024},
url={https://openreview.net/forum?id=9KNnSvUxLl},
note={under review}
}
In recent years, numerous deep learning models have been proposed for Multi-variate Time Series (MTS) forecasting, with Transformer-based models showing significant potential due to their ability to capture long-term dependencies. However, existing models based on MLPs or Transformers often suffer from a lack of interpretability due to their large parameter sizes, which can be problematic in many real-world applications. To address this issue, we propose TimeKAN, a model based on Kolmogorov-Arnold Networks. The KAN model offers two key advantages: (1) it achieves accuracy comparable to MLPs with significantly fewer parameters, and (2) its parameters can be symbolized, which makes it possible to interpret the meaning of the parameters. Additionally, instead of the usual attention mechanisms, we designed a Multi-Scale Patching (MSP) module for MTS that allows for more flexible and simple multi-patching and effectively extracts both temporal and cross-dimensional features. By leveraging this strategy along with KAN, TimeKAN constructs a hierarchical structure capable of utilizing information across different scales, leading to highly accurate predictions. Extensive experiments on six real-world datasets demonstrate that TimeKAN outperforms state-of-the-art (SOTA) methods in terms of predictive performance. Furthermore, we interpret TimeKAN by visualizing its learning process for extracting symbolized features, opening the black box and revealing meaningful patterns within the time series.
I certify that there is no URL (e.g., github page) that could be used to find authors’ identity.
I acknowledge that I and all co-authors of this work have read and commit to adhering to the ICLR Code of Ethics.
Multi-variate Time Series (MTS) Forecasting Kolmogorov-Arnold Networks (KAN) White Box Multi-scale modelling
I certify that there is no acknowledgement section in this submission for double blind review.
/pdf/8af16276f146d8be623d9d970157649007dc7715.pdf
learning on time series and dynamical systems
I understand the reciprocal reviewing requirement as described on https://iclr.cc/Conferences/2025/CallForPapers. If none of the authors are registered as a reviewer, it may result in a desk rejection at the discretion of the program chairs. To request an exception, please complete this form at https://forms.gle/Huojr6VjkFxiQsUp6.
I certify that this submission complies with the submission instructions as described on https://iclr.cc/Conferences/2025/AuthorGuide.
/attachment/bb4b6a27b40038893a51cfff4316bbd17e6082f5.zip
TimeKAN: A Transparent KAN-Based Approach for Multivariate Time Series Forecasting
ICLR 2025 Conference Submission
ICLR.cc/2025/Conference/Submission