Spatial-temporal Graph Attention Network for Forex Forecasting with Hierarchical Transformer
Graph Attention Networks;Transformer;Forex Forecasting
Yes
No ethics review needed.
1.	Could you provide some cases and analysis for graph construction?
2.	Were experiments conducted on currencies other than the Chinese Yuan?
3.	Given that research on Forex rate prediction is limited, have you considered using methods from stock prediction as a baseline, since they are similar?
1.	The model architecture is novel, introducing a spatial-temporal graph attention network and hierarchical transformer for Forex rate forecasting.
2.	The presentation of methods is clear, and the performance metrics, MAE and RMSE, are reasonable.
3.	The research contributes to financial time series analysis and can be generalized to other domains like stock prediction.
This paper introduces a novel Spatial-Temporal Graph Attention Network with Hierarchical Transformer (STGAT).
1.	The combination of spatial graph convolutions with transformers has been explored in other domains, and the paper does not adequately highlight the unique challenges of Forex forecasting that the proposed model addresses.
2.	In the experiments part, line 316, the dataset of 17 currencies against the Chinese Yuan is limited. It should be discussed whether the chosen data can generalize to other market behaviors.
3.	The performance of graph construction from line 230 with k-means should be examined to determine if the final graph accurately represents the real situation, you should give analysis in the experiment part.
Yes
No ethics review needed.
Q1: For W2, could you provide a more detailed description of each module’s inputs and outputs?
Q2: For W4, could you analyze the model's performance on both long-input and short-input scenarios? Additionally, please specify how many future time steps your model is predicting.
Q3: For W5, could you include an analysis of these financial events? For example, identify specific phases where predictions were less accurate, possibly due to complex financial conditions coinciding with particular events.
S1: The combination of spatial graph convolutions and dual-view temporal transformers addresses the limitations of traditional forex models by capturing inter-currency dependencies and effectively handling long-range temporal dependencies for improved prediction accuracy.

S2: The implementation of a linear attention mechanism reduces computational complexity, enhancing the model’s suitability for large-scale forex data involving numerous currency pairs.
This paper proposes a Spatial-Temporal Graph Attention Network with hierarchical transformer (STGAT) architecture for predicting forex rate. This model addresses two major challenges in forex rate prediction: (1) capturing interdependencies among different currencies and (2) managing long-range temporal dependencies. STGAT combines spatial graph convolutions with a dual-view temporal transformer, incorporating a novel temporal linearity graph attention network (TLGAT) for efficiency. The model outperformed ten baseline models across three categories (regression-based, transformer-based, and GNN-based) in experiments with 17 currencies over 2,092 trading days.
W1: There are minor typographical issues in the paper: "firstly" is repeated on lines 240 and 243; "EXPERIMENTAL SETTTINGS" on line 313 should be "EXPERIMENTAL SETTINGS"; and "Traing setup" on line 321 should be corrected to "Training setup."

W2: The description of the model's input and output in Figure 2 is unclear.

W3: The paper's writing has considerable room for improvement, as the definitions of symbols in the methodology section are rather ambiguous.

W4:While you claim that your model effectively captures long-term dependencies, the experimental setup lacks clarification on the number of time steps used as the model's input.
W5: In Section 3.3, where you mention that "as a result of the Brexit event, there will be an increase in the volatility of the Pound, especially in the face of uncertain events," it would strengthen your analysis to include specific examples. For instance, in 2023, when the U.S. Federal Reserve raised interest rates, the resulting increase in the dollar’s exchange rate impacted forex rates globally, leading to a depreciation in other currencies, especially those with close economic ties to the U.S. Similarly, other geopolitical or economic shifts, such as fluctuations in oil prices or trade policies, could be cited to illustrate how such events amplify volatility across forex rates, including the Pound.
Yes
No ethics review needed.
Q1: Could the authors test their model on general time-series datasets, given that they compare it with iTransformer?

Q2: The authors should provide more detailed experimental comparisons.

Q3: The effectiveness of using a k-means constructed graph is questionable; could the authors compare it with self-learning graph methods proposed in papers like Graph WaveNet?
1. This paper focuses on exchange rate prediction, although exchange rate datasets have already become a standard choice in most time-series forecasting models.

2. The authors mention some unique characteristics of exchange rate data compared to other time-series data, though the proposed model does not seem, in my view, to effectively leverage these characteristics.
The paper proposes an approach to exchange rate forecasting through the Spatial-Temporal Graph Attention Network with Hierarchical Transformer (STGAT). The model integrates spatial graph convolutions with a dual-view temporal transformer mechanism to capture currency interdependencies and long-range data dependencies. The authors present validation results of STGAT's performance on a dataset covering 2,092 trading days across 17 currencies, indicating some improvement in accuracy over certain existing models.
1.From a methodological perspective, the paper primarily combines existing graph neural network structures with transformers. The so-called linear attention mechanism is also a common structure, and the approach does not seem to contribute new insights to the ML field.

2.While the authors aim to address exchange rate forecasting, the proposed model feels more like a general time-series forecasting model. Without demonstrating superior performance on commonly used datasets such as ETTh, electricity, or traffic data, it is difficult to find the approach convincing.

3.The experimental results in Table 1 appear quite weak, with many models showing R² values below zero, meaning they perform worse than simple mean prediction. This suggests the authors may not have given adequate attention to data normalization or baseline parameter tuning.

4. The use of k-means for graph construction seems unnecessary, as self-learned graph structures are now common, and many end-to-end deep clustering methods are available.
Yes
No ethics review needed.
- Could incorporating macroeconomic indicators, such as inflation or GDP, improve the model's predictive performance, particularly for long-term predictions?
- Have you explored using finer temporal granularity (e.g., hourly or minute-level data) to capture short-term market fluctuations?
- What are the primary challenges or limitations of applying this model to other types of financial time series, such as stock market prediction?
- **Originality**: The combination of spatial graph convolutions with **temporal transformers** is a novel approach to forex rate forecasting, especially as it addresses spatial and long-range dependencies in the data.

- **Quality**: The paper conducts comprehensive experiments, comparing the model against multiple baselines, and presents detailed results using appropriate metrics such as MAE, RMSE, and R². 

- **Clarity**: The explanations are clear, particularly in describing the technical contributions like GAT and hierarchical transformer components. Diagrams also effectively aid understanding.

- **Significance**: Forex rate forecasting has significant applications in financial markets, and the accuracy improvement demonstrated in the experiments suggests a practical and meaningful contribution.
The paper proposes a Spatial-Temporal Graph Attention Network with Hierarchical Transformer (STGAT) for forecasting foreign exchange (forex) rates. This model integrates graph attention networks (GATs) with hierarchical transformers to capture spatial and temporal dependencies across currencies. It introduces a dual-view temporal transformer mechanism to manage both local and global currency correlations, alongside using linear GAT to enhance efficiency. Tested on 17 currencies over 2,092 trading days, the model shows improved performance over state-of-the-art models, including XGBRegressor, LSTM, and FourierGNN.
- **Motivation**: The motivation is somewhat weak. While the authors claim that traditional models do not address the interdependencies between currencies and long-range dependencies, other financial time series prediction models, particularly in stock markets, have already tackled similar issues. This diminishes the novelty of the problem formulation. 

- **Lack of Macroeconomic Indicators**: The model only uses forex rate data, without considering macroeconomic indicators like GDP or inflation, which are often crucial in driving currency movements.

- **Efficiency vs. Accuracy**: The ablation study suggests that a non-linear GAT could offer slightly better performance than the linear GAT, but the paper does not adequately discuss the trade-off between computational efficiency and potential accuracy improvements.

- **Temporal Granularity**: It is unclear whether the daily data granularity used in the model is optimal. The authors could have experimented with finer temporal granularity, such as hourly or minute-level data, to see if it improves performance.
@inproceedings{
anonymous2024spatialtemporal,
title={Spatial-temporal Graph Attention Network for Forex Forecasting with Hierarchical Transformer},
author={Anonymous},
booktitle={Submitted to The Thirteenth International Conference on Learning Representations},
year={2024},
url={https://openreview.net/forum?id=5x9kfRXhBd},
note={under review}
}
The foreign exchange market, with its daily trading volume reaching nearly trillions of dollars, presents significant opportunities for the application of advanced predictive analytics. Traditional exchange rate forecasting methods often overlook the interdependencies between currencies and struggle with long-range data dependencies, leading to challenges in capturing the true market dynamics. To overcome these limitations, this paper introduces a novel Spatial-Temporal Graph Attention Network with Hierarchical Transformer (STGAT). Our model innovatively combines spatial graph convolutions with a dual-view temporal transformer-based mechanism, utilizing a Temporal Linearity Graph Attention Network (TLGAT) to account for currency relations in a time-sensitive manner. By integrating a linear attention mechanism for enhanced efficiency and capturing both local and global sequential data embeddings, STGAT provides a framework based on a hierarchical transformer for predicting exchange rates. We validate our approach on exchange rates of seventeen currencies over 2,092 trading days, demonstrating superior performance compared to state-of-the-art models.
I certify that there is no URL (e.g., github page) that could be used to find authors’ identity.
I acknowledge that I and all co-authors of this work have read and commit to adhering to the ICLR Code of Ethics.
Graph Attention Networks Transformer Forex Forecasting
I certify that there is no acknowledgement section in this submission for double blind review.
/pdf/58a8dc4a23c5bb1fed00702511f80f588a9abb45.pdf
learning on graphs and other geometries & topologies
I understand the reciprocal reviewing requirement as described on https://iclr.cc/Conferences/2025/CallForPapers. If none of the authors are registered as a reviewer, it may result in a desk rejection at the discretion of the program chairs. To request an exception, please complete this form at https://forms.gle/Huojr6VjkFxiQsUp6.
I certify that this submission complies with the submission instructions as described on https://iclr.cc/Conferences/2025/AuthorGuide.
Spatial-temporal Graph Attention Network for Forex Forecasting with Hierarchical Transformer
ICLR 2025 Conference Submission
ICLR.cc/2025/Conference/Submission