CASCADED GLOBAL–LOCAL REPRESENTATION LEARNING FOR FINANCIAL TIME-SERIES FORECASTING
Keywords:
BiLSTM, Transformer, Financial time series, Index forecasting, Feature fusionAbstract
Forecasting financial indices remains difficult because market observations combine persistent movements, short-lived disturbances, nonlinear interactions, and substantial noise. A single recurrent architecture may retain nearby temporal information yet fail to represent widely separated dependencies, whereas an attention-based encoder is effective at relating distant positions but does not by itself guarantee detailed sensitivity to local sequence dynamics. This paper reformulates the forecasting pipeline as a cascaded global–local learning problem. A Transformer encoder first converts normalized price windows into contextual representations through positional encoding, multi-head self-attention, residual normalization, and a feedforward sublayer. Those representations are then processed by a bidirectional long short-term memory network, so forward and reverse recurrent states refine the global context before a dense prediction head produces the output. The design was assessed on daily closing-price series for the S&P 500, Dow Jones Industrial Average, and Nasdaq Composite over 2 September 2003–13 July 2023. Preprocessing included interpolation of missing observations, interquartile-range screening of outliers, first differencing, min–max scaling, and windowed sample construction. Tests against recurrent, bidirectional recurrent, feedforward, Informer, and temporal-convolution baselines show that the hybrid system delivers the strongest overall error and goodness-of-fit profile across the three markets. The findings indicate that passing attention-derived context into a bidirectional memory module offers a practical means of combining long-horizon structure with local temporal variation, although computational cost remains relevant for latency-sensitive trading applications.References
[1] Cavalcante R C, Brasileiro R C, Souza V L, et al. Computational intelligence and financial markets: A survey and future directions. Expert Systems with Applications, 2016, 55: 194–211.
[2] Do H X, Brooks R, Treepongkaruna S, et al. How does trading volume affect financial return distributions? International Review of Financial Analysis, 2014, 35: 190–206.
[3] Iacuzzi S. An appraisal of financial indicators for local government: a structured literature review. Journal of Public Budgeting, Accounting & Financial Management, 2022, 34(6): 69–94.
[4] Cao J, Li Z, Li J. Financial time series forecasting model based on CEEMDAN and LSTM. Physica A: Statistical Mechanics and its Applications, 2019, 519: 127–139.
[5] Yang L, Li J, Dong R, et al. NumHTML: Numeric-oriented hierarchical transformer model for multi-task financial forecasting. Proceedings of the AAAI Conference on Artificial Intelligence, 2022, 36(10): 11604–11612.
[6] Kabir M R, Bhadra D, Ridoy M, et al. LSTM–Transformer-based robust hybrid deep learning model for financial time series forecasting. Sci, 2025, 7(1): 7.
[7] Mishra A K, Renganathan J, Gupta A. Volatility forecasting and assessing risk of financial markets using multi-transformer neural network based architecture. Engineering Applications of Artificial Intelligence, 2024, 133: 108223.
[8] Li J C, Sun L P, Wu X, et al. Enhancing financial time series forecasting with hybrid deep learning: CEEMDAN–Informer–LSTM model. Applied Soft Computing, 2025: 113241.
[9] Swapna G, Kp S, Vinayakumar R. Automated detection of diabetes using CNN and CNN-LSTM network and heart rate signals. Procedia Computer Science, 2018, 132: 1253–1262.
[10] Ojha V K, Abraham A, Snášel V. Metaheuristic design of feedforward neural networks: A review of two decades of research. Engineering Applications of Artificial Intelligence, 2017, 60: 97–116.
[11] Waqas M, Humphries U W. A critical review of RNN and LSTM variants in hydrological time series predictions. MethodsX, 2024: 102946.
[12] Siami-Namini S, Tavakoli N, Namin A S. The performance of LSTM and BiLSTM in forecasting time series. 2019 IEEE International Conference on Big Data, 2019: 3285–3292.