Tag

long-range dependencies

1 views collected around this technical thread.

AntTech
AntTech
Apr 27, 2022 · Artificial Intelligence

Pyraformer: Low-Complexity Pyramidal Attention for Long-Range Time Series Modeling and Forecasting

The paper introduces Pyraformer, a low‑complexity pyramidal‑attention Transformer that captures multi‑scale temporal dependencies with linear time‑space complexity, achieving superior single‑step and long‑range forecasting performance on real‑world datasets while supporting green‑computing capacity management.

Pyraformerlong-range dependencieslow complexity
0 likes · 14 min read
Pyraformer: Low-Complexity Pyramidal Attention for Long-Range Time Series Modeling and Forecasting