Home / Research Articles Hub / Autoformer: Decomposition Transformers with Auto-C...
🤖 Artificial Intelligence OpenAlex

Autoformer: Decomposition Transformers with Auto-Correlation for\n Long-Term Series Forecasting

📅 Published: June 24, 2021 👤 Haixu Wu, Jiehui Xu, Jianmin Wang et al. 📖 arXiv (Cornell University) 📊 1,324 citations
AI-Generated Summary

Extending the forecasting time is a critical demand for real applications,\nsuch as extreme weather early warning and long-term energy consumption\nplanning. In long-term\nforecasting, Autoformer yields advanced accuracy, with a 38% relative\nimprovement on six benchmarks, covering five practical applications: energy,\ntraffic, economics, weather and disease.

⚡ This is an original paraphrased summary — not copied from the abstract. Full paper available at the source link below.

Key Findings
  • 1 This paper studies the long-term forecasting problem of time series.\nPrior Transformer-based models adopt various self-attention mechanisms to\ndiscover the long-range dependencies.
  • 2 However, intricate temporal patterns of\nthe long-term future prohibit the model from finding reliable dependencies.\nAlso, Transformers have to adopt the sparse versions of point-wise\nself-attentions for long series efficiency, resulting in the information\nutilization bottleneck.
  • 3 Going beyond Transformers, we design Autoformer as a\nnovel decomposition architecture with an Auto-Correlation mechanism.
Why It Matters

This research advances how AI systems learn, reason, and solve problems — with direct implications for automation and scientific discovery.

This summary is based on publicly available metadata and abstract. For the full research paper, visit the original source:

Read Full Paper at OpenAlex
More Artificial Intelligence Papers ← Back to Hub 📚 Learning Hub
Article Details
Source OpenAlex
Category 🤖 Artificial Intelligence
Published Jun 24, 2021
Journal arXiv (Cornell University)
DOI 10.48550/arxiv.2106.13008
Citations 1,324
Authors Haixu Wu, Jiehui Xu, Jianmin Wang, Mingsheng Long