DataFunTalk
Jul 1, 2021 · Artificial Intelligence
Pre‑Trained Models: Past, Present, and Future – A Comprehensive Survey
This article surveys the evolution of pre‑trained models, covering the origins of transfer and self‑supervised learning, the rise of transformer‑based PTMs such as BERT and GPT, efficient architecture designs, multimodal and multilingual extensions, theoretical analyses, and future research directions for scalable and robust AI systems.
AI researchefficient traininglarge language models
0 likes · 27 min read