Tag

Efficient Fine-Tuning

0 views collected around this technical thread.

DataFunSummit
DataFunSummit
Mar 3, 2024 · Artificial Intelligence

Instruction Fine-Tuning Practices for Huawei's Pangu Large Language Model

This presentation details the concepts, methodologies, and experimental results of instruction fine‑tuning for Huawei's Pangu large language model, covering model scale, architecture, training strategies, data quality, parallelism techniques, and case studies on Chinese‑English translation and Thai language adaptation.

AI infrastructureEfficient Fine-TuningInstruction Fine-Tuning
0 likes · 19 min read
Instruction Fine-Tuning Practices for Huawei's Pangu Large Language Model