PanGu Coder

PanGu is a family of large language models developed by Huawei, focusing on improving code generation and natural language processing capabilities. Research efforts center on enhancing model performance through techniques like ranking feedback mechanisms and sparse heterogeneous computing to improve training efficiency and scale, often leveraging pre-trained models and adapting them for specific tasks such as dialogue generation and program synthesis. These advancements contribute to the broader field of large language models by demonstrating efficient training strategies and achieving state-of-the-art results on various benchmarks, impacting both research and practical applications in software development and AI-driven conversational systems.

Papers