China Telecom say AI model with 1 trillion parameters trained with Chinese chips

In This Article:

A Chinese state-owned carrier said it has developed two large language models (LLM) trained entirely on domestically produced chips, illustrating the progress China has made in its effort to achieve chip autonomy in artificial intelligence (AI).

The Institute of AI at China Telecom, one of the country's large state-backed telecoms operators, said in a statement on Saturday that its open-source TeleChat2-115B and a second unnamed model were trained on tens of thousands of domestically produced chips, marking a milestone amid tightening US restrictions on China's access to advanced semiconductors, including Nvidia's latest AI chips.

The achievement "indicates that China has truly realised total self-sufficiency in domestic LLM training" and marks the start of a new phase for China's innovation and self-reliance in LLMs, the technology behind OpenAI's ChatGPT, the AI institute said in a statement published to WeChat.

Do you have questions about the biggest topics and trends from around the world? Get the answers with SCMP Knowledge, our new platform of curated content with explainers, FAQs, analyses and infographics brought to you by our award-winning team.

China Telecom said the unnamed model has 1 trillion parameters - a machine-learning term for variables present in an AI system during training. The sophistication and effectiveness of an AI model depend largely on the scale of parameters involved in the training process. TeleChat2t-115B has over 100 billion parameters, the company said.

China Telecom is believed to be using chips from Huawei to train AI models. Photo: AFP alt=China Telecom is believed to be using chips from Huawei to train AI models. Photo: AFP>

Chinese companies are rushing to catch up in AI and stay globally competitive by working around Washington's export restrictions. China Telecom did not say who supplied its domestic chips, but the company has previously disclosed that it is developing LLM technology using Ascend chips developed by Shenzhen-based telecom equipment giant Huawei Technologies.

US-sanctioned Huawei recently started testing a new AI chip with potential clients in China, as companies look for alternatives to high-end Nvidia hardware, the Post reported last week.

Huawei has offered samples of its Ascend 910C processor to large Chinese server companies for hardware testing and configuration, according to two sources briefed on the matter. The chip is also being offered to Chinese internet giants that are major Nvidia customers, according to one of the sources, a distributor of Huawei AI chips.