At present, the application of large models has gradually penetrated into all walks of life, and the evaluation benchmarks of large models in vertical segments are also rapidly advancing the construction, and the substantive application of large models is of great significance for the efficient and high-quality development of the industry.

In this context, at the beginning of the new year, in order to better promote the application and development of large models in the field of automotive services, the

CTTL-Terminal Labs of China Academy of Information and Communications Technology (hereinafter referred to as "CAICT")  signed a cooperation agreement with Autohome, a leading service platform in the domestic automotive industry, to build a detailed large model benchmark around the automotive service field, carry out test verification and comparison collection, aiming to improve the application level of AI technology in the field of automotive services, and gradually improve the performance and usability of AI models.

In recent years, it has carried out in-depth research in the field of AI, and has a complete set of evaluation theories, methods and systems. As a leader in the automotive service industry, Autohome has long been committed to the application and exploration of AI technology in the automotive field, and has rich industry experience and rich data resources. The cooperation between the two parties will undoubtedly inject new vitality into the development of large model technology in this subdivided field, and will greatly promote the substantive application of large models in the field of automotive services.

In terms of the evaluation and promotion of large models in the automotive service industry, we will focus on working with the industry to jointly formulate comprehensive and scientific special scenario evaluation standards to accurately measure the performance of large models in the industry. Recently, Autohome's self-developed large-scale model products, and the Thiel Terminal Laboratory has carried out testing and verification work for some scenarios and indicators, organized experts to conduct special discussions on the construction of evaluation benchmarks, and sincerely invited automobile service companies to participate in special standard research and industry benchmark evaluation, so as to contribute wisdom and strength to the sustainable development of China's automotive service AI industry.

Contact information:

Zhang Xiaoyu

zhangxiaoyu@caict.ac.cn