Revealing Japanese Advanced Legal Master’s Degrees with AWS Trainium: Pioneers Spotlight from the AWS LLM Development Assistance Initiative | AWS Machine Learning Blog

AWS LLM Development Support Program Overview

Amazon Web Services (AWS) is dedicated to supporting the development of cutting-edge generative artificial intelligence (AI) technologies worldwide. The AWS LLM Development Support Program in Japan aims to assist innovative teams in harnessing the power of large language models (LLMs) and foundation models (FMs) to drive progress across various industries utilizing purpose-built AI infrastructure on AWS. The program provides technical assistance, compute infrastructure, and go-to-market support for participating organizations.

Ricoh: Curriculum Learning Approach for Japanese-English Bilingual LLM

Ricoh recognized the need for Japanese LLMs and developed a bilingual LLM with a curriculum learning strategy. By gradually introducing complex data to their model, Ricoh achieved strong logical reasoning performance using AWS Trainium capabilities for large-scale distributed training.

Stockmark: Suppressing Hallucination in Japanese LLMs

Stockmark focused on creating highly reliable Japanese LLMs by pretraining a model to address hallucination concerns in industrial applications. They developed a 13-billion-parameter LLM from scratch and validated it for enterprise use with AWS Inferentia.

NTT: Lightweight High-Performance Japanese LLM – Tsuzumi

NTT’s Human Informatics Laboratories developed a lightweight, high-performance Japanese LLM named Tsuzumi, emphasizing Japanese language proficiency and multi-modal capabilities. The model is designed to benefit various industries such as healthcare and customer support.

Generative AI Models in the LLM Program

Participants in the LLM Program showcased the transformative capabilities of generative AI on AWS Trainium. Domain-specific models tailored for specific tasks, multi-modal frameworks integrating visual and language modalities, and linguistically diverse models combining various languages were developed by organizations ranging from startups to enterprises.

Future of Generative AI with AWS

With the support of AWS and the commitment to drive innovation and progress globally, the future of generative AI models looks promising. Organizations will continue to develop FMs and LLMs through programs like GENIAC, leveraging purpose-built AI chips and AWS resources to bring AI innovation into real-world applications.