Fujitsu & team debuts Fugaku-LLM; large language model trained on supercomputer “Fugaku”
Large language model with enhanced Japanese language ability was developed using Japanese supercomputing technology Distributed parallel learning by maximizing the performance of the supercomputer “Fugaku” Enhanced Japanese language ability, for use in research and business Commercial use is permitted, which will lead to innovative research and business applications such as AI for Science A team of researchers in Japan has released Fugaku-LLM, a large language model (1) with enhanced Japanese language capability, using the RIKEN supercomputer Fugaku. The team is led by Professor Rio Yokota of Tokyo Institute of Technology, Associate Professor Keisuke Sakaguchi of Tohoku University, Koichi Shirahata of Fujitsu Limited, Team Leader Mohamed Wahib of RIKEN, Associate Professor Koji Nishiguchi of Nagoya University, Shota Sasaki of CyberAgent, Inc, and Noriyuki Kojima of Kotoba Technologies Inc. To train large language models on Fugaku, the researchers developed distributed training methods,...