The rapid development of large-scale language models (LLMs) has already had an impact on various fields of science. In particular, the use of the Transformer, the core of LLMs, for multimodal data has significantly advanced in the past few years. This research project aims to construct a “digital brain” using the Transformer through the collaboration of experts in the fields of large-scale neural measurement, large-scale neural simulation, and natural language processing.