Day 2 - June 08
Fireside chat: Building RedPajama
Foundation models such as GPT-4 have driven rapid improvement in AI. However, the most powerful models are closed commercial models or only partially open. RedPajama is a project to create a set of leading, fully open-source models. In this session Ce Zhang, Together CTO, will discuss the data collection and training processes that went into building the RedPajama models.