TogetherAI
TogetherAI is an American enterprise software company founded by academics from Stanford University and ETH Zurich.Together develops a web-based platform for working with open-source large language models like LLaMA and doing fine-tuning. The company develops FlashAttention, FlexGen, and CocktailSGD.
| Type | Private |
|---|---|
| Industry | Computer software |
| Founded | 2022 |
| Founders |
|
| Headquarters | , United States |
Key people |
|
| Website | together |
RedPajama
On April 17, 2023, Together launched a project named RedPajama to reproduce and distribute an open source version of the LLaMA dataset.[1] The dataset has approximately 1.2 trillion tokens and is publicly available for download.[2]
References
- "RedPajama-Data: An Open Source Recipe to Reproduce LLaMA training dataset". GitHub. Together. Retrieved 4 May 2023.
- "RedPajama-Data-1T". Hugging Face. Together. Retrieved 4 May 2023.
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.