Hugging Face (Twitter)

RT @eliebakouch: Here is more detail on how this is working. There are 5 teams for this first round and only 4 teams will go to the second round. There are 3 constraints:
> from-scratch training
> somewhat open (can be used commercially)
> ambitious (omni model, large scale, etc.)

breakdown of the different costs:

> Compute:
~$110M in compute leasing (sk telecom and naver are providing the compute)

> Data:
~$7M for data accessible to each team, ~$14M for a video dataset (only naver ended up training an omni model afaik). Each team gets an additional ~$2M for their own dataset curation

total cost of this first round is ~140M USD https://twitter.com/eliebakouch/status/2006364076977336552#m