The Code/X ArchiveView on X
Sean Lie

@seanlie

How we deploy multi-trillion parameter models at scale

Today, let's break down the math for how @cerebras:
1. Fits the full model into on-chip memory
2. Maps the model across multiple chips
3. Handles a high # of concurrent requests
411861.7K1.7K