AI Infra Day (Sarvam x SGLang with Hugging Face)

202607111039
Status: #idea
Tags:

AI Infra Day (Sarvam x SGLang with Hugging Face)

Deploying Large Models at Scale with SGLang
How We Make AI Inference Fast - Performance-Maxing GPUs to Their Physical Limits


References

  1. https://luma.com/btxqaqgc?tk=iUkr0t