VIDUR - A Large-Scale Simulation Framework for LLM Inference

202502061807
Status: #idea
Tags:

VIDUR - A Large-Scale Simulation Framework for LLM Inference

My Notes (Extensive)

Review (Summary)


References

  1. MSR project page
  2. Preprint
  3. github.com/microsoft/vidur
  4. Paper