猸愶笍 Optimizing open models for production

Type
Topics
1 min 路 29 words
Table of Contents

Overview

Optimization techniques to run open models in production

What you’ll learn

  • State of open models
  • Optimzation techniques like caching, routing, prefil decoding ..etc

Resources

Delivered At (4 events)