Production inference service for custom-trained open models
AC Inference is Applied Compute's production inference service for serving custom-trained and open models. Applied Compute says it grew to serve more than 1 trillion tokens a day within about three months of launch, and that 40% of its customers use Applied Compute for both training and inference.