Local inference stack for fast on-device AI
Husky is Underdog's local inference stack aimed at faster on-device model serving (the team publicly compares throughput versus MLX). It supports Underdog's broader on-device personal AI product direction where models run on the user's computer.