libtorch

libtorch-gin-api-server
High-speed Deep learning API Server with Libtorch (C++) and Gin (Golang)