news.ycombinator.com
Show HN: TrnRT – An open-source LLM inference engine for AWS Trainium
Hi HN, Sanchit here from RunAnywhere (YC W26). We just open-sourced TrnRT: Trainium RunTime, our inference engine for AWS Trainium. We started 3 weeks back, and currently we’re able to serve and run GLM 5.3 flash (FP8) on AWS trn2.48xlarge, and will bring more models support soon. It’s open to contributions :) What it does today: - Serves 2 instances of GLM-
Original reporting from news.ycombinator.com.
Read original at news.ycombinator.com