Inference Software Stack