Near-Efficient and Non-Asymptotic Multiway Inference