Duplex: A Device for Large Language Models with Mixture of Experts, Grouped Query Attention, and Continuous Batching