Efficient In-Domain Question Answering for Resource-Constrained Environments