Multiple Choice Learning of Low Rank Adapters for Language Modeling