Sample Efficient Demonstration Selection for In-Context Learning