Towards Efficient Use of Multi-Scale Features in Transformer-Based Object Detectors