On Designing Light-Weight Object Trackers through Network Pruning: Use CNNs or Transformers?