CornerFormer: Boosting Corner Representation for Fine-Grained Structured Reconstruction