NN-Former: Rethinking Graph Structure in Neural Architecture Representation