Characterizations of non-normalized discrete probability distributions and their application in statistics