HandyPriors: Physically Consistent Perception of Hand-Object Interactions with Differentiable Priors