Mathematical foundations of stable RKHSs