Homogeneous Speaker Features for On-the-Fly Dysarthric and Elderly Speaker Adaptation