SSDM: Scalable Speech Dysfluency Modeling