Paralinguistics-Enhanced Large Language Modeling of Spoken Dialogue