Capturing the diversity of multilingual societies