Speech Summarization using Restricted Self-Attention