BERTO: an Adaptive BERT-based Network Time Series Predictor with Operator Preferences in Natural Language

Abstract--We introduce BERTO, a BERT -based framework for traffic prediction and energy optimization in cellular networks. Built on transformer architectures, BERTO delivers high prediction accuracy, while its Balancing Loss Function and prompt-based customization allow operators to adjust the trade-off between power savings and performance. Natural language prompts guide the model to manage underprediction and overprediction in accordance with the operator's intent. Experiments on real-world datasets show that BERTO improves upon existing models with a 4.13% reduction in MSE while introducing the feature of balancing competing objectives of power saving and performance through simple natural language inputs, operating over a flexible range of 1.4 kW in power and up to 9 variation in service quality, making it well suited for intelligent RAN deployments. Time series data is ubiquitous across all layers of modern communication networks.