AnoOnly: Semi-Supervised Anomaly Detection with the Only Loss on Anomalies