Threshold Crossings as Tail Events for Catastrophic AI Risk