Doubly Robust Structure Identification from Temporal Data