On Partially Unitary Learning