How Aligned are Generative Models to Humans in High-Stakes Decision-Making?