What's in an embedding? Would a rose by any embedding smell as sweet?