Is attention all you need to solve the correlated electron problem?