Which classifier has the best performance?

Logistic regression enables the researcher to explicitly parameterize and estimate a theoretical model. The other techniques to varying degrees put more emphasis on purely empirical estimation from the data. Whether this is advantageous or disadvantageous will of course depend on the situation but as we move to an increasingly Big Data world I believe that theory-based research will have an inherent advantage: with thousands of potential explanatory variables available, the potential for noise to overwhelm the signal increases, unless we have theoretical models to suggest which variables are more likely to convey signal. It's similar to how computers can beat human chess (and now Go) players -- but the strongest players in the world are expert human players combined with computers.