2nd Place Solution to 2017 DSB - Daniel Hammack and Julian de Wit

Ultimately I built two'ensembles' of models. The first ensemble I built really in an ad-hoc manner - during the process of tuning my neural net structure I trained a bunch of models. Many of them turned out to have similar performance, so I threw them all into an ensemble. This ensemble had a CV score of 0.41 (remember the prior best was 0.433 - averaging helps!). The second ensemble was more systematic (described below).