what to do with really strong features in machine learning

Let's try to understand how machine learning works in practice. Machine learning is not something you run in isolation, you don't just take your raw data and feed everything into it. Instead, you would develop a pipeline where you process or transform your data. Machine learning or predictive modelling is simply part of the pipeline, usually after the filtering process. Not everything in the raw data would go into your model.