Goto

Collaborating Authors

 research library pipeline look


r/MachineLearning - [D] NLP-Research. What does your research library/pipeline look like?

#artificialintelligence

So, I've been meaning to move away from creating new models and the whole training process for each new project or coding experiment I undertake. I've been meaning to check out a few NLP research frameworks built on top of PyTorch but in the meantime, a lot of libraries have sprung up that do a whole bunch of stuff. I was wondering, could any NLP researcher and core developer share their views on which library does what well and whether there is a single library that can do everything? I know there are a few libraries that are really good for transfer-learning, structured prediction, bayesian stuff, interpretability, transformers and pre trained language models etc. but i'm looking for a general purpose research library with modular add on components for general research in PyTorch. Would be really helpful if someone could share their views on this thing?