GitHub - uber/fiber: Distributed Computing for AI Made Simple

This project is experimental and the APIs are not considered stable. Fiber is a Python distributed computing library for modern computer clusters. Originally, it was developed to power large scale parallel scientific computation projects like POET and it has been used to power similar projects within Uber. To use Fiber, simply import it in your code and it works very similar to multiprocessing. Note that if __name__ '__main__': is necessary because Fiber uses spawn method to start new processes.