luigi

Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

翻译 - Luigi是一个Python模块，可帮助您构建批处理作业的复杂管道。它处理依赖关系解析，工作流管理，可视化等。它还内置了Hadoop支持。