Review (May 2024)

Prefect is a new data workflow management system, designed for modern infrastructure. prefect provides a flexible open-source python framework to easily combine tasks into workflows, then deploy, schedule, and monitor their execution through the prefect ui or api. create powerful data pipelines and let prefect take care of scheduling, infrastructure, error handling, retries, logs, triggers, data serialization, parameterization, dynamic mapping, caching, concurrency, and more.