DiscoverAI ToolsSnapshotMagazineStartup SpotlightAI News
+ List Startup Sign In
›Developer Tools›DataFlow
DataFlow logo

DataFlow

Open-source data preparation with LLM-based operators and pipelines, from a SIGMOD'27 project
Share Visit Website

About DataFlow

DataFlow is an open-source system for easy data preparation with LLM-based operators and pipelines. Instead of hand-writing cleaning and transformation code, you compose operators that use language models to prepare training and evaluation data, with companion projects for multimodal data, reusable skills and a web UI.

The project comes out of the OpenDCAI group with a SIGMOD'27 paper behind it, and everything lives in the open on GitHub - free to use, extend and self-host.

Website

DataFlow website screenshot

Perfect for

ML engineers and researchers who need reproducible, LLM-assisted data preparation pipelines.

Solves these problems

Replaces ad-hoc data cleaning scripts with composable LLM-based operators and pipelines.