I built a data processing system for sprawling commercial batch jobs that had a sort of compiler that build a set of production rules to run the ‘control plane’ which would set up and tear down reactive pipelines, key-value stores, triple stores, etc. that comprised the ‘data plane’ —- for a system designed to run on one SMP machine that can extract parallelism at multiple levels.
