I can convince my first followers by doing the first crops and batches myself, alone.
Usage of animals and metal tools in agriculture came much later. I don't need that to start. I just need fire and ceramics.
Of course it wouldn't be _easy_. Empires are never easy.
Ultimately, what I'm saying is the context of the original comment about soap: food tech would be more succesful than soap tech.