Personally I believe they do almost nothing. Food born illness is pretty common and almost impossible to trace unless it is a wide spread outbreak.
Many cities only inspect a food establishment every 2-3 years and in some cases as long as 5 years.
I think reputation, and economics play a larger factor in safety then government inspections. Dirty places making their customers ill tend to close long before the government inspectors come around.