function mean() { octave -q --eval "mean = mean(load('$1'))" }
I am sure your approach is much quicker, octave takes a good 0.5s(!) to load on my machine.
Regarding speed, for simple calculations like sum, mean and variance, the bottleneck is in I/O.