It's really nothing major, but it's the small little cherries on top:

http://wiki.octave.org/FAQ#What_features_are_unique_to_Octav...

It's a bit of a problem to innovate too much with Octave, because Matlab may decide to implement a feature we did first, but they'll do it slightly differently, forcing us to redo our work to match theirs.