You probably won't be doing pointer arithmetic in C#. It's been about 5 years since I wrote any C#, but I don't remember any... mostly I remember it as a Java clone, which would preclude pointer arithmetic.
The only time I've ever used them is to speed up drawing. Bitmap.SetPixel is super slow compared to taking a pointer to the raw image data and writing there directly.