How bad does your astigmatism have to be? I've only ever been able to get one magic eye poster to work for me in my life, and I had no idea astigmatism had any impact until just now! I don't know if mine counts as severe, but this would explain a lot for me.
As it happens, I also can't focus on the images in TFA after crossing my eyes to get the shimmer the author refers to.