For articles, natives say sentences with wrong articles in them too. Seldomly because they don't know it (still happens), but because they change what they want to say mid-sentence. Cases are always a fight between the pendants and people who don't care.
Plain incorrect grammar will of course be noticeable, but grammar isn't everything.