Being non-religious means you simply aren't concerned. Are there gods? Great. Are there no gods? Awesome. Jesus is the one God? Okay. Zeus leads his pantheon of gods? Nice.
Atheism meanwhile is a deliberate belief in no religion. It's different from simply not caring about religion at all, because you do care about religion insofar as to not believe in it.