And if you were in a folder before launching your app, it takes you back to the open folder. I never understood that part and it throws me off every time even with 1+ year of experience with it...
You can just hit the home button again. I always think of open folders as just another state of the home screen, just like any of the apps maintains a state.