Do I need to have the Monitoring application running in the background at all times, for receiving the notifications?

No.

You don’t need to keep the application open on your Monitoring Mobile phone.