You will only receive weather alert notifications for the first location on your list. This is your current GPS location by default.
Please make sure you have weather alert notifications enabled in BeWeather by going to the settings and then set Weather Alert Notifications to anything other than None.
Please also make sure you have notifications enabled for BeWeather in your device's settings. Open the Settings app and go to BeWeather. Then select Notifications and enable Allow Notifications.