notifier: Get rid of the lock with more signals

List some more possible signals that could kill the notifier and prevent
leaving the lock in place in such case.