rcirc-notify doesn't configure itself automatically. In your eval-after-load "rcirc" add:

 `(rcirc-notify-add-hooks)`

More information can be found in the readme https://github.com/nicferrier/rcirc-notify/blob/master/README.md.