We're currently discussing to add pop-unders to one of our platforms to get users to use one of our notification features. As you can probably imagine, as a UX person I'm really against the use of pop-unders. But I need some data or at least very strong arguments (because on one of our sister platforms, they do convert really well).
Are there any studies on pop-unders? (didn't find anything relevant so far...) Any other thoughts?
Update: Found one study (daipratt.co.uk/popunders/), but it's about ad revenue (so not exactly my case).
Update II: To clarify, this is what we would do: After using the search on our classified website the pop-under opens. The content would be something like "You were looking for XY, if you are interested in getting new results as soon as they appear please enter you email address here"). So it's not third party advertising and might even be useful for the user. But to be honest I still hate the idea - I just don't like when my browser opens stuff I didn't ask for.
Update III: Great answers, thanks everyone! I just accepted the one with the most votes, but the other answers are very helpful as well.
Update IV: So it turns out that the conversion rate of the pop-under on our sister site was actually dwindling over the past years - probably because of built-in pop-up blockers. Good news for me: No pop-under on our page, yey! :)
I can't link to any data or research; I don't see them used very often, probably for good reason. They might not interrupt workflow in the same way a pop-up might, but they're invisible at the time when the notification is most relevant! I would explore other ways of notifying the user. I would recommend some kind of inline validation rule that displays a
<div> to the right of where the user is focussed, perhaps.
Every time I have seen them, they have been poorly done and looked suspicious to me. I just assume that there is something sinister going on like key logging or something like that (not even sure if that's possible but I err on the side of caution). I often think that the reason they are behind the window is so that they can do whatever they need to do without hoping that I do not see them until it's too late. I could just be ignorant to the capabilities of malware etc, but I always try to take the "better safe than sorry" approach.
That being said, I came across this article discussing why they can be effective:
The effectiveness of pop-under windows most likely stems from the timing. When your visitor first enters your site, their mind is on what lead them to your site to begin with. Pop-up windows will most likely cause a higher percentage of your visitors to instantly close your window before viewing its content. That's what makes pop-under windows more effective -- your visitor is through visiting your site and their mind is clearer. They will be much more likely to take the time to look at your offer when they don't have another objective on their mind.
This is a good point. The only thing I am not sure of is if they can overcome the bad reputation and disgust that has been created by pop up advertisements. Most people seem to be conditioned into hating any sort of unwanted/extra window that they weren't expecting. But again, the above article has some good points.
If the site was a reputable one, and the pop under was directly related to the site's content, I would be much less suspicious. For example, if Amazon had a pop under that offered me a discount subscription to Amazon Prime, I would be likely to check it out.
These are major things to consider when making this decision. It seems as though no matter how hard you try and how well you do it, it will annoy the user.
Your example "You were looking for XY, if you are interested in getting new results as soon as they appear please enter you email address here" is conditional (only if they are interested in getting new results) and most pop-unders are modal which means that they need to be acted upon by the user, so you are forcing them to make a decision that they have not asked for.
The pattern that you are implementing is 'saved search' where the user 'follows' or adds a search as an 'interest'. Either way, saving a search is something that I'd expect to do easily if it exists but I wouldn't like it to be forced upon me.
Research has shown that pop-under ads are almost indistinguishable from pop-up ads (pdf source), and are actually worse than pop-up ads in terms of intrusiveness in tests vs in-line ads.
Pop-under ads were indistinguishable from pop-up ads on every dependent variable. It is perhaps worth mentioning that intrusiveness of pop-under ads was reported to be 33.1% higher than the intrusiveness of in-line ads (t=4.728; 264 d.f.; p=.000), while the intrusiveness of pop-up ads was only 24.1% higher than the intrusiveness of in-line ads (t=3.478; 277.96 d.f.; p<.001).
Bottom line, if you accept that pop-ups are bad, pop-unders are worse. In-line is the way to go.
This study seems to address your concerns exactly:
Here's the abstract:
Pop-up, pop-under, and in-line ads have been said to be intrusive, and previous findings suggest that they could have important effects on user perception and cognition. Using a 2x2 factorial design, this experimental study examines the effects of those ads. Besides a control group without ads, factors included ad placement (pop-up vs inline) and ad congruence (with the site's content or not). Results indicated that intention to return was impaired by ads; retention of website information was higher when ads were inline or when ads were not congruent with website content; and retention of ad content was higher for inline ads and those that were not congruent to the content of the website. However, contrary to expectations, intentions to return were not affected by ad placement, retention of site content was not affected by the existence of ads, and intrusiveness of ads was not affected by ad congruence.
So I have Firefox open with twenty tabs, many of them containing articles I want to read later. I then close Firefox, secure in the knowledge that the session is saved and I'll see the same twenty tabs again the next time I open the browser. And now I discover that there's another Firefox window open with your lousy ad in it. And that will be the last window closed. So next time I open Firefox I don't get the interesting articles in my saved session; I get your lousy ad. (Firefox saves the tabs of the last window closed.)
Pop up notifications, like the ones used in Gmail and here on StackExchange might be a good way to get your message across.
The method used on StackExchange is especially relevant because it offers information that is site specific, and often how to make ones experience on the StackExchange better. Since your message:
"You were looking for XY, if you are interested in getting new results as soon as they appear please enter you email address here"
is a way of optimizing the user's experience on your site, this would be a perfect use the pop up/down notification.
This solution isn't sneaky. It's upfront, appropriately timed, and relevant. All of which pop-unders are not.
Try our Pop services atour official webpage: https://www.popunderzone.com