While we're on the subject of poorly punctuated song titles, the most difficult title to properly punctuate is Annie Lennox's semihit from 1995, on her album Medusa. Allmusic.com styles it No More "I Love You's" in its track listing, but "No More I Love You's" in its text. Rollingstone.com cops out similarly, calling it No More "I Love You's" in its track listing, but dropping that first quotation mark in the album review, opting for "No More I Love You's."
Now, clearly, you can't just drop a quotation mark in the middle of a song title just because you decided to put the whole thing into quotes. That's cheating. A reference to this song in the middle of prose should be styled "No More 'I Love You's,' " if we can trust the track-listing version to be right.
But it's not. Annie isn't promising not to say "I love you's," unless she's from the Bronx, which she isn't. She's promising that she will no longer say "I love you," singular. So ideally, what we should have here is "No More 'I Love You' 's," I think. A double apostrophe!
I still don't really know what the original style is, since I don't have this album. If anyone out there does have a copy and can tell me how Annie herself punctuates the title, please send it in. But I do know the song's not even that good, certainly not worth all these grammatical gymnastics.