You make it sound more nefarious that it is. If you don't want your data to be crawled, there's an easy solution. Even Rupert Murdoch, who complains about google all the time, won't take the simple step necessary to stop google from crawling the WSJ website.
