Part 3: Neat Little Snippets of Code That Are Useful for WordPress
Monday, December 17th, 2007
The Content Scraper (for sites that have no feed).
::now holding my ears to shut out the yelps::
Okay, okay - calm down. Here's the thing. I debated long and hard about putting this here. I truly did. People hate content scrapers, and yes - for the most part - the ones that use it for horrid purposes are evil bastards. But being in the Christmas spirit that I always get in at this time of year, I'm going to try and believe that people are good for the most part - and although I know this might become abused here and there...well at least I can take slight solace in the fact that this one, at the very least, will cache the content on the spammers server, so your bandwidth isn't too huge.
I still have trepidation about this one - so seriously, if it does become an issue, and I get a lot of people who really don't want this one here, I will remove it. This one was a toughie to consider sharing, but I'm hoping that people use it for the greater good. I've seen a lot of requests for this kind of stuff on the forums - people who would like to "scrape" the content on their own site that they have in one place and stick it on another one they own so they don't have to write the same thing twice in two different places - and honestly, that's what this was developed for.