What's with all the pink?

Find out more at Pink for October or get your own Pink!

5ThirtyOne

Avatar

A blog. A website. A semi-coherent receptacle for Derek Punsalan mixed with excerpts of technology, personal interests, and noteworthy items.

Twitter: Saigon nightlife... inter-est-ing. Squared, Lush, and Gossip.
Get content delivered: RSS | Email

Derek Punsalan...is Sylvia Loh MyQuire - Get stuff done with people who share your passions Box.net - Access your files anywhere with Box

Current » This post published on May 6th 2007 at 2:43 pm

WordPress; manage, reduce, and prevent comment spam

An ideal blogosphere would be free of comment spam - solicitations for enlarging your manhood with knock off drugs, wooing the lady with tried and true sex tips, or drug pedaling bots which believe that BBCode is a compatible comment format for WordPress blogs. The WordPress Discussion Options SubPanel offers a Comment Blacklist filter:

When a comment contains any of these words in its content, name, URL, e-mail, or IP, it will be marked as spam. One word or IP per line. It will match inside words, so “press” will match “WordPress”.

Although the Comment Blacklist filter does a great job of holding any comments which contain words from your filter for moderation, it is humanely impossible to continually update the list to reflect new spam. Short of chaining yourself to your site and decreasing the natural comment experience for visitors using the "An administrator must always approve the comment" option, the best route to take is integrating plugins designed and created to prevent & manage spam.

Managing comment spam with Akismet + Simple Spam Filter

Ask any WordPress user that receives any traffic about combating comment spam, and the common response will be to install a comment spam plugin. My recommendation? Auttomatic’s Akismet + Tan Tan’s Simple Spam Filter; here’s why:

How does [Akismet] work? - When a new comment, trackback, or pingback comes to your blog it is submitted to the Akismet web service which runs hundreds of tests on the comment and returns a thumbs up or thumbs down.

Akismet cross-references suspicious comments submitted on your site against a database of recognized and known spam logged by Akismet through other bloggers, forums, wikis, and contact forms. For more information, visit the Akismet FAQ. By integrating Akismet, you reduce the need to manually filter through suspicious comment. If Akismet catches a comment, it’s probably spam.

Unfortunately, "probably spam" does not guarantee that Akismet accurately manages to differentiate between "good" & "bad" with 100% accuracy. It’s good, and better than everything else I’ve tested, but nothing is good enough to be perfect. Occasionally, a few "good" comments - usually lengthy / descriptive comments with multiple URLs - are caught. No innocent commenter enjoys seeing the Your comment is being held for moderation message after submitting a thoughtful comment. Knowing this, it is important to quickly identify false positives in order to prevent readers from being standoffish the next time they consider contributing their thoughts.

Browsing your Akismet Spam view for "good" comments can turn into a tedious and irritating task [depending on how much spam your site attracts]. Akismet has caught over 48,000 spam on 5thirtyone.com since being installed. Could you imagine if Akismet filtered 450 spam comments while you slept? You begin to understand that while Akismet does a fantastic job of catching spam, your new [mounting] task is making sure that you’re not deleting legitimate reader comments. It’s time to filter the comment spam filter, and that’s how Tan Tan’s Simple Spam Filter comes into play:

As I mentioned above, this plugin isn’t ment to replace any of the existing spam plugins out there, but rather it’s ment to work in conjunction with them by doing a simple prefilter to weed out the most obvious comment spams and dump them into the Internet black hole. All other comments (whether spam or not) are passed along and processed normally (like with Akismet). I realize that this is not fool proof by any means, since spam will continue to evolve over time…

Simple Spam Filter adds an additional SubPanel menu option to your Administrative Comments view titled "Spam Filter". The "Spam Filter" view presents a summarized list of keywords identified as likely spam - "Contains a word that matches a short list of common spam words (for example, viagra or cialis). See the plugin’s source for the full list." By reviewing the list and deleting comments based on obvious keyword matches, moderated comments are deleted from the database reducing the number of comments to sift through.

Additional plugins & tools for managing comment spam

Additional plugins & tools sure to simplify the task of managing comment spam on your WordPress driven website.

  • Bad Behavior - Bad Behavior is a set of PHP scripts which prevents spambots from accessing your site by analyzing their actual HTTP requests and comparing them to profiles from known spambots. It goes far beyond User-Agent and Referer, however. Bad Behavior is available for several PHP-based software packages, and also can be integrated in seconds into any PHP script. Recommended!
  • Spam Karma - Anti-spam plugin for the WordPress blogging platform. It is meant to stop all forms of automated Blog spam effortlessly, while remaining as unobtrusive as possible to regular commenters. Will work in tandem with Akismet. Overkill to run an entirely different spam plugin on top of Akismet.
  • Let human spammers know - Duh! No seriously. Add a snippet of text above your comment submit button warning visitors that comments may be held in moderation and may be deleted at an administrators discretion.
  • Akismet Aunite Spam - Firefox Greasemonkey script which alters the view of your Akismet panel for quicker browsing.
  • Comment Timeout - Archived articles are more likely to be targeted by spammers than newer updated articles. Minimize the likelihood of older articles turning into a cesspool of spam crud, disable comments on older articles based on specified rules - e.g. Disable comments when post is more than ‘xx’ days old, or has not had a comment for ‘xx’ days, whichever is the later. Recommended!

What methods or tools are you using to combat spam on your own personal website? Add your routine in the comments and the number of comments you’ve blocked in the process. [Digg it]


Explore » Discover new content on 5thirtyone.com

This post tagged , , , . Explore similarly tagged content below or visit a random entry. Visit the archives for additional content.

Meta » Gritty post related bits

The post titled WordPress; manage, reduce, and prevent comment spam is categorized under WordPress. Feel free to leave a comment or trackback from your own site.

Advertisement

Reader Activity: Have something to say about WordPress; manage, reduce, and prevent comment spam?
35 Comments
  1. Excellent work finding Simple Spam Filter. Akismet is working wonders, but I just get way too much spam. I’ve tried to lower my spam count by installing Bad Behavior, yet I still find obvious comments with 8 million links. Hopefully Simple Spam Filter will cut down on that even more.

    The only thing I worry about is the 5 link limit. What if a legitimate user had a very detailed comment with multiple URLs? Looking at the source, I see the plugin spits back a page letting the user know they have too many links, but I still think there should be a way to let the person’s comment through. Possible presenting a captcha on multiple URLs would be an effective method.

  2. The URL limitation worried me as well but looking back at the archives (previous comments), most people that do insert links average two at most. Those that feel to express their link love with more are often individuals who don’t know how to create a proper hyperlink.

  3. Hey nice Derek. I just installed SSF as well. My biggest problem lately is false positives, and while it’s a chore to wade through the akismet filtered list, it’s just kind of a fact of life. Having said that, I have a cu\ouple Moveabletype blogs that are much harder to spam proof than my WP projects.

    Dugg ;)

  4. Nice list of spam filter for wordpress. Though I don’t think getting dugged is a good way to reduce spam ;). Currently I am still using good ol’ trustable hand to combat spam. Although Iately I am not allowing comments. The bad thing is that I am blocking good comments too, the good thing is, the bad comment is comming down with it. You can’t win everytime right? i’ll keep this in mind when i finally allow comments.

  5. Cool, thanks for all the nice comments :)

    I do plan to make the link limit and spam words configurable, and possibly make the error message a little more user friendly in a future release (like via an ajax popup or something like that). Let me know if you have any other ideas that might be helpful!

  6. Limiting the links to two is not a problem. Even a genuine commenter should know not to leave more than two links.

    I think Akismet, along with having to enter in letters or numbers, is as much as the average blog would need.

    (Nice site by the way).

  7. added a digg. Akismet is really enough for me, it catches around 300 spam comments per day, and RARELY miss one.

  8. Yeah, Akismet seems to work great for me, although I don’t actually have enough traffic to interest the spammers yet :) Let’s just hope it doesn’t become a problem.

  9. I hacked Akismet so that logged in users never get marked as spam, and other than that we need nothing more. it’s caught 300,000 spam in nearly a year.

  10. Akismet is a brilliant system, and I’ve seen that lately it is being introduced as a way of protecting messageboards and other software from spam :)

  11. Dumitru Tira

    Nice one Derek, definitely a must do then I’ll set up my own blog. cheers.

  12. Thanks for the tips. It is useful to me. :)

  13. I installed the Tan Tan plugin after reading this post few days ago. It has definately reduced my spam comments. It is nice seeing my Akismet list go from ~150 spams a day to 7, but I just have this little fear that it’s deleting genuine comments and I don’t know it.

  14. It’s probably safe to assume that any comments using any one of the words in the pre-filter list are probably comments that you don’t want on your pages. Same goes for comments that include mutliple URLs.

  15. Probably the worst problem with akismet is it manages to sometimes false positive the best comments made.

  16. Nice job! Keep working on preventing false positives.

  17. There is nothing better for protection than a regular review by a human, which I thought was the whole purpose of a Blog, not to simply be created then abandoned. If you can’t moderate it, then switch off comments.

  18. If you can’t moderate it, then switch off comments.

    Comment moderation becomes more and more of a chore once your site is targeted by spam bots. Most individuals I know who try and maintain an online presence through their blog do so on their free time (usually outside of a regular job). I don’t think it is humanly possibly to stay on top of moderating comment spam once your site is targeted. 5thirtyone receives over 300 spam comments per day. I wouldn’t ever consider moderating comments myself unless the spam filters marked them as potential false positives.

  1. Cartoons Fans Lounge - May 6th, 2007
  2. Wordpress at Kaizenlog - May 7th, 2007

Leave a Reply

Your comment may be held for moderation. If your comment is not displayed immediately, do not repost. I reserve the right to remove any and all comments deemed as personal attacks or completely off-topic. Please use the appropriate discussions forum if your comment is not applicable to the current article.

Archived: Browse previous activity by category
Browse an overview of recent activity

View Tutorials » Step-by-step go make something tutorials

WordPress Custom Fields; laying text over your lead graphic

For WordPress users, there are certain scenarios when the typical reverse chronological presentation of content is just not enough. I have experimented with different methods ...

Remove DRM protection from iTunes tracks with iMovie HD

A few days back I found myself perusing the iTunes Music Store looking for a few songs that I had heard via Sirius*. After completing ...

View Apple » Apple software & hardware related articles

"What you’ll find in my Leopard"… and what you won’t

I had made plans for a proper break-down concerning the features, changes, and updates for Apple's latest feline incarnation - 10.5 Leopard. Ultimately, I decided ...

How-to: Proper Gmail IMAP for iPhone & Apple Mail

UPDATE 11/18: inaequitas reminds us that in order to star messages on your iPhone, simply move the message the starred items directory. UPDATE 10/26: RayL re-confirms ...

View Personal » Personal thoughts & rants

Planning on carrying the momentum, 2007 to 2008

Syl caught a photo of Boo (Mini Rat Terrier) in a rare "not bouncing off the wall and couch" mode The later part of 2007 was ...

November is purple, Pancreatic Cancer Awareness

Educate and promote awareness Last month 5ThirtyOne went pink to support Pink for October raising awareness for Breast Cancer Awareness Month. A co-workers partner raised the ...

View Inspiration » Design related announcements & articles

Lovely Blogs highlights "blog design"

Ben Bleikamp, also known for his entrepreneurship blog College Startup, has been hard at work coding and compiling his design community share Lovely Blogs. Now ...

Rebooted - “Fat” faux footers

Inspired by Phu's Many colours of a reboot, I've decided to share my favorite sites which utilize "fat" footers. I think the more appropriate title ...

View Mobile » Mobile technology & information

Asus Eee PC sub-notebook running Apple OS X

Ignoring the legalities or hair pulling from Apple's legal department, Dan decided that it was high time for a sub-notebook running OS X. If Apple ...

Unlimited SMS savings for iPhone (or any phone) family account holders

There are currently three different iPhone plan add-ons for at&t family accounts. Each plan offers unlimited data usage & visual voicemail. The only difference which ...

View Noteworthy » Take note, noteworthy posts or news

Maybe shopping in person actually does save time?

Yesterday I was hoping to have some free time to visit the grocery store to pick-up a few necessities. Unfortunately, I realized all too late ...

Warning! Gmail users beware, fake upgrade emails

UPDATE: According to a comment on digg, gmailupgrades.com has been taken down. Important FYI update for any Gmail users. If you receive the following email in ...

View Productivity » Staying productive, articles pertaining to productivity

Box.net evolves, say hello to OpenBox

Box, a long-time favorite mentioned in Box.net as a collaborative file manager, has evolved into OpenBox adding new features which would tie the service into ...

Basecamp, activeCollab, and Goplan compared

UPDATE 11/18: activeCollab is no longer offered as a free project management collaboration download. From the design, development, and product strategy company Webreakstuff comes a new ...

View WordPress » Articles pertaining to the rock solid CMS WordPress

The Unstandard WordPress theme

The Unstandard WordPress theme is released / shared with the intent of breaking the typical blog mold. Farewell to the blase reverse chronological text heavy ...

WordPress 2.3+ official support for custom database error page

Some time ago a tutorial was posted on 5ThirtyOne which addressed customizing the DB Error page rendered whenever visitors landed on heavily trafficked WordPress site. ...

Advertisement



External: Your reader says "feed me"
Finished? Return to the top

Flickr » Subscribe to my Flickr

  • Coconut juice
  • Dried fish
  • Fresh crabs
  • Fresh frogs
  • Rooftops
  • Vietnam Airlines