Sounds like your on to a much needed service offering. When will it be ready for prime time?

“Mega information clutter” really changes the data management game in many deep and meaningful ways.

Round these parts, we call the clutter “data superabundance”…

We’ve discovered that kicking the junk off the web is a solveable problem. Try our “http://www.sitetruth..com”. This is an automated due diligence system tied to a search engine. It tries to find out who’s behind a web site, and lowers the search positioning based on that info. All those “domaining” sites, link farms, referrer pages, and similar junk just drop out. Remember “on the Internet, no one knows if you’re a dog?” We don’t let the dogs in.

One thing about the semantic web though: Information polluters would have to go the extra step of creating a namespace and rdf tuples for their pages; not so with SST. So it is likely that information pollution would be less of a problem for semantic web applications.

Data cleansing is not a new problem and this is probably why closely engineered and monitored content, though costly, is not a such bad idea. Where do you think the saying “garbage in, garbage out” came from.

One inherent problem is that search engines present links that are used to drive traffic to “the right place”. People that want to scam you will fight to be that right place. The scam is to appear real, authoritative and accurate. Just like you said in the end, Riza, how can you filter “There are WMD in Iraq”?