Monday, January 3, 2011

Making Web searches more useful


TechCrunch suggests that Google is now so swamped with spam that it's almost useless as a means to find the information we want. There may be a better alternative.

Google has become a jungle: a tropical paradise for spammers and marketers. Almost every search takes you to websites that want you to click on links that make them money, or to sponsored sites that make Google money. There’s no way to do a meaningful chronological search.

We ended up using instead a web-search tool called Blekko. It’s a new technology and is far from perfect; but it is innovative and fills the vacuum of competition with Google (and Bing).

. . .

In addition to providing regular search capabilities like Google’s, Blekko allows you to define what it calls “slashtags” and filter the information you retrieve according to your own criteria. Slashtags are mostly human-curated sets of websites built around a specific topic, such as health, finance, sports, tech, and colleges. So if you are looking for information about swine flu, you can add “/health” to your query and search only the top 70 or so relevant health sites rather than tens of thousands spam sites. Blekko crowdsources the editorial judgment for what should and should not be in a slashtag, as Wikipedia does. One Blekko user created a slashtag for 2100 college websites. So anyone can do a targeted search for all the schools offering courses in molecular biology, for example. Most searches are like this—they can be restricted to a few thousand relevant sites. The results become much more relevant and trustworthy when you can filter out all the garbage.

. . .

Blekko makes an effort to index the page by the date on which it was actually created (by analyzing other information embedded in its HTML). So if I want to search for articles that mention my name, I can do a regular search; sort the results chronologically; limit them to tech blog sites or to any blog sites for a particular year; and perhaps find any references related to the subject of economics. Try doing any of this in Google or Bing.

. . .

The bottom line is that we’re fighting a losing battle for the web and need alternative ways of finding the information that we need. I hope that Blekko and a new breed of startups fill this void: that they do to Google what Google did to the web in the late 90’s — clean up the spam and clutter.


There's more at the link. Here's a video introduction to Blekko.







Looks like a promising start. I'll use it for a while, and if I like it, I'll report back on my experiences. I have to agree with TechCrunch - I'm getting awfully tired of spam sites popping up on Google searches! There are even companies offering optimization tools to help your Web site show up better in response to users' search queries on Google. When things have gone that far, it means one can't rely on a search to return honest answers . . . and it's time that changed. I hope Blekko gets it right, and that others follow.

Peter

4 comments:

Anonymous said...

That's odd. I have been using Google for many years without noticing that problem. Looking back, I seem to remember some annoyances about 4 years ago or so, but none since. Maybe it's because I use the Firefox browser with AdBlock plus and NoScript plugins installed.

PS: my prayers for Brigid have been sent.

Anonymous said...

I agree with Anonymous here--despite the ads from Bing (etc.) to the contrary, I've yet to have problems finding anything in Google. No "Search overload", etc.

That said, Blekko is the newest in a long string of Better Search Engines; Vivisimo is another, as is Wolfram Alpha.

Jenny said...

Yeah, it was worse a few years ago when folks were abusing Google's search algorithm. But (funny thing about capitalism) - Google changed their algorithms and started blacklisting sites, so - less problems now.

Also, knowing the little tricks Google already has (most of which aren't unique to them, like quoting phrases, using +/-, and site:) - help immensely.

Also, Google help is slick, yo.



To Blekko -

1. Marketing fail. So your draw to me is that you can show me all the Global Warming sites tailored to my own political prejudice?

Yeah, way to alienate the half of your audience that doesn't take your pet issue seriously.

2. Technical fail. If it gets big, Google can implement most of the same tech in under a day. Whee, the user gets to alter the query string. That's something I'm gonna pony up capital for.

tpmoney said...

Google has gotten progressively worse over the years at providing relevant pages. I realize all systems can be gamed, but it seems like Google has almost stopped improving their system. It's gotten so bad, that depending on how esoteric or popular my search is, I've taken to using this site:
http://www.givemebackmygoogle.com/

just to get reasonable results.