For a while now, Google has been serving up tweets related to searches as part of its real-time search effort. Now they are making it possible to search the Twitter stream in exactly the way Twitter doesn’t allow — that is, to search for tweets older than a few days. A query like
cyberwarfare site:twitter.com
will return a bunch of tweets, formatted as Google search results. As of the time I ran this query, it identified 1,380 hits from Twitter. Twitter’s search yielded about 250 tweets, going back to no more than 10 days ago. So far, so good.
What’s no so good with Google’s UI is that the tweets are returned in order of “relevance” but it is not clear what that means for a single-word query and 140 character documents. Twitter search returned results by date, so there was some transparent organizing principle. In the Google interface, it’s hard to explain why one result is placed above another. Clicking ‘timeline’ doesn’t show any results, as you might expect. To get Google to show results by date, you have to perform the following steps (assuming you’re using iGoogle):
- Click on “show options…” to open the menu
- Click “Past 24 hours” or “Past week” or “Past year” links (but not “Latest”) in the time category to show the sort criteria options
- Click “sorted by date”
The results will now be sorted with the latest item first, but there appears to be no way to sort the list in earliest-first order. Of course you can just go to the last page in the set of pages, and scroll to the bottom, right? Wrong! The documents shown there are not tweets. They are links to lists and to tweeps’ pages that happen to include the text of a tweet that mentions ‘cyberwarfare’. Furthermore, the number of matching documents as reported on the last page (10 as shown on the first page of results) decreased from 1380 to 466.
It is also possible to filter search results by a specific date range, but when I tried searching for tweets containing the word ‘cyberwarfare’ between 1/1/2005 and 1/22/2010, I got 380 hits (ordered by relevance). Switching to ‘sorted by date’ mysteriously reduced the number of hits to 369. Clicking on the last page shown reduced the number of matching items further, to 321, although none of these was a tweet. In fact, tweets were returned only on the first page, and only 14 of 50 on that one.
The problem with indexing tweeps’ home pages is that they change so frequently that the index gets stale almost immediately. It makes much more sense to index the tweets themselves. Google seems to do some of each, but the results are not predictable, not complete, and thus not trustworthy.
What about Bing?
A search on Bing’s twitter page for ‘cyberwarfare’ yielded one tweet. ‘cyber warfare’ yielded four. The trending topic ‘Haiti’ produced about 20 hits; the button marked ‘Older’ did not find any other tweets. Sigh. On the other hand, it was easy to switch between the date and relevance sort orders.
The upshot of this is twofold: Twitter search, for all its problems, still seems more comprehensive (and comprehensible) than Google’s and Bing’s, and Google’s UI design desperately needs some help. Let’s hope that some usability people are paying attention.
I enjoyed this post, Gene. I agree with your thoughts. You would probably like an alternative search tool TipTop http://FeelTipTop.com which is fast becoming the early leader in this emerging space.
FeelTipTop looks like an interesting site. Are you the developer on that? What is the difference between Tip tweets and piT tweets?
Thanks for taking a look, Gene. Yes, TipTop is my creation. From all the information out there (tweets, user reviews, etc.), TipTop harnesses the most influential/actionable bits. These we call Tips. Hence the name of the company/product TipTop. Top is short for Top of mind or Topic (the context). Given any Top, the best tips are discovered & presented back to the user. piTs are also Tips. It is a little play on words. piTs tend to be those Tips that are often negative (don’ts rather than do’s). I hope this summary of TipTop will help you appreciate it even more.
Thanks for the explanation. Sentiment analysis is an interesting (you might say trending!) topic, but it seems hard to get reliable data out of individual tweets (compared to blog posts or even online reviews). How do you manage the noise inherent in the Twitter signal?
Twitter Comment
#Google #search for #Twitter? #fail! @HCIR_GeneG lays out his issues – Interesting read ! [link to post]
– Posted using Chat Catcher
Indeed, Gene. It is a huge challenge. That is partly what makes me so excited about what we have already achieved at TipTop. It is still only the beginning & there is a long path ahead. I am happy to chat with you sometime so that we can discuss TipTop at length. Best e-mail address for me is shyam AT feeltiptop.com Thanks.
Twitter Comment
Fxpal blog raquo blog archive raquo google search for twitter? fail… [link to post]
– Posted using Chat Catcher
[…] http://palblog.fxpal.com/?p=2772 […]
[…] tweets the way that Bing and Google do it seems like a poor model to emulate, given the shortcomings of those firms’ approaches. It seems like a better opportunity would be to provide a more […]