The Potential for Facebook Search Kicks Twitter’s Butt – Stay N Alive

The Potential for Facebook Search Kicks Twitter’s Butt

FacebookRob Diana recently did a post suggesting Facebook, rather than Twitter, was the real goldmine for data.  I, as I’ve inferred before on LouisGray.com, wholeheartedly agree with that notion, and in fact, Facebook is already showing the potential for this with their Lexicon product.  While not yet as public as Twitter search, right now anyone can see top trending keywords and topics, very similar to Twitter search, via the URL http://facebook.com/lexicon.  Better yet, Facebook has revealed where they are going with it via their new version of the trends tool at http://facebook.com/lexicon/new.

picture-11

From the new Lexicon you can pick any trending topic, see the number of users talking about those topics on a given timeline.  Facebook goes further though, providing demographic data.  For instance, for the term, “baseball”, you can find out how many females vs. males are talking about baseball.  Under a Demographics category, you can also break it down by age, or country.

picture-21

picture-31

Associations

In addition to demographical information, you can pull out various statistics about what people are saying about a particular topic.  Under the “Associations” category, you can get a graphical breakdown of what the most popular word associations with the topic are.  Popular associations for the word, “baseball” were “high school”, “college”, “coach”, to name a few.

picture-4

Sentiment

I found this one quite interesting.  Facebook has found some way to determine the sentiment of users when mentioning various search terms.  For instance, for “baseball”, you can determine the percentage of users speaking positively of baseball, and the percentage of users speaking negatively.  They go further though, allowing you to compare the sentiment of one search term over another.

picture-5

Pulse

Facebook will also do some biographical checking for you as well.  It looks at each search term, and will determine what other common keywords are in users’ profiles related to those search terms, and what words are most popular when users are mentioning the term.  For “baseball”, users tended to have words such as “sports”, “music”, “football”, and “reading”, revealing a little information about those fanatical about baseball.

picture-6-1

Geography

Lastly, users can see how a particular search term fares geographically.  “baseball” is very popular in California.  Facebook provides a map, color-coding based on percent of users talking about the particular term.  I can’t help but wonder if all search results are biased towards California however since that is one of the most populous states in terms of Facebook use.

picture-7

The Potential for Facebook vs. Twitter

I think Facebook has shown through this Lexicon that they have the potential to be much more useful than Twitter in terms of search and data mining potential.  Because Facebook has more detailed profile data, and a significantly larger user base to read from, the potentials for useful data are so much greater, and are already proving so via this Lexicon.  If Facebook starts to provide APIs around this search data, along with the publicly available user status updates and profile data, they will be a very serious force to reckon with, that I think, regardless of the mass funding Twitter has, will be extremely tough to compete with.

If you’re currently writing apps for Twitter, you should sincerely consider starting to learn Facebook.

77 thoughts on “The Potential for Facebook Search Kicks Twitter’s Butt

  1. Rob, I agree – it seems developers are spending all this time right now
    trying to mine data that Facebook has already done. This is one of the
    reasons I'm not focusing on content on SocialToo – it's too much work for
    Twitter (and expensive!).

  2. Rob, I agree – it seems developers are spending all this time right now
    trying to mine data that Facebook has already done. This is one of the
    reasons I'm not focusing on content on SocialToo – it's too much work for
    Twitter (and expensive!).

  3. I'll have to agree with Daniel here… Whenever I talk to someone about Facebook, they tell me straight up that their status update's are usually “I am currently on Facebook, updating my status.”, where people on twitter tend to think “How can I squeeze as much information into these 140 characters?”.

    Because of this, the information I get from Twitter is so much more valuable (and real-time) then Facebook.

  4. Daniel, that's coming. Facebook just has to make the search I'm talking
    about here public, along with the timeline of updates and posts. They're
    working on that as we speak, I'm 90% sure of it. Facebook mines 100 times
    the data Twitter has mined so far – it won't take much for it to kill
    Twitter. Facebook simply has way more it can index, which is why it will be
    more successful.

  5. I'll have to agree with Daniel here… Whenever I talk to someone about Facebook, they tell me straight up that their status update's are usually “I am currently on Facebook, updating my status.”, where people on twitter tend to think “How can I squeeze as much information into these 140 characters?”.

    Because of this, the information I get from Twitter is so much more valuable (and real-time) then Facebook.

  6. Daniel, that's coming. Facebook just has to make the search I'm talking
    about here public, along with the timeline of updates and posts. They're
    working on that as we speak, I'm 90% sure of it. Facebook mines 100 times
    the data Twitter has mined so far – it won't take much for it to kill
    Twitter. Facebook simply has way more it can index, which is why it will be
    more successful.

  7. I recently guest-lectured a class of college PR students. When I asked how
    many were on Twitter, about 1/4 of the class rose their hands. When I asked
    how many were on Facebook, 100% rose their hands.

  8. I recently guest-lectured a class of college PR students. When I asked how
    many were on Twitter, about 1/4 of the class rose their hands. When I asked
    how many were on Facebook, 100% rose their hands.

  9. Yeah, they're on Facebook, playing games, commenting on pictures (which we can do thanks to TwitPic), taking surveys (which we can do thanks to SocialToo and SocialSurveys), and much more. The thing that Twitter has over Facebook, is that the entire service is built around the status update, where Facebook is an entire social network. I think because Twitter focuses on what users are doing right now, instead of having many other apps and services that are crucial to the network (who hasn't received a Ninjas vs. Pirates invite?), they have a greater search potential.

    In the end, I think simplicity, and watching for scope creep, wins out in the end.

  10. Yeah, they're on Facebook, playing games, commenting on pictures (which we can do thanks to TwitPic), taking surveys (which we can do thanks to SocialToo and SocialSurveys), and much more. The thing that Twitter has over Facebook, is that the entire service is built around the status update, where Facebook is an entire social network. I think because Twitter focuses on what users are doing right now, instead of having many other apps and services that are crucial to the network (who hasn't received a Ninjas vs. Pirates invite?), they have a greater search potential.

    In the end, I think simplicity, and watching for scope creep, wins out in the end.

  11. Joseph, IMO that's Facebook's strength. A good search should enable users
    to exclude the noise if they don't want it. I can find that on Google as
    well. The strength that Facebook has over Twitter is the fact that I can
    identify real individuals and their demographic information with the status
    updates, pictures, videos, links, notes, and more that they're posting.
    Facebook is extremely powerful in that aspect, and Twitter doesn't hold a
    dime.

  12. Joseph, IMO that's Facebook's strength. A good search should enable users
    to exclude the noise if they don't want it. I can find that on Google as
    well. The strength that Facebook has over Twitter is the fact that I can
    identify real individuals and their demographic information with the status
    updates, pictures, videos, links, notes, and more that they're posting.
    Facebook is extremely powerful in that aspect, and Twitter doesn't hold a
    dime.

  13. yes, and that's why I think Facebook search will hit a much larger and wider audience than Twitter search. Once the masses figure that out no one will need to use Twitter. Facebook just has to improve a few things and they're there. I'm pretty sure they're working on that.

  14. yes, and that's why I think Facebook search will hit a much larger and wider audience than Twitter search. Once the masses figure that out no one will need to use Twitter. Facebook just has to improve a few things and they're there. I'm pretty sure they're working on that.

  15. I think that's what they're building it up to be. Again, look at the
    potential examples I listed of what they can do currently. It's a marketer's
    and news organization's dream if they could have access to all that data.
    That's why Twitter has taken off as well. I would have never seen Twitter as
    a search engine at its beginnings either. It just became that because it was
    more public. As Facebook becomes more public, it will be seen as a source
    for data mining and search just like Twitter.

  16. I think that's what they're building it up to be. Again, look at the
    potential examples I listed of what they can do currently. It's a marketer's
    and news organization's dream if they could have access to all that data.
    That's why Twitter has taken off as well. I would have never seen Twitter as
    a search engine at its beginnings either. It just became that because it was
    more public. As Facebook becomes more public, it will be seen as a source
    for data mining and search just like Twitter.

  17. I had not heard of Lexicon before. One potential issue, however, is that it doesn't appear to work for up-to-the-minute searches. When I used the current Lexicon to search the phrase figure skating, I couldn't see anything in the timeline beyond March 13, which was nine days ago. Even the demo of the new Lexicon seems to only show results through March 20. Perhaps the live version of the new Lexicon will show more recent data, but if it takes a couple of days to compile Facebook wall data for Lexicon display, then the usefulness of the feature is somewhat limited.

  18. I had not heard of Lexicon before. One potential issue, however, is that it doesn't appear to work for up-to-the-minute searches. When I used the current Lexicon to search the phrase figure skating, I couldn't see anything in the timeline beyond March 13, which was nine days ago. Even the demo of the new Lexicon seems to only show results through March 20. Perhaps the live version of the new Lexicon will show more recent data, but if it takes a couple of days to compile Facebook wall data for Lexicon display, then the usefulness of the feature is somewhat limited.

  19. Jesse, I see a huge problem for Facebook getting the majority of their users to (knowingly) allow their personal feed stream to be publicly accessible.

    Because the entire service was started on the premise of a Walled Garden where it was safe and private to connect with your (mostly real) friends and acquaintances. Already, I am hearing (via Steve Gillmor) that supposedly as many as 94% of Facebook users responding to a poll about the new “Twitterized” design dislike it.

    Twitter is in a whole other gear in terms of speed, and the felt need of it's most ardent users to express themselves. Currently, due to the number of very active Twitter users who employ any number of client programs to send and read updates, the raw data from Compete.com re:visits does not tell the whole story. My guess is that the current 20:1 visit ratio in Facebook's favor is off, I could easily see it being only 10:1 or even better.

    And most importantly, except for a few unfortunate souls on Twitter who have set their updates to “Protected”, there never has been a supposition of privacy, indeed, it tends to attract those that do not mind, do not care, or WANT to overshare… 🙂

    While on Facebook users treasure their privacy a lot more, and would react VERY negatively if e.g. the Personal Feed were to be opened to the public by default. Remember what happened with Beacon?

    I would agree that there are data mining opportunities on Facebook, it's just that Facebook likely has to sell those to the highest (corporate) bidders, i.e. you or I are not likely to be getting open access to it. Even with that Facebook would have to be very careful as to privacy issues, real or perceived, or the backlash could make the recent TOS disaster look like a complete cakewalk.

  20. Jesse, I see a huge problem for Facebook getting the majority of their users to (knowingly) allow their personal feed stream to be publicly accessible.

    Because the entire service was started on the premise of a Walled Garden where it was safe and private to connect with your (mostly real) friends and acquaintances. Already, I am hearing (via Steve Gillmor) that supposedly as many as 94% of Facebook users responding to a poll about the new “Twitterized” design dislike it.

    Twitter is in a whole other gear in terms of speed, and the felt need of it's most ardent users to express themselves. Currently, due to the number of very active Twitter users who employ any number of client programs to send and read updates, the raw data from Compete.com re:visits does not tell the whole story. My guess is that the current 20:1 visit ratio in Facebook's favor is off, I could easily see it being only 10:1 or even better.

    And most importantly, all except a few unfortunate souls on Twitter who have set their updates to “Protected”, there never has been a supposition of privacy, indeed, it tends to attract those that do not mind, do not care, or WANT to overshare… 🙂

    While on Fecbook users treasure their privacy a lot more, and would react VERY negatively if e.g. the Personal Feed were to be opened to the public by default. Remember what happened with Beacon?

    I would agree that there are data mining opportunities on Facebook, it's just that Facebook likely has to sell those to the highest (corporate) bidders, i.e. you or I are not likely to be getting open access to it. Even with that Facebook would have to be very careful as to privacy issues, real or perceived, or the backlash could make the recent TOS disaster look like a complete cakewalk.

  21. John, this just shows the potential. Facebook still has some work cut out
    for them, but they do seem to be moving much faster than Twitter. They also
    have way more resources than Twitter does at the moment.

  22. John, this just shows the potential. Facebook still has some work cut out
    for them, but they do seem to be moving much faster than Twitter. They also
    have way more resources than Twitter does at the moment.

  23. “If you’re currently writing apps for Twitter, you should sincerely consider starting to learn Facebook.”

    It's a false comparison from the third-party developer perspective. What's important is not only the aggregate cashflow that a platform will generate, but also how much economic room the platform *consistently* makes for third parties. To scale a business, the third-party needs to trust the platform. Twitter inspires this trust and makes a ton of room for third parties. Facebook's record is spotty, and they seem to be vertically integrating quickly.

  24. “If you’re currently writing apps for Twitter, you should sincerely consider starting to learn Facebook.”

    It's a false comparison from the third-party developer perspective. What's important is not only the aggregate cashflow that a platform will generate, but also how much economic room the platform *consistently* makes for third parties. To scale a business, the third-party needs to trust the platform. Twitter inspires this trust and makes a ton of room for third parties. Facebook's record is spotty, and they seem to be vertically integrating quickly.

  25. Which is why Facebook wants on that bandwagon. At least you can tell that
    data from Facebook. I can't find out how many people on Twitter are talking
    about Facebook.

  26. Which is why Facebook wants on that bandwagon. At least you can tell that
    data from Facebook. I can't find out how many people on Twitter are talking
    about Facebook.

  27. I spend about 80 hours a week developing on Twitter, and I've written apps,
    and the O'Reilly book on Facebook development. I trust Twitter way less than
    I trust Facebook. I can't trust that Twitter's servers will be up. I can't
    trust that their platform will even stay around due to no monetization
    strategy, and I can't trust that my business can scale since their limits
    essentially prevent me from growing too big. Facebook's API is built to
    grow, and has a much stronger reputation at stability and building
    relationships with their developers.

  28. I spend about 80 hours a week developing on Twitter, and I've written apps,
    and the O'Reilly book on Facebook development. I trust Twitter way less than
    I trust Facebook. I can't trust that Twitter's servers will be up. I can't
    trust that their platform will even stay around due to no monetization
    strategy, and I can't trust that my business can scale since their limits
    essentially prevent me from growing too big. Facebook's API is built to
    grow, and has a much stronger reputation at stability and building
    relationships with their developers.

  29. Ironically given this convo, we agree on the main point. Twitter can't make money on Search, and FB can. My only issue is that being an FB third party won't scale any more than being a Google third-party does.

    At Lookery, we used ran one of the larger Facebook app ad networks until October. I don't have direct involvement in Twitter, other than some advisory shares at Bitly, but I know the entire TwBoD. I can't code for shit, but I know the commercial side of things well enough.

    It's clear from both their words and deeds that Facebook is seeking to build a huge, mostly closed system, from which developer/platform revenue will be a zero-sum game within a few years. What you say about developer relationships is contrary to every convo I've had in the past year. To be clear, I think they will make a huge amount of money at it. However, once they get serious about revenue, they will work hard to keep all the gross margin to themselves (think AdWords). Because they want to be all valuable parts of the application and marketing layers, they need a ton of cash.

    Twitter's is far better funded for what they are trying to accomplish than Facebook is. They don't care about being the application layer; they care about being the messaging layer. That's a lot cheaper, now that they've FINALLY got some scaling working well.

  30. Ironically given this convo, we agree on the main point. Twitter can't make money on Search, and FB can. My only issue is that being an FB third party won't scale any more than being a Google third-party does.

    At Lookery, we used ran one of the larger Facebook app ad networks until October. I don't have direct involvement in Twitter, other than some advisory shares at Bitly, but I know the entire TwBoD. I can't code for shit, but I know the commercial side of things well enough.

    It's clear from both their words and deeds that Facebook is seeking to build a huge, mostly closed system, from which developer/platform revenue will be a zero-sum game within a few years. What you say about developer relationships is contrary to every convo I've had in the past year. To be clear, I think they will make a huge amount of money at it. However, once they get serious about revenue, they will work hard to keep all the gross margin to themselves (think AdWords). Because they want to be all valuable parts of the application and marketing layers, they need a ton of cash.

    Twitter's is far better funded for what they are trying to accomplish than Facebook is. They don't care about being the application layer; they care about being the messaging layer. That's a lot cheaper, now that they've FINALLY got some scaling working well.

  31. Jesse – Intentional or not, Facebook has positioned itself better than almost any online platform for demographic advertising. The recent hyper-growth (as evidencde by MANY of us contacted by old friends we never thought we'd see there) plus the more open cross-posting API and apps, just amplifies the potential of the platform. While many have taken issue with the latest look and feel, the reality is that the mainstream (and those with limited time) love 'fast and simple' … which is exactly what the new Facebook is. I not only see it as a more viable advertising space than Twitter but one of the few Google competitors once media buyers realize how the very new international, multi-media advertising spectrum works. Great piece!.

  32. Jesse – Intentional or not, Facebook has positioned itself better than almost any online platform for demographic advertising. The recent hyper-growth (as evidencde by MANY of us contacted by old friends we never thought we'd see there) plus the more open cross-posting API and apps, just amplifies the potential of the platform. While many have taken issue with the latest look and feel, the reality is that the mainstream (and those with limited time) love 'fast and simple' … which is exactly what the new Facebook is. I not only see it as a more viable advertising space than Twitter but one of the few Google competitors once media buyers realize how the very new international, multi-media advertising spectrum works. Great piece!.

  33. Great info on Facebook Lexicon. However, your argument seems more relevant to why Facebook Lexicon is better than Twitter trends. The beauty of Twitter search is that you have the ability to perform a search just like you would on google and get real-time results based on recency–and I'm not talking about search trends, but rather actual statements or links to articles, etc. As far as I can tell, that type of search is not available with facebook. If it is, please point me in the right direction. However, I do agree with you that Facebook Lexicon appears to offer a lot of very valuable information around the statistics of conversations on Facebook. Thanks for the info.

  34. Great info on Facebook Lexicon. However, your argument seems more relevant to why Facebook Lexicon is better than Twitter trends. The beauty of Twitter search is that you have the ability to perform a search just like you would on google and get real-time results based on recency–and I'm not talking about search trends, but rather actual statements or links to articles, etc. As far as I can tell, that type of search is not available with facebook. If it is, please point me in the right direction. However, I do agree with you that Facebook Lexicon appears to offer a lot of very valuable information around the statistics of conversations on Facebook. Thanks for the info.

  35. Katy, my example of Facebook Lexicon was simply to display the potential of
    what Facebook search would bring. I agree it's not what Twitter provides
    now, but it does show that Facebook has a lot more to bring to the table,
    and I'm pretty dang sure they're working on that.

  36. Katy, my example of Facebook Lexicon was simply to display the potential of
    what Facebook search would bring. I agree it's not what Twitter provides
    now, but it does show that Facebook has a lot more to bring to the table,
    and I'm pretty dang sure they're working on that.

  37. You can go both ways on the advantages and disadvantages of a service dedicated to one function (Twitter, Likaholix) vs a service capable of multiple functions (Facebook). However, remember that information may be gleaned from more than status updates. If I share a Siobhan Donaghy video on Facebook, that indicates to everyone that I have an interest in that artist, which could be valuable marketing information. And frankly, a marketer can make the assumption that Ninjas vs. Pirates players have an interest in online games.

  38. You can go both ways on the advantages and disadvantages of a service dedicated to one function (Twitter, Likaholix) vs a service capable of multiple functions (Facebook). However, remember that information may be gleaned from more than status updates. If I share a Siobhan Donaghy video on Facebook, that indicates to everyone that I have an interest in that artist, which could be valuable marketing information. And frankly, a marketer can make the assumption that Ninjas vs. Pirates players have an interest in online games.

  39. So … you think people who join a SOCIAL networking site, Facebook or any other, will stay there and sit still while you mine their “data” and advertise “at” them? (Aside from the question of how much of the “data” on social sites is true …)

    Does the recent history of TV viewing behavior since the invention of the remote control, VCR, TiVO, etc., offer any insight?

    If you want to market in social sites, step away from the charts, graphs, columns of numbers, and join the conversations.

  40. So … you think people who join a SOCIAL networking site, Facebook or any other, will stay there and sit still while you mine their “data” and advertise “at” them? (Aside from the question of how much of the “data” on social sites is true …)

    Does the recent history of TV viewing behavior since the invention of the remote control, VCR, TiVO, etc., offer any insight?

    If you want to market in social sites, step away from the charts, graphs, columns of numbers, and join the conversations.

  41. […] returning to vogue as a result of coverage it’s received lately from folks like Robert Scoble and Jesse Stay. Perhaps it’s just my inability to really get Facebook, or perhaps I’m just willing to say what […]

  42. My questions weren't about whether that's where Facebook is going, but whether Facebook (and online marketers) are engaged in wishful thinking and ignoring the quite recent history of media and advertising if they plan to mine the kind of “data” folks put on social sites and then deliver ads expecting anyone to pay attention.

  43. I'm not technical enough to banter with you guys, but I can at least tell you that I MUCH prefer Twitter. The knowledge I have gained through Twitter is remarkable, and I love not having to deal with the plant my garden junk. It's a PITA getting around FB, and just try to find someone's 'Fan' page easily … I don't even like the 'Fan' page concept. Fan pages are for Hugh Jackman. Give me Twitter any day (if I had to chose just one).

  44. It sounds like an angle on stats tracking. What about real time mining? Does FB allow you to target the exact user and their comment at the moment of creation?

    Twitter's real time search attaches a real person to real time comments. You can search on twitter (http://search.twitter.com/search?q=need+massage) or you can use tweetdeck which makes it a lot easier to receive your notifications from your desktop.

    So if you are selling pancakes you will find all of the real time news about pancakes on your desktop!! Then you can serve pancakes (follow) the user soon after they thought about eating pancakes. Hopefully they appreciate hearing from you because this person is hungry for pancakes!

    New FB force feeds like twitter now. I am not sure if they have a feature like that can deliver search results for real time?

  45. Conor, they don't. My purpose here was just to show what the potential
    could be. There are only a few things they would need to add to make that
    happen though, and it would provide much richer data than Twitter could ever
    provide.

  46. It sounds like an angle on stats tracking. What about real time mining? Does FB allow you to target the exact user and their comment at the moment of creation?

    Twitter's real time search attaches a real person to real time comments. You can search on twitter (http://search.twitter.com/search?q=need+massage) or you can use tweetdeck which makes it a lot easier to receive your notifications from your desktop.

    So if you are selling pancakes you will find all of the real time news about pancakes on your desktop!! Then you can serve pancakes (follow) the user soon after they thought about eating pancakes. Hopefully they appreciate hearing from you because this person is hungry for pancakes!

    New FB force feeds like twitter now. I am not sure if they have a feature like that can deliver search results for real time?

  47. Conor, they don't. My purpose here was just to show what the potential
    could be. There are only a few things they would need to add to make that
    happen though, and it would provide much richer data than Twitter could ever
    provide.

  48. John, this just shows the potential. Facebook still has some work cut out
    for them, but they do seem to be moving much faster than Twitter. They also
    have way more resources than Twitter does at the moment.

  49. Jesse, I see a huge problem for Facebook getting the majority of their users to (knowingly) allow their personal feed stream to be publicly accessible.

    Because the entire service was started on the premise of a Walled Garden where it was safe and private to connect with your (mostly real) friends and acquaintances. Already, I am hearing (via Steve Gillmor) that supposedly as many as 94% of Facebook users responding to a poll about the new “Twitterized” design dislike it.

    Twitter is in a whole other gear in terms of speed, and the felt need of it's most ardent users to express themselves. Currently, due to the number of very active Twitter users who employ any number of client programs to send and read updates, the raw data from Compete.com re:visits does not tell the whole story. My guess is that the current 20:1 visit ratio in Facebook's favor is off, I could easily see it being only 10:1 or even better.

    And most importantly, except for a few unfortunate souls on Twitter who have set their updates to “Protected”, there never has been a supposition of privacy, indeed, it tends to attract those that do not mind, do not care, or WANT to overshare… 🙂

    While on Facebook users treasure their privacy a lot more, and would react VERY negatively if e.g. the Personal Feed were to be opened to the public by default. Remember what happened with Beacon?

    I would agree that there are data mining opportunities on Facebook, it's just that Facebook likely has to sell those to the highest (corporate) bidders, i.e. you or I are not likely to be getting open access to it. Even with that Facebook would have to be very careful as to privacy issues, real or perceived, or the backlash could make the recent TOS disaster look like a complete cakewalk.

  50. yes, and that's why I think Facebook search will hit a much larger and wider audience than Twitter search. Once the masses figure that out no one will need to use Twitter. Facebook just has to improve a few things and they're there. I'm pretty sure they're working on that.

  51. I think that's what they're building it up to be. Again, look at the
    potential examples I listed of what they can do currently. It's a marketer's
    and news organization's dream if they could have access to all that data.
    That's why Twitter has taken off as well. I would have never seen Twitter as
    a search engine at its beginnings either. It just became that because it was
    more public. As Facebook becomes more public, it will be seen as a source
    for data mining and search just like Twitter.

Leave a Reply

Your email address will not be published. Required fields are marked *