I spoke at the BigThink Search event, where the Google-Bing controversy came to fruition. This was an aside with O’Reilly media about how search can influence news presentation, and how FanFeedr uses social signals, and the people who generate the signals to refine the prominence of a particular story, team or player.

Feedback welcome and appreciated, as always.

Thanks, FanFeedr

Much has been written about News Corps’ the Daily as a news product, both pro and con, and how it compares to another forward-thinking, magazine-like sibling, FlipBoard.

What is of greater interest is how the product chooses what to cover, and how that delivers value to users.

There are four ways to assign the news, and five ways to present it. We are going to focus on the former, saving the latter for another post.

How to assign the news, or how to decide what to cover . . .

• Editorial
• Curatorial
• Algorithmic
• Algorithmic plus on site interactions

Editorial

Human beings (I am one of them!) provide great news judgement, but can often lag behind the information zeitgeist or misjudge it. There is no reason, in 2011, to make editorial and assignment decisions in a vacuum.

A purely editorial lens uses an editor, obviously, to make decisions about what to cover. They may not care what is trending on twitter, or the page views that they received on the stories from yesterday, or what their competition is covering, and the attention that various subject areas received.

I am not accusing the Daily of being purely editorial. However, in the absence of an editorial mechanism that is actively mining the data of who is looking at what, when, in what volumes, and with what authority, one is left thinking that just using Bob or Sue Editor is not enough.

Curatorial

Using a curatorial lens instead of making purely editorial decisions about what news to cover is not just a sidelight, or auxiliary plan for coverage. It is the most fruitful means to cover the largest number of events in the absence of infinite staff.

While the 100 journalists at the Daily is 100 more journalists than we have at FanFeedr, the application isn’t going to be able to deliver articles that hit the sweet spot of trending topics, garnered through social media, which is something that Business Insider, BuzzFeed, the Huffington Post, SB Nation and Bleacher Report seem to have pinned down quite nicely.

UPDATE at 1.54p ET: These sites use analysis of trending topics via Twitter and/or Google Trends to drive news coverage. Vin Diesel in a car crash? Let’s write an article about Vin Diesel, and a piece on celebrities who get into car crashes. Tiger Woods exposed? Let’s get salacious pictures of his special friends through their social media profiles. The technique looks at hot topics and then uses those topics to drive coverage. A curator also looks in a slightly longer timeframe, like the last 24 hours or week, to tease out the topics that are driving continued interest. You don’t need to do this for a subject like politics, but covering specific political figures will have greater resonance based on their frequency of mention, or prominence.

The curatorial lens has a downside: it can devolve into subject areas that some may find less tasteful. It does allow any publication, including the Daily, to both react well to areas of potential user interest as well as determine areas of coverage for future focus.

You can get a sense of how the Huffington Post does this here.

Algorithmic

The third way of making editorial decisions about coverage is using a purely algorithmic framework to suss out what people are talking about, and then present the “hot” news to users based on real-time interactions across a large body of content.

One might suspect that Google News is crafted this way, but, in fact, they have humans sitting on top of the algorithms.

Many of the SEO content farms, as they are somewhat disparagingly labelled, pursue this avenue for assignment purposes. Simply put: they exploit opportunities to attract search traffic. These opportunities are gleaned through data analysis and then assigned to writers at low cost.

They use a single signal: search queries.

Algorithmic plus on site interactions

The fourth way for editorial presentation is using trending topics through social channels, and then refining those topics based on attention signals off of one’s own site. Put simply, this is a more refined version of the purely algorithmic take, and it requires data mining user interactions at scale, but in a way that competitors cannot.

Two concrete examples:

• Bleacher Report has an email newsletter that has over 1MM subscribers (they have stated this publicly.) They use the interactions of their users through those newsletters to determine areas of interest for coverage, in addition to their other data mining techniques. No one else has access to this data.
• Gawker Media promotes a single story on front of its new websites, based, again, on a set of interactions that only Gawker can measure, in addition to their normal story coverage techniques, and they also have the scale that makes their private user feedback a valuable tool for refining their coverage.

Human beings don’t play a role here, but this process is highly dependent on having enough signal to understand both what is happening on social channels and the interrelationship of internal (site and application) data with the “signals” at large.

The joint venture between bitly and the New York Times, News.me, pursues this logic. The JV can use Twitter + Bitly to do this type of news presentation at scale, and accurately.

They have access to bitly’s click-stream data for discrete URLs in addition to perhaps the most robust analysis of social media information pursuits through the use of shortened bitly URLs across social media.

FanFeedr, our company, does something similar, but just for sports.

Conclusions

• Of the four, the purely editorial lens will show greater distribution in page views and time spent across all of its individual news products, as it will tend to be hit or miss.
• The curatorial product will show a more tightly clustered set of viewers, but greater volatility over time, depending on whether scandal is in the air or not.
• Curatorial products love controversy because they add kerosene to the fire, in a good way. Purely curatorial products also introduce latency into news coverage, in that they can’t cover the news as it is happening, because they require signals (both social and sharing based) that necessarily trail the actual event. With this technique, you can’t assign a story about a high-ranking Senator caught in flagrante at the local Applebees until there is a social media reaction to that event.
• The purely algorithmic product can be victimized by being banned, as the search engine Blekko has done (and Google may do),  gaming (companies or individuals affecting topic popularity through unethical/non-natural means) or an insanely devout fan base (tip of the hat to Justin Bieber).
• The blend of algorithmic plus internal signals can also get gamed, but the gaming is less likely because of the diversity of signals used in the analysis, assignment and feature presentation. Is it also less latent that a purely curatorial model, because humans aren’t involved.

We aren’t advocating one technique at the expense of the other, but suggesting that two or three of the techniques, used in a complementary fashion, will yield the highest user value. HuffPo uses a blend, as does Gawker, SB Nation and Bleacher Report.

Right now, there aren’t enough “hit” stories on the Daily that personally appeal to me or that I couldn’t get elsewhere.  The Daily can solve this by adopting a larger umbrella for linking to third-party stories, and choosing those stories based on user interest on their site and elsewhere.

Essentially, they need a more diverse story selection model to deliver greater individual value to individual users.

Last but not least, to really refine their news presentation model, they should actively promote sharing for every content item, including excerpts from articles and videos, so that they have a proper internal feedback loop for what is working and what is not. They currently enable posting to Twitter and Facebook, but it isn’t granular (that is, at the sub-story level), and leaves little UX affordances for color commentary.

The last feature that they can add to deliver greater user value, and something that we do at FanFeedr (self-promotion alert), is provide users the ability to personalize based on topics of interest, and if they used Facebook authentication (which they do not), they would be able to pull in user interests directly from their profile, and then customize the news delivery based on those explicit preferences.

Yes, we are behind with our product releases, and it is because the writer of this blog has been focused on the revenue-generating aspects of the business to the detriment of clear communication about product releases and the hard work of our engineers. Situation remedied today, as . . .

Sprint 7

• Supporting Champions League soccer as an independent group, and this wasn’t easy
• Formally created our HTML5-compliant application, which you can check out here.
• Deployed our customized FanFeedr for Athletes product for Visanthe Shiancoe. You can check it out on Twitter or Facebook.
• Added standings to all of the soccer/European football leagues. Check out the Premier League.
• Added rosters for all of soccer/European football. This means that you can also follow individual players, like Leo Messi.

Bugs

• Fixed the way ties are displayed for soccer/European football results
• Changed “soccer” to “football” wherever we could to least offend your sensibilities
• Posting comments to Twitter on the website was not working, but it is fixed now

Sprint 8

• Redskins Feedr now live for the iPhone and iPod Touch (previously iPad, Android only.) Yay!
• Added live updating to the FanFeedr HTML5 application
• Integrated Google Authentication for the FanFeedr HTML5 application
• Made it so that fans of a league, like NFL or NBA, will see more popular stories when using their FanFeed
• We added in videos that we aggregate, so you should see more of those

Bugs

• Deleted preseason NBA games so that they didn’t show up as betting opportunities
• Fixed team records to show record for Champions League vs. national league, in context.
• Slate of fixes for the Chrome application
• Our aggregation of Tweets fell down, go boom, so that is back and functional
• Fixed caching on team records, which made them seem slightly out-of-date
• Fixed schedules for soccer/European football teams. Check out FC Barcelona’s schedule, for example.
• Comment notification emails now linking to the right place.

As always, thank you for supporting us, and let us know what we can do to make your experience better by using the big red “Feedback” tab on the left-hand side of every web page at FanFeedr.

Thanks, FanFeedr

Recap of the features in this week’s release:

• We have access to a bigger slice of Twitter, so the “Hot Topics’ module on the home page is now even more accurate (though Liverpool fans still talk about their team quite a bit)
• We have decided to suppress tweets in our mobile applications after you folks asked us to do so
• Minor bug fixes

As always, thanks, FanFeedr

Michael Arrington at TechCrunch famously suggested that if one were to build a news organization from scratch, one path would be to hire away the top 50 writers at the New York Times without all of the attendant cost (pensions, printing plants, editors, etc) and put out lean/mean journalism.

A smart tactic, but one that still would rely on editorial judgment about what news should be presented. Smells like latency to me.

Yet most organizations that focus on news, and its associated verticals (financial news, entertainment news, sports news, and so) pursue a model that relies upon editorial judgment to determine what gets published. This has remained more than unchanged, calcified, perhaps, since 1994. It is the most linear adaptation of an old-school publishing metaphor that one could concoct.

The other technique that news sites can pursue is social media sensing about what people deem important. This doesn’t suggest that humans can be done away with in the story selection process, but determining weight and heft, and what is important, should be driven by what people are paying attention to right now, not editoral-historical perspective about importance.

This can be done by sampling Twitter, Collecta, OneRiot and other real-time engines for the topics, stories and subject matters at hand, and determining the relative weight of story importance based on mentions, velocity of the mentions, the authority of the person and/or the site making the mention, and other algorithmically-driven analysis.

The Huffington Post has managed its way to 24MM monthly uniques using a small group of freelancers, some staff, and better judgment about the zeitgeist by leveraging social trend data to determine subject matter. This is higher order prioritization than human judgment, but still trails real-time by a lengthy period. They also have a right-column that shows their most popular stories, and this serves to drive a great deal of traffic on the site.

Even faster in terms of approaching real time is the approach taken by Jonah Perreti’s smart BuzzFeed. Compete places them at 2.2MM monthly uniques with a network reach just south of 80MM monthly uniques. They know, more than most other sites, when a piece of content is going viral, which is different than news judgement, but my point is that it is complementary, and worth as much (and requires fewer people to inject themselves into the process.

Most news outlets are using humans for editorial judgment. The next level in the just-memed “Pyramid of Publishing” is the HuffPo, a little bit of the Daily Beast, and some elements of BuzzFeed that are news-related. There are others in that next tier, to be clear.

The top of the pyramid is rarified land, with a few enterprising souls and some big companies dabbling in real-time + news categories +/- media assets.

Some examples include Brizzly, Bitly TV, the aforementioned Collecta and SkyGrid (iPad only.) (FanFeedr, does this on a personalized basis, for sports.)

There is going to be ongoing friction between these five categories of news prioritization:

• Editorial: fleshy people making decisions about what is important
• Real-time: streams of relevant news around a topic
• Wisdom of the crowds: leveraging implicit and explicit interactions, sharing, commenting, and views, to determine popularity.
• SEO-driven: Demand Media, Aol and others are pursuing this approach
• Local: This is actually an orthogonal dimension that can frame any of the above items on a geo-located basis.

For organizations that want to carve cost out of the equation and still drive customer value, the prioritization should be Real-Time, with a “What’s Hot” component. For extra credit, provide a local window into the above items.

The new Newsweek, despite its shortcomings (and lack of time-stamp on its articles), is broadly tackling this head-on, which is a good thing, and others who pursue this strategy will find greater dividends on their news-gathering investment.

For another point of view on this subject, Robert Scoble has posted a smart take on the seven needs of real-time curators here.

This week’s release had some fixes that make possible publishing last week’s free agent-focused news anywhere. Here are some examples from the Knicks.

• View the Knicks Free Agents website
• Follow Knicks Free Agents on Twitter
• Fan Knicks Free Agents on Facebook

As an aggregation and distribution service we make the best choices we can about what information to corral and where to send it. However we aren’t always exactly right for everyone. Accordingly, last week we added a feature that allowed you to suppress Twitter across the site, and this week we made a less visible change and now support OAuth. We will be adding this to our API documentation shortly, but if you can’t wait and want to integrate now, drop us a line.

In release-related news, this will be the last weekly release for now. We are fine-tuning our development model by adding some planning overheard and extending our development cycles to two weeks. We will occasionally do point releases with bug fixes, but going forward major releases will be every two weeks. This will allow us to continue delivering great new incremental features while we lay the foundation for bigger leaps forward.

Thanks, FanFeedr

This is a pretty straightforward release: Pick’Em has been added to the FanFeedr home page so that you don’t have to search for it.

You can pick games directly on the front of FanFeedr.com so that you don’t have to go to the Pick’Em homepage.

Also, we added a new World Cup news section on Facebook.

Let us know if we can provide you with other features right here.

Thanks, as always, FanFeedr

and they have been answered. No longer will you get all 54 versions of AP stories on Matt Holliday’s latest bon mot. We have smartly figured out how to stop that scourge of duplication, the wire story, from showing up all over the place.

The highlights from this week’s release:

• Fixed the leaderboard so that we only show in-season sports. You can pick the Final Four teams here, by the way.
• Twitter
  • You can choose whether we publish your game wins to Twitter, and how frequently
  • Your badges will get published to Twitter as well
• The Formula 1 Times is back up, as we have their new RSS feed
• You can find metropolitan areas like Bay Area and Chicago just by typing them in the search bar. This allows you to follow all of the teams in a city in one fell swoop.
• We have re-ordered your badge placement on your profile page so that the most important badges are on the top of your other, somewhat less important badges
• Usual stomping of the bugs

We hope that you are looking forward to the start of baseball this Sunday as much as we are, and don’t forget that the Pick’Em game works pretty nicely for  MLB as well.

Let us not forget: our iPad application is available RIGHT now, for those of you who want the best sports application on the iPad, with the usual personalized FanFeedr goodness.

Thanks, Feedr of the Fans

Hello and good morning/afternoon/evening.

This week we enabled the ability to sign up using Twitter as well as Facebook, so if you would like to use those credentials as the primary way you login to the site, no problem. You can also post material to and from Facebook, but you will be known on the service primarily by your Twitter handle.

You can try it out by going to the homepage and logging in with Twitter. If you already have an account with us, you can add your twitter credentials whenever you make a comment and post to twitter or if you share via Twitter.

Facebook

You can follow your favorite teams on Facebook now, and that functionality is exposed on the team pages (in the left column, the blue button.)

Some examples of team pages on Facebook:

• Soccer-Arsenal
• College Basketball-Kentucky Wildcats
• NFL-New Orleans Saints
• MLB-Yankees and Red Sox
• NBA-Lakers

These feeds publish headlines, scores, boxscores, photos and other updates directly on Facebook.

Pick’Em Game

• We fixed the badging so that there is only one Commissioner, and so that Newbies show up in the right place

Content

• We added the mildly unintentionally funny Ozzie Guillen’s twitter feed for your consumption
• You can also get Bill Simmons, the Sports Guy
• And Deadspin, so that you don’t have to go hunting for your favorite sports writers
• Baseball schedules for 2010 are up on the team pages for MLB

UX

• We reformatted the team and player pages so that they look good (that is, not like a ransom note) in Internet Explorer 7 and 8, which are super finicky about style sheets
• Roster pages have been cleaned up to look like our super fresh schedule pages

And we are up to 7,000 content sources, including all of the material submitted in the past month.

Thanks for your support, and let us know if we are missing anything, here.

FanFeedr

• More content: Over 6,700 sources
• Better team info: we re-organized rosters, schedules and added logos to all of the teams
• Reorganization in advance of March Madness: logos, moved all of the teams into their proper conferences

That’s it, more racing stuff coming this week.

Thanks for supporting us, FanFeedr