• Home
  • Projects

Rev Dan Catt's Blog

A random collection of random thoughts

Feeds:
Posts
Comments
« DayNotes – Mon 12th Sept, 2011
Just discovered Playlistify for converting my last.fm loved tracks to Spotify »

#opennews, JSON and the later on today guardian

21 October, 2011 by Reverend Dan Catt

Latertodayguardian appspot com(screenshot from: http://latertodayguardian.appspot.com/)

Dan Roberts has been running an experiment over on the Guardian for the past two weeks, and it’s an experiment I wholely approve of, the Open News Lists. The idea being that we have our Open Platform API which pushes out the news we’ve already posted to the website, but this is displaying what stories the Guardian is thinking about and publishing soon.

I like to think of it as open sourcing the Guardian, even if not technically correct its a good philosophical standpoint.

The idea of seeing what a newspaper is planning (along with the chance to get involved) is I think, pretty exciting. It’s also a position that’s been made more understandable by the explosion in Twitter. You often see the comment that people saw the news on Twitter first and somehow this means that news orginisations are too slow or don’t respond quickly enough. The obvious truth is more along the lines of checking facts & trying to explain the background for context more than 140 characters will allow, which of course takes time.

An Open News List is an interesting hybrid, it’s an acknowledgement that we know something has happened or are aware of it coming up and encouraging a discussion to take place on twitter while the editors and reports put the piece together, including that feedback and those tips from twitter.

The experiment was quickly put together using the tools at hand, trying things out at it’s best! Google Spreadsheets and it looks like this…

Open newslist | News | The Guardian

Which is great’n'all for the raw data-ness of it, but possible not that easy to read or more importantly engage with. I figured it’s be good to have the data presented in a more approachable fashion. But being busy I did what any good developer does, build a JSON endpoint for the data and hope that someone else does all the hard work ;)

A couple hours later with Google AppEngine and an endpoint is born:

http://opennewstracker.appspot.com/api/gu.get.newslist

The output looks roughly like this…

Opennewstracker appspot com api gu get newslist

…the same data from the spreadsheet but turned into a format that’s really easy for computer programming languages to understand and handle. In short, it’s still not pretty or good for humans to read, but a really useful mid-point between the source spreadsheets and data that can more easily be turned into something human readable.

Chris Thorpe took the JSON endpoint, worked a bunch of coding magic and turned it into the later today guardian, from which the top screenshot is taken…

“It hauls in the newslists using the very nice JSON feed created by Dan Catt and it then makes a column layout. One thing is it gives you a chance to interact with the journalists. If the story is in the “help” phase you can send a tweet tagged with #opennews to the journalist using a Twitter web intent“

This is now the part where I wrap up with comments about how this reflects the distributed network of ideas, journalists, editors, developers & users and an example of small pieces loosely joined. Along with the stressing of the “It’s all very experimental” part, Dan Roberts is experimenting with open news lists in the simplest quickest form possible, I created an experimental scraper to convert it to JSON and Chris created an experimental version 0.1 webpage that formats the JSON.

But all those rough experimental bits put together is pretty good, none of us had to do the whole thing from start to finish and no-one was in-charge & orchestrating the whole thing.

More about the Open News Lists:

This Week in Review: An open-newsroom experiment, and News Corp.’s troubles spread to the WSJ
Memo to newspapers: Let your readers inside the wall
Guardian to publish daily newslist online
Guardian: Lessons from our open news trial
Is An Open News Approach The Way To Go?
Guardian to Readers: Here’s Our Upcoming Stories ListLessons from our open news trial

Posted in guardian, hack | 2 Comments

2 Responses

  1. on 21 October, 2011 at 2:04 pm Paul Morriss (@paulmorriss)

    Woah! This is mind boggling. I thought those spreadsheets were vaguely interesting, but I didn’t spend long looking at them. However what Chris has done has made it look great and made it so simple to interact with the reporter.

    I think I need to lie down in a darkened room now until my mind is de-boggled.


  2. on 14 December, 2011 at 6:09 pm Gilda Parrella

    I am intrigued by this process. Perhaps you and your readers would be interested in a couple of short articles of mine published in the Fall, 2011 issue of Harvard’s Nieman Reports that may add another dimension to your approach. I am proposing a new approach to online journalism merging mediation with journalism to cut through the polarization that is paralyzing our political processes. If you are interested you may find these ideas in “Consensus-building Journalism: An Immodest Proposal” and “What Mediation Looks Like for Journalists”
    which attempt to involve thoughtful diverse points of view in a search for common ground.



Comments are closed.

  • About

    Dan Catt works at the Guardian doing some serious (and not so serious) number crunching. Previously he spent 4 years working at Flickr as a frontend engineer (+stuff), from when it had newly moved to California until about 4 Billion photos later.

    These views do not reflect those of the Guardian or Flickr. Apart from any sweary bits which totally reflect those of Flickr.

    Twitter: @revdancatt

  • Subscribe

    Posts.

  • Recent Posts

    • The last tiny problem I had with Blue Peter Totaliser as a child
    • Guardian Hack Day, Secondary Attention and 24 Hour Drone News Headlines Internet Radio
    • 2012 – A Year in Review
    • Last Friday, in photos
    • Flickr, Instagram, the Social Graph and Interfaces effecting behaviour
  • twitter

    • (which is essentially a 650 word version of this 140char tweet: https://t.co/1rs3UsLN) 2 hours ago
    • Blog, I wrote about the hateful Totaliser "The last tiny problem I had with Blue Peter Totaliser as a child" http://t.co/uP1eHu4m 2 hours ago
    • Having a cup of tea, because that's what I do now, drink tea. I keep forgetting. 19 hours ago
    • Dusting off some old AR video/face detection code to see if it even still works. 20 hours ago
    • Evening/Night child; "I feel poorly", temp, burning up, whining. Morning child; crazy running around happy "hey parents why so tired?" :/ 1 day ago
  • Archives

    • February 2012 (2)
    • January 2012 (5)
    • November 2011 (3)
    • October 2011 (1)
    • September 2011 (1)
    • August 2011 (1)
    • June 2011 (5)
    • May 2011 (4)
    • April 2011 (5)
    • March 2011 (3)
    • February 2011 (3)
    • January 2011 (5)
    • December 2010 (5)
    • November 2010 (6)
    • October 2010 (1)
    • September 2010 (3)
    • March 2010 (2)
    • February 2010 (2)
    • January 2010 (5)
    • December 2009 (1)
    • November 2009 (2)
    • October 2009 (8)
    • September 2009 (5)
    • August 2009 (6)
    • July 2009 (8)
    • June 2009 (12)
    • May 2009 (13)
    • April 2009 (9)
    • March 2009 (14)
    • February 2009 (18)
    • January 2009 (17)
    • December 2008 (17)
    • November 2008 (10)
    • October 2008 (3)
    • August 2008 (4)
    • July 2008 (2)
    • June 2008 (3)
    • May 2008 (5)
    • April 2008 (6)
    • March 2008 (2)
    • January 2008 (4)
    • December 2007 (1)
    • November 2007 (1)
    • October 2007 (1)
    • August 2007 (9)
    • July 2007 (1)
    • May 2007 (11)
    • April 2007 (8)
    • March 2007 (7)
    • February 2007 (10)
    • January 2007 (25)
    • December 2006 (8)
    • November 2006 (32)
    • October 2006 (5)
    • August 2006 (1)
    • April 2006 (1)
    • March 2006 (6)
    • January 2006 (3)
    • September 2003 (1)

Get a free blog at WordPress.com

Theme: MistyLook by Sadish.