-
Suw: I don't agree with Roy that subeditors aren't needed, but I do agree with the commenters who say that perhaps subbing needs to develop to suit the digital medium.
Yearly Archives: 2009
links for 2009-02-14
-
Kevin: Data scraping for the rest of us. How to use Google Spreadsheets to scrape data from web pages and tables.
-
A group of dedicated open-government activists have teamed up to push the federal court records system into the 21st century, much to the annoyance of the government.
-
Kevin: Friend and colleague Charles Arthur weighs in on the current micropayments discussion that has been revived, at least in my little corner of the web, by news organisations looking for a new revenue stream and looking to make digital content pay in ways other than reliance on advertising.
-
Kevin: Editors in the US with comments on their sites should invest the 20 minutes watching this video in which David Ardia explains Section 230 of the Communications Decency Act. David is with the Citizen Media Law Project at Harvard's Berkman Center for Internet & Society, but before joining the Center, he was the assistant counsel at The Washington Post. The bottom line is the for US publishers they can moderate comments without the fear that this exposes them to undue legal liability. It's not a case in which they have to make the binary choice of unmoderated comments or no comments at all.
-
Kevin: Discussions on three types of mashups: Presentation mashups, data mashups and logic mashups.
-
Kevin: Matthew Ingram talks about the Policy Wiki experiment at Globe and Mail in Canada. He describes it at "a combination of a traditional wiki — that is, a publicly-editable resource similar to Wikipedia — and a public discussion forum, with comments and voting features as well. In many ways, it’s a kind of social-media mashup aimed at pulling in suggestions from readers and other concerned Canadians about public policy issues."
-
Kevin: Worth reading and worth watching the video. BusinessWeek asked why the foreclosure problem became so severe in the US. They found after 70 interviews: "One reason foreclosures are so rampant is that banks and their advocates in Washington have delayed, diluted, and obstructed attempts to address the problem."
-
Kevin: The graphs help explain some complex economic events and why the last 10 years, a so-called "Golden Decade" were a-historical and why some of the financial models that allowed for the boom had too small of a time sample to be taken seriously.
-
Kevin: Nicholas Carlson of the Silicon Alley Insider looks at the cost of printing the New York Times. It's an interesting cost comparison albeit I'd like a little more clarity on the numbers he's using.
The comments are worth reading especially one by Thomas Lord talking about a competitive print on demand model. It's good to see some creativity creeping back into areas of the newspaper business model.
US law and comments on websites
David Ardia, on legal liability for comments online from Nieman Journalism Lab on Vimeo.
David Ardia, director of the Citizen Media Law Project at Harvard, talks about CDA 230, the section of the Communications Decency Act that provides some protection to people who run web sites.
Joshua Benton from the Nieman Journalism Lab at Harvard University says:
I wish every managing editor in the country could see this 20-minute video. I’ve heard so many misconceptions over the years about news organizations’ legal ability to police, manage, or otherwise edit the comments left on their web sites. They say “the lawyers” tell them they can’t edit out an obscenity or remove a rude or abusive post without bringing massive legal liability upon themselves — and that the only solutions are to either have a Wild West, anything-goes comments policy or to not have comments in the first place.
That’s not true, and hasn’t been true since 1996.

Android, e-ink and live news displays
Android Meets E Ink from MOTO Development Group on Vimeo.
Motorola Development Group is showing off a proof of concept with Google’s Android running an e-ink display. With Amazon’s Kindle showing some signs of success, it looks like e-readers might finally be reaching a tipping point in terms of adoption. What I find interesting in terms of not only the Kindle but also this proof of concept is the delivery of content wirelessly.We’re starting to see experimentation in terms of form factor for these devices. We’re not just talking about laptops, netbooks and mobile phones.
With the cost of printing the New York Times roughly twice as much as sending every subscriber a free Kindle, there might be a point where wireless delivery to an electronic reading device makes economic sense. This is very speculative and very much out in front of the market and most consumers, but as Nicholas Carlson points out:
What we’re trying to say is that as a technology for delivering the news, newsprint isn’t just expensive and inefficient; it’s laughably so.
Print is always cast in terms of habit. The argument is that people prefer the tactile experience of the printed page and the easily browsable format, but with the economics of print news delivery becoming financially untenable, it’s worth seeing what options are available and what options are developing.

links for 2009-02-13
-
Kevin: Steve Outing pierces some of the recent (and largely recycled) talk about micropayments and news content. As Online Journalism Blogger Paul Bradshaw says, newspaper content isn't like iTunes. You listen to songs several times, you don't read newspaper content several times. But Steve looks at a new model, Kachingle. Briefly, Kachingle takes the US National Public Radio voluntary supporter model with a model that allows users to reward content providers they like and not just traditional media but also bloggers. Steve goes through the details. It's a new idea. Will it work? Dunno. But it might be worth trying.
-
Kevin: Lisa Williams of Placeblogger writes about how journalists, just as technology workers before them, can survive and thrive as big companies fail. She writes: "You'll discover what thousands upon thousands of tech workers discovered: you can do great work outside of an institutional, big-company context, and you can make a living doing so. High tech companies didn't own innovation; the innovators did. News organizations don't own journalism: journalists do."
-
Kevin: Dan Lyons behind the Fake Steve Jobs talks about his time of obsessive blogging, and Robert X. Cringely writes: "We're at the end of one era on the blogosphere and the beginning of another. What the new one will be like nobody can say. Will the amateurs fade away and leave the game to people who actually know how to write and report? Or will the marketers complete their coup, leaving the rest of us old journos to scramble for jobs at Wal-Mart?"
links for 2009-02-12
-
Kevin: Chris O'Brien talks about location-based services and Google's new Latitute. He writes: "my concern is that it will take any of these location-based services years to attain the critical mass that would make them truly useful." It's a good piece that looks at the services, recognises the privacy issues but talks about the hurdles for their widespread adoption.
-
Kevin: I know that this isn't journalism related, but I'm going to start collecting stories about the financial crisis. This talks about the amount of 'goodwill' or intangible assets on bank balance sheets. In the bust, these 'assets' (sneer quotes intended) may be worth nothing and therefore require even greater capatilisation to support the banks than is currently estimated. It's ugly in the US, and it's even uglier in Europe. CDO and US subprime exposures are not the only issue for European banks. They have even higher levels of goodwill assets on their books.
-
Kevin: After the much reported comments about Twitter's possible money making idea of charging 'brands' for their use of the micro-blogging platform, Kara Swisher reads between the lines of a Biz Stone blog post on possible avenues Twitter might take. She seems (and probably rightfully so) snarkily suspicious about any plans that Twitter has to actually make money. Is Twitter's only really strategy to become too big to fail and then get bailed out/acquired by a bigger company? If GOOG buys 'em, will Twitter become yet another service that the search giant buys and then neglects?
-
Kevin: Matt Davis, director of news agency DataNews, said that the BBC could be 'the Freedom of Information Act's first major scalp' as its spending is made public'. Davis says that it will lead to inevitable trimming of the corporation's budget.
Guardian election road trip review: Geo-tagging
With the inauguration of Barack Obama as president of the United States now well behind us, I thought I’d take (a long overdue) look back at the road trip that I took during the US elections for The Guardian and talk about some of the things we tried in terms of innovations in coverage and what I learned from it.
This is the third trip that I’ve taken for the US elections. In 2000, I took a trip with BBC Washington correspondent Tom Carver. Webcasts were the thing of the day, and we took a portable satellite dish and a DV video camera to webcast live or as-live (recorded but treated as live). We answered a range of questions covering topics suggested by our global audience. In 2004, I took another trip with BBC News Online colleague Richard Greene. The trip was my introduction to blogging, and it set the path for my career for the last five years.
The common thread through all of these trips has been an attempt to engage the audience in new ways and field test new digital journalism techniques. Over a series of posts I’ll talk about some of the things that we did for US Election trip 2008.
Geotagging
As I mentioned last summer, one of the things that I wanted to try was geo-tagging. I was inspired by the GPS and geo-tagging function in my Nokia N82 to add this to our coverage. The camera in the N82 is stellar. With a 5 megapixel sensor and a brilliant Xenon flash, it is one of the best features in the phone. (I’d be interested in seeing what the new N85 has to offer, apart from the OLED screen. ZDNet has a review.) I’m going to focus on geo-tagging in this post and talk more about mobile newsgathering with the N82 and other smartphones in another post.
As good as the camera is on the N82, I knew that there would be times when I needed Suw’s Nikon D70, a proper D-SLR with interchangeable lenses. But how to add the geo-data? Dan Chung, award-winning photographer and digital innovator at the Guardian, and I had played around with a geo-tagging device from Sony, the GPS-CS1.
A geo-tagger at its most basic has a GPS radio and some memory. It records your location either every so often or after you move a certain distance. It’s not physically connected to the D-SLR in any way, but it does require you to sync the clock from the geo-tagger with the clock in your D-SLR. To add the geo-data to your photos, all you have to do is import the photos to your computer and import the GPS logs from your geo-tagger. Software then compares the time that the photo was taken with your GPS logs and merges the geo-data into the EXIF files of the photos. Newer high-end cameras such as the D200 have GPS add-on units (the GP-1), and point-and-shoot cameras like the P6000 have integrated GPS.
Dan had me test the Song geo-tagger a couple of years ago, and I wasn’t that impressed. It didn’t acquire the satellites very quickly, and Sony didn’t officially support non-Sony cameras. But although the accuracy wasn’t brilliant, the idea is sound.
I looked around and settled on GiSTEQ CD110BT. It has a sensitive MTK chipset with 51-channel tracking, and I found the accuracy to be frighteningly good. The GPS track plotted on Google Earth actually shows when I changed lanes in my rental car. The Sony could take minutes to acquire the satellite, but from a cold start, the GiSTEQ usually got a lock in less than a minute. A synthesised voice says “Satellites fixed” when it’s got a lock. To conserve power, it will shut itself off but wake when moved or vibrated. I carried it around my neck on a lanyard or in the pocket of my camera bag when I was out and about. A supplied light adhesive patch kept it on my dashboard while driving. The unit also comes with both mains (AC) and car chargers.
That’s the good. The bad is that while GiSTEQ says CD110BT will work on PCs and Macs, mine didn’t out of the box. It required a firmware update to work with a Mac, and the firmware updater only works on PCs and didn’t like Windows XP running on Parallels virtualisation software. Fortunately, my friend Andy Carvin at NPR gave me five minutes on his PC to update the firmware, but even after that, I had difficulty getting the device to consistently download data. GiSTEQ has since released a new update that they say fixes this. I downloaded some GPS logs tonight without a hitch.
I’d like to try the Amod AGL3080 (review in Wired), which is touted as a driverless geo-tagger. It simply mounts as an external drive on Mac or PC, and all you need to do is copy the data from it. It uses a highly accurate SiRF III chipset. Unlike the GiSTEQ which is charged via the USB cable, the Amod runs on three AAA batteries. Kevin Jaako has a thorough review of it on his blog.
The software that comes with the GiSTEQ promises a lot and delivers most of it without too much fuss. It’s actually rebranded software from JetPhoto, and as the company says on its site, you don’t actually need a specialised geo-tagger. There are several Garmin or Magellan GPS units that will work with it. The software also works quite nicely with the N82, instantly recognising that the photos already have geo-data embedded in the files. If the geo-data is off, the software has a nice interface to relocate and update the geo-data. It also has a built-in Flickr uploader, although it could be a bit more intuitive and work more seamlessly with Flickr title and description fields.
But I didn’t just geo-tag my photos. I also geo-tagged my tweets using Twibble, a geo-aware Twitter app Nokia S60 phones. Twibble integrates seamlessly with the GPS on the N82. It also allows you to upload pictures you’ve taken with the phone directly to TwitPic. We just used this all to great effect for Guardian Travel’s first TwitTrip with Benji Lanyado. It is pretty heavy on the battery, but I had a power inverter in the car so everything was fully charged all the time. It was also a bonus to have Nokia and Google Maps on the phone for navigation.
I also geo-tagged all of my blog posts. I either took the geo-data from a Tweet or a photo, or if I didn’t have any geo-data handy, I used sites like Geo-tag.de or Tinygeocoder.com to generate geo-data from an address.
Visualising the trip
Thanks to a quick bit of python scripting by Guardian colleague Simon Willison, I have a KML file for all of the 2059 photos that I took over the more than 4000 miles of the trip. One of the reasons that I wanted to geo-tag pictures, posts and tweets was that while I know most of these towns, I wanted to give a global audience a sense of place.
But apart from easily visualising the trip, why all the fuss to do this? Adding geo-data to content is one of those fundamental enabling technological steps. It opens up a world of possibilities for your content. By geo-tagging your content, it allows users to subscribe to content based on location. Geo-tag your movie and restaurant reviews, and you can start leveraging emerging location-based services on mobile phones. With Google Maps on mobile and other mapping services, news organisations could provide real-time location based information. Geo-data allows users to navigate your content by location instead of more traditional navigation methods.
Some companies are already dipping their toes into geo-data. Associated Press stories hosted on Google News have a small inset Google Map inset based on the location information in the dateline. New York Times stories appear on Google Earth. But datelines are imprecise because they are city-based, but when you pull up more accurate data you can do much more. You can see the possibilities of mapped information on Everyblock.com.
But to get from most news sites to Everyblock, you’ve got to put in the foundational work both on the technical side and the journalistic workflow. Having said that, it’s not rocket science. It might seem a lot of work up front, but once the work is done, geo-data provides many opportunities, some of which could provide new revenue streams.
links for 2009-02-11
-
Kevin: Just in time for Valentine's Day, suggestions to save the newspaper industry. Page One Girls plus edible pages. My personal favourite is the ch'i sucking micropayment system.
-
Suw: Some really fabulous data visualisation work. I particularly love the Britain From Above suff. Not just fascinating, but beautiful too.
-
Kevin: Michael Kinsley founding editor of Slate on the folly of micro-payments and news. He not only spikes the idea of micro-payments, but he also talks about the supply and demand issues in terms of content and news.
-
Kevin: Looking at some of the Silicon Valley startups and companies that are doing well in the recession. The companies include virtual malls, social networks, spam and spyware filter companies. It's interesting to look for patterns in the companies that are weathering this downturn.
-
Kevin: My colleague Keith Stuart writes a nice eight step guide to how to develop iPhone apps. It reminds me of watching Olympic skiing. He makes it look and sound so easy.
-
Kevin: Martin Stabe asks on Twitter: "how have I missed this brilliant site?" From the About page of the blog: Information Aesthetics is designed and maintained by Andrew Vande Moere, a Senior Lecturer at the Design Lab at the Faculty of Architecture, Design and Planning of the University of Sydney, Australia. His research interests include data visualization and visual design, from traditional screen-based interfaces, over "media architecture", to more explorative, artistic and wearable applications. His teaching comprises interaction design, physical/wearable computing and 3D real-time multimedia.
links for 2009-02-10
-
Kevin: Clayton Christensen and the disruptive-innovation crew from Harvard — who developed the NewspaperNext program with the American Press Institute — struggle to get us to understand how and why simple, low-end, inadequate, "junk" products and services so often topple the big guys.
-
Kevin: This is a very interesting piece that raises a lot of questions about columnists and abuse. I'd really like there to be a clearer differentiation between columnists and journalists. I think this piece slightly blurs the lines between the two. As far as I can tell, this piece is about columnists and a former Gawker blogger. But maybe I'm holding too closely to the US separation of columns and reporting. The comments are very much worth reading. The one thing I would say is that columnists are often shocked by the tone of the 'debate'. However, if you read the columns, they don't set the stage for a debate but rather seem written solely to provoke a reaction. Again, read the comments if you're running a comment site. They make some reasonable and very valid points.
-
Kevin: A good analysis by the folks at Bivings of the top 10 best US newspaper sites (from the top 100 newspapers in the States by circulation.) There are some good mentions in the comments from sites that don't fit those criteria. Check out the WikiJax feature at Jacksonville. It's an interesting innovation. I wonder if we wouldn't increase newspaper usage if we explained our features better. Of course, the best features and web sites explain themselves.
-
Kevin: Let the British media iPhone app rush begin. The one thing to note in this release is how ITN will enable offline video access.
-
Kevin: BitTorrent site Pirate Bay has just released a Google Maps mashup showing their worldwide user base. Janko Roettgers has some good analysis of the numbers. It's just a snapshot in time. It's also interesting to see where BitTorrent, or at least Pirate Bay, isn't used widely such as Africa and the Middle East.
-
Kevin: Some great sources of where to follow the Australian Bushfires via social media. I've been using a search based filter on Tweetdeck to follow the fires.
-
Kevin: I usually find mobile trend watchers in denial about the industry. They focus on handset manufacturers and ignore the speed bump/impregnable road block that the carriers are. But this trend list for '09 seems reasonable. I think we're finally seeing some movement in terms of Location Based Services. Apps are finally breaking the on-deck strangehold carriers used to have in terms of mobile data. Definitely worth a look.
Barriers to innovation
This video, made by a team at NASA as part of a project to shake up the overly bureaucratic culture there, is spot on, not just for NASA but for so many businesses.