Visualisation for news and community discovery

I think that visualisations and interface innovation hold great untapped potential for journalism, not only helping journalists and audiences to see trends and understand complex sets of data but also as a tool that will dramatically improve news site usability. The last few years have seen a lot of innovation in visualising data with the advent of mash-ups and easier visualisation tools from Google, Many Eyes from IBM, etc., but there has been too little interface innovation for news websites.

By and large, news websites still reflect their print heritage. They make the classic mistake of rigidly reflecting their own structure while ignoring the semantic connections that cross desks and departments. Most news web site interfaces obscure the vast amounts of information we produce as journalists. Good interfaces go beyond design and search to issues of information architecture, user experience and discovery.

I believe that interface innovation can unlock the power of technologies, helping them break out of a small group of technically adept early adopters to a much wider audience. The Windows-Icon-Mouse-Pointer interface helped open up computers to a much wider audience than when command line interfaces were dominant. The graphical web browser helped unleash the power of the world wide web. In 1990, when I first used the internet, I had to learn arcane Unix commands to even read my e-mail. In August 1993, I used the seminal web browser Mosaic for the first time in a student computer lab at the University of Illinois, where I was studying journalism and where that groundbreaking browser was created. I instantly realised that the web browser would become a point-and-click window to a world of information, communications and connection.

I’ve been interested in interface innovation since the late 1990s when I first saw the Visual Thesaurus from a company then called Plumb Design, now called Thinkmap which showed the connections between related words. The company did even more impressive work for Sony Music and EMPLive, an online exhibition for Microsoft co-founder Paul Allen’s Experience Music Project. In many ways, the work was way ahead of its time and sometimes ahead of the capability of the internet. The projects used advanced interface concepts more often found in CD-ROM projects of the day than the internet. One of the things that impressed me about especially the EMPLive project was that it allowed virtual visitors to the navigate the music collection a number of ways, whether they were interested in time, genre or a particular artist. The presentation also showed relationships between elements in the collection. I like Robin Good’s description on the Master New Media blog of Plumb Design’s work:

The original goal at Plumb Design was to create dynamic interfaces to information systems that reveal interrelationships often obscured by conventional methods of navigation and information display.

In many ways, Plumb Design showed what was possible with data, semantic analysis and rich interfaces more than a decade ago.

While interface innovation has not been an area of focus for most news sites, thankfully we’re seeing some tentative steps forward after a post-dot.com crash period of stagnation. Slate has launched a service called News Dots. Chris Wilson describes it like this:

Like Kevin Bacon’s co-stars, topics in the news are all connected by degrees of separation. To examine how every story fits together, News Dots visualizes the most recent topics in the news as a giant social network. Subjects—represented by the circles below—are connected to one another if they appear together in at least two stories, and the size of the dot is proportional to the total number of times the subject is mentioned.

Like EMPLive and the Visual Thesaurus, News Dots helps show the interconnection between stories. The feature uses Calais, “a service from Thompson Reuters that automatically “tags” content with all the important keywords: people, places, companies, topics, and so forth”. Slate has built its own visualisation tool using the open-source ActionScript library called Flare.
Slate's News Dot project
It’s a good first stab, but Slate admits that it is a work in progress. I like that the visualisation clearly links to articles and sourcing information. I like that the dots are colour-coded to show whether the dot represents a person, place, group, company or ‘other’. I think there might be a possibility to better show the correlation between the tags, but as I said, this is a good launch with a lot of possibility for improvement and experimentation.

Another project that I think shows the potential of improved interfaces is the Washington Post’s visual commenting system called WebCom. As Patrick Thornton explains, it is a visual representation of comments n the site. As new comments are posted the web expands. Those comments rated highly by other commenters or those that spur the most responses appear larger in the web. The web not only allows for navigation and discovery, but users can comment directly from within the visual web interface.

Thornton says:

The commenting system was built in two weeks by two developers at washingtonpost.com. A front-end developer worked on the user interface, while a back-end developer created the database and commenting framework in Django. Because the user interface was built in one language — Flash’s ActionScript 3 — and the back-end in another, the Post can take this technology and put it on different parts of washingtonpost.com with different user interfaces.

Wow, that’s impressive in terms of turnaround time. Django is quickly becoming an essential tool for the rapid development of journalism projects.

Thornton points out that it doesn’t work on mobile browsers or older computers. I might quibble with the focus on most popular comments or comments that spur the most response; comments that draw the most responses can often be the most inflammatory or intemperate. Likewise, popularity often becomes self-reinforcing, especially when it drives discoverability as it does in an interface like this. I would suggest that a slider that weights other factors might be useful. A simple search or tagging system might help commenters to find threads in the discussion that interest them. Again, this is a good first attempt and, with the development time only taking a few weeks, it shows how rapidly innovations like this can built and tested in the real world.

It’s exciting to see these kinds of developments. News organisations are struggling during the Great Recession, but often these times of crisis spur us to try things that we might otherwise think too risky. Whatever the motivation, it’s good to see this kind of innovation. If this can happen during the worst downturn in memory, just think what we can do when the recession eases.

Social filters have replaced professional ones

Chris Anderson, of Long Tail and now Free fame, is obviously getting peeved at the questions he’s getting from journalists. He says as much in this interview at Frank Hornig at Salon.com. Probably the most important line in this rather tedious interview is when Anderson says:

I read lots of articles from mainstream media but I don’t go to mainstream media directly to read it. It comes to me, which is really quite common these days. More and more people are choosing social filters for their news rather than professional filters. We’re tuning out television news, we’re tuning out newspapers. And we still hear about the important stuff, it’s just that it’s not like this drumbeat of bad news. It’s news that matters. I figure by the time something gets to me it’s been vetted by those I trust. So the stupid stuff that doesn’t matter is not going to get to me.

[From Who needs newspapers when you have Twitter? | Salon News]

Like Anderson, I have developed filters to tune out much of what is in the media. A few years ago journalists were decrying the loss of the all (self-)important gate-keeping function that they said they performed. I got to a point where I thought that if that is what journalists think is their unique selling point then they’re doomed because they are doing a lousy job of determining what is really important.

I spend a lot of time sifting through, while ignoring, much of the garbage produced by media to find a few, small nuggets of information that are useful. I can afford to do that. It’s my job. Not only can I not imagine most people doing this, I think they stopped quite a while ago. They realised that the signal-to-noise ratio was so low that they were better served by just tuning out.

I can ignore most of the childish nonsense that obsesses the mainstream media. Honestly, if it weren’t my job, I would pay to filter out much of this noise. I don’t need to read the professional trolls aka columnists who try to tell me what I should be outraged about. I can figure that out for myself, thank you very much. I do pay for insightful analysis. Most of what obsesses the media is remarkably juvenile, and as the media’s fortunes have waned, they have becoming annoyingly shrill in trying to reassert their role in society. Watchdogs? Defenders of democracy? I wish. Mostly of the media operate as little more than professional gossips and hypocritical scolds.

For the last several years, I have said that the network is my filter. Through blogs, social bookmarking services like Delicious, Twitter and even simple things like email newsletters, I am passed incredibly relevant and high quality information. It’s not that I think professional journalists are superfluous. I just find that social filters are providing an extremely valuable service in recommending the best, most relevant information available.

We’re coming to an economic point where we as journalists have crossed a Rubicon where we can’t do more with less, we’re simply going to have to do less. We just don’t have the resources to create redundant content that provides little value to our audiences. We need to start looking to ways to filter the best information. We need to do it soon. We’re running out of time. Our audiences ran out of patience long ago.

@DW Global Media Forum: Blogging, citizen journalism and politics

Deutsche Welle BOBs 2008 winners

Deutsche Welle Best of the Blogs 2008 winners

Bloggers were well represented at Deutsche Welle’s Global Media Forum, in part because it was the first time that they awarded their BOBs – Best of the Blogs – to the winning bloggers in person. The forum was a stark reminder of internet theorist Clay Shirky’s observation that technology that is often used to pass time in the West can be an essential tool for expression and democracy in repressive countries. Blogging has become a powerful means of expression, reporting and organisation in countries around the world.

Blogging and citizen journalism

During a panel on blogging and citizen journalism, Israel Yoroba Guebo from the Ivory Coast said that in his country, “We hope that our journalists don’t end up in prison.” There is only one television channel and opposition political parties have no way to communicate their positions. He used to work for a newspaper, but he wanted an outlet to tell about the everyday life of people in his country.

Ivory Coast was divided by conflict in 2002 as rebels held part of the country. The political conflict didn’t just divide the country but also its people. He wrote on his blog Le Blog de Yoro about life in all parts of the country and tried to show that people shared the same way of life in an effort to bring about reconciliation.

He was asked whether blogging could have prevented the conflict. He said:

“In Ivory Coast, we didn’t see a way to prevent crisis, but if we had the blog, maybe we could have prevented some of the massacres.”

Another person asked him who was the target audience of the blog. Was it Africans, many of whom don’t have access to the internet, or was it audiences in Europe and the US?

He said that it was important to let people in other countries know what was happening in the Ivory Coast, but maybe his blog would also encourage others to take up bloggin. “The more bloggers that we have, the greater opportunity we have to talk freely,” he said.

The problem is that blogging there is difficult and expensive. They don’t have broadband and have to go to internet cafes to post. However, he said:

“You can at least give the world the possibility to express themselves. Something that would never be accepted on the television.”

Iranians do not have to be encouraged to blog. It is often said that Persian is the fourth most common language for blogs. Four years ago, women in Iran gathered outside of parliament to protest a law that prevented women from becoming president, but it was one of many laws unfair to women. The women decided to protest every day of the year against one of these laws, said Nazli Farokhi.

“We realised that 365 days was not enough,” she said, so they started the blog 4equality. It gives a chance for women who support the campaign to write about their experiences. She was asked about the security of the bloggers. Police have arrested 50 of their members, and four remain in prison.

During the BOBs award ceremony, she played the group’s anthem which describes the discrimination that women in Iran face and the hope that one day women and men can be equal there.

Threats to bloggers

A climate of fear due to threats of violence, intimidation or arrest face bloggers in repressive countries. Bloggers from China and Cuba were not allowed to travel to accept their awards, but instead had to record video messages for the BOBs ceremony.

Cuban Yoani Sanchez’s Generación Y won the award for best blog 2008. Appearing via video message, she said that having a blog in Cuba “can drive one to madness”: There are no internet connections in people’s homes, and bloggers are forced to go internet cafes or hotels that cater to tourists. The cost of using the internet for one hour is equal to a third of the average Cuban’s salary.

Zeng Jinyan won the Reporters without Borders best blog award. She’s the wife of imprisoned Chinese human rights activist Hu Jia, and she began blogging after being put under house arrest. She writes about life under constant surveillance by the Chinese authorities. She couldn’t travel to accept the reward, but was able to get a video to the BOB organisers. In the video message, she said:

“Blogging has brought new hope to my life.”

Ahmad Abdalla won the award for best blog in Arabic. When he started writing the blog, he said that he was only writing “about small things” and didn’t think that anyone would care about it. But, he added:

“But these small things are affecting my generation, these small things that we’re missing.”

Blogging in Russia

Eugene Gorny said that two or three years ago, he wouldn’t have predicted that he would be interested in the link between politics and blogs in Russia, but now people who were not previously interested are getting involved in the political discussion.

Most popular media channels or national newspapers in Russia are controlled by the government. They have no chance to report about opposition political leaders, protests or anything that the government doesn’t want known or discussed.

Andrei Illarionov, the former chief economic advisor to Vladimir Putin, says of Russia, “People enjoy a tangible level of personal freedoms, but political rights are almost absent, civil liberties are severely restricted and there are significant limits on personal security.”

The regime is afraid of any political activity of the citizens, and brutally oppresses them, Gorny said.

Russians first started blogging seven or eight years ago, but it was mostly for fun and for the self-expression of the internet elite. As the Russian government has seized control of the media, blogs have become an important alternative to the state media for people to discuss issues that are important to them.

A 2009 report by Russian search engine Yandex found 7.4m blogs in Russian, of which about 1m are active. There are 1m posts in the Russian language every day. Russian bloggers are journalists, opposition politicians or “anyone who has a story or an opinion to share”, he said. Journalists blogging are able to write about issues more freely than in the traditional media. But it doesn’t matter whether a blogger is a journalist or not, Gorny said. Rather, bloggers were judged by their peers about their ability to write about significant topics.

Many blogs have a huge readership and reach in Russia. Free magazine F5 reviews the hottest topics in the Russian blogosphere, coming mostly from popular blogging service LiveJournal. The magazine boasts a circulation of 100,000.

Bloggers write reports on what they see, publish documents such as Amnesty International reports, commentary on current events, coverage of protests and quotes and links to other posts.

Their favourite topics are writing about:

  1. The “iIllegitimate, corrupted, aggressive and unjust regime”.
  2. The constant search for internal and external enemies.
  3. Human rights violation in Russia, Chechyna, Ingushetia,
  4. Police mayhem, extreme violence and the “outrageous breach of all limits”.
  5. Strategies of resistance.

The last has become important as the authorities criminalise new forms of resistance. Russian authorities have clamped down on flash mobs and, earlier this year, they even arrested members of a silent protest for using foul language. The protestors had tape over their mouths. As more protesters are jailed, blogs from prison are part of a growing trend in Russia.

Blogs are a significant and growing part of the media in Russian, and Gorny predicted that if the political situation gets worse, then that the role of blogs will only increase.

Blogs and democracy in the West

Of course, even in the West, blogs can still be used for democratic purposes. US transparency through technology group, the Sunlight Foundation, won the 2008 Best Blog in English for their Party Time blog. The blog aims to collect information on the lobbyists, corporations and other donors who pay for parties for US politicians.

Nancy Watzman said that anonymous sources, some even in the lobbying groups themselves, offer the group tickets to the parties. The tickets come from sources they trust. They post the information on the Party Time blog, helping to shed light on one of the poorly reported aspects of the game of money, access and influence in US politics. During the political conventions in 2008 ahead of the presidential elections, they went to many of the parties, taking videos and posting them to the blog.

They would like to take the project further and are looking for partners, including the Huffington Post.

Markus Beckedahl started blogging at Netzpolitik to discuss issues of digital rights, copyright and censorship on the internet, pulling together stories in German and from around the world on the subject. He does a lot of thinking about how to change politics. He said:

“Politicians do bills about internet and they don’t really know what they are talking about.”

About 70,000 people in Germany use Twitter, and Markus has found that it’s a good way to quickly oganise and mobilise people. Netzpolitik has its own YouTube channel and video podcasting channel, and this has led to reports in traditional media about their efforts and issues.

He discussed some of their political campaigns. In 2005, the German government began discussing whether to switch from Microsoft’s Windows XP to Linux. The software giant threw a party to lobby the government to stick with Windows, Beckedahl said. Netzpolitik crashed the party in penguin costumes, the penguin being the mascot of Linux. Some of the penguins even managed to send pictures from the party via MMS.

In recent months, Deutsche Bahn, the German rail giant, has been in a “spy scandal with their workers”, Beckedahl said. Someone sent him internal DB documents, which he posted on the internet. Their lawyers sent him a cease-and-desist letter. He posted the letter on the site, asking for advice. Soon, the letter and documents were spread across the internet, making it difficult for DB to get them removed.

Their most recent campaign is against a proposed law aimed at child pornography. Instead of seeking to shut down the sites, the German government is looking to use filtering software, but internet activists fear that government filtering efforts could be used by other industries such as the music industry against file-sharing sites or by the Hessen government to filter gambling sites. Activists would rather the government seek limited action to shut down sites operating outside of the law.

The German government has an online petition system. A successful petition has to get 50,000 signatures. Using Twitter and hundreds of blogs, Netzpolitik managed to get the necessary signatures in record time, getting 110,000 in all.

Final Thoughts on the Global Media Forum

I thought one of the best quotes of the forum came from Laura Pintos, who writes at the blog 233grados.com. (233 degrees being the temperature at which paper ignites.) She was asked during the BOBs awards ceremony what she saw as the future of journalism. She answered:

“It is the wrong question. it is the present. We are living in a digital moment. It is our present.”

It was nice to see that point of view represented at the conference, even if it probably represented a minority view amongst the speakers and attendees. While a lot of people are wringing their hands over what the future of journalism is, there are people Pintos and many of the bloggers and podcasters at the conference who aren’t worrying about the future of journalism and rather simply creating it.

Mobile social media can unchain journalists from their desks

I’ve spent most of my career as a field journalist and, like most journalists, I’d rather not be stuck in the office all day sitting in front of a computer. I live for being as close to the story as possible.

When technologies are first introduced, they often have limitations that impose restrictions on what is possible. Initially, internet journalism was desk-based journalism for all but a lucky few. It was mostly production and re-purposing of content from print, radio or television news. For most of us who saw the journalistic possibilities of the internet, using it simply as a repository for content from other media was akin to using a Porsche to haul manure because, like a cart, a Porsche also has wheels. Yes, the internet can be a simple distribution platform for content, but that entirely misses the point, which is one of the reasons journalism is in the predicament it is today. The internet is a highly networked platform to tell stories using text, audio and video that can connect not only content from almost anywhere but, more importantly, connect people.

I was lucky enough to be one of those early few who could use the internet for original, multimedia journalism, and I remember the limits of what we could do in the late 1990s before wifi and mobile data outside of cities. In 1999, I remember running smack into the limitations of the technology of the time when I was covering Hurricane Floyd for the BBC. As the storm rolled through North Carolina, it knocked out power and communications. My mobile phone worked, but there was no way that I could file the pictures I had because I couldn’t get a data connection. Two months later, I got my first mobile data kit: A cable that connected to my phone. I could at least file pictures and copy back to base. It was slow, but it worked.

Many journalists have a very odd relationship with technology and those who use it. It is similar to executives who have their secretaries print out emails for them to read: Not using technology is seen by some journalists as a sign of their position and importance. They have worn (and many still wear) their ignorance as a tribal badge setting them apart for those who must toil in front of a glowing screen.

For me, technology sometimes frustrates, but more often liberates me in the work that I do. I remember a jaw-dropping moment at the US Democratic Party conventions in 2000. I watched as an Indy media journalist streamed live video of the LA police bearing down on protesters. He was peddling backwards, holding a black PowerBook, a webcam and an early high-speed mobile modem from a company called Richochet. He was closer to the action than the TV camera crews.

Our production technology lagged behind as it required a faster data connection than many of the early data modems, which topped out at 9600 baud, could provide. But I could email my copy in from anywhere. I didn’t have to hunt for a phone socket. By 2001, I was totally mobile. Laptop. Wireless modem. Portable printer. The speeds went up to 128kbps, and I could just about use production tools in the field.

Fast forward to today, and not only do we have 500kbps+ wireless data connections in many areas in the US, western Europe and Asia, but we also have a suite of applications that can instantly upload photos, video and text. As I said last week at media140, the technology to produce the content is there, but the production systems and the presentation still need work. But Twitter is a liberating technology, not a technology that “will keep reporters off the streets and in front of their screens”, as journalism professor Edward Wasserman writes.

And if he thinks that mobile phone technology is just for “the young, the hip, the technically sophisticated, the well-off”, he obviously hasn’t travelled to South Asia or Africa or even to most neighbourhoods in the US. He obviously doesn’t understand the prevalence of pay-as-you-go phones, not only for communications, but also for micropayments and information services in the developing world. This isn’t just about kilobits and data, it’s also about SMS and the inventiveness of the human mind that takes a simple tool and carves out a revolution. When I worked on the World Have Your Say programme at the BBC World Service, we were overwhelmed with text messages from people in who Africa wanted to take part in the discussion.

Wasserman’s implication that technology is to blame for the skewing of news to cover demographics attractive to advertisers is a red herring. The idea that Twitter will chain journalists to their desks shows rank ignorance of Twitter’s mobile functions in the US.

There are no links in Wasserman’s commentary to support his views. Professor Wasserman, links are the footnotes of the internet age. They give you authority by showing that you’ve done your research. The internet isn’t killing newspapers. The internet might be killing the US newspaper model of local monopolies, but that’s the death of an accidental business model not the death of journalism.

Twitter can liberate journalists to stay in the field and cover important stories, as we did here at the Guardian during the G20 protests. Technology isn’t the enemy of journalism, but I’m increasingly of the opinion that uninformed commentary is.

Media140: Twitter and covering the US elections

Suw and I both spoke at the Media140 last Wednesday. Suw spoke about how Twitter helped build support for Ada Lovelace Day, the international day of blogging to raise awareness about women in science and technology. I talked about how I used Twitter as a reporting and community-building tool during my trip across the US covering the historic 2008 elections.

As I’ve written before, this was my third trip across the US covering the election and every trip included some experimental element. : In 2000, we focused on webcasting; in 2004, I wrote a blog; and in 2008, I built on blogging with an experiment in highly distributed networked journalism and geo-tagging. I experimented with several different services even after I landed in the US: Video services like Viddler and YouTube, geo-location services such as Fire Eagle and location-based social network BrightKite. In the end, I settled on four which became the cornerstones of my coverage: Flickr, Facebook, Delicious and Twitter.

Building contacts

Twitter often helped me develop better contacts who I initially met using other services. For instance, I posted my images to Flickr under a Creative Commons attribution-non-commercial use licence, which I felt was important because I was using Creative Common licenced photos from Flickr to help illustrate my posts. I contacted fellow Flickr users to let them know I had used their pictures, something I try to do as a matter of courtesy and also as a light-weight way to promote our journalism. Sometimes those contacts developed into stories and contacts beyond the original posts. For example, I used this excellent photo of a foreclosed home in California by Jeff Turner, who organises property shows there. He followed me on Twitter and helped me find local contacts for my reporting on the housing crisis.

200905182219.jpg

Sign Of The Times – Foreclosure, by Jeff Turner, Some Rights Reserved

After writing a post about the crisis, I received an e-mail from Ralph Torres whose father had been in the property business for 30 years. Ralph wanted to give me a tour of his neighbourhood, Riverside, one of the hardest hit not only in California, but in the nation. He told me about the history of his neighbourhood and showed me the foreclosed homes on his street. He told me:

Our family went through a few recessions over the years, but it was always real estate sales slowing down. You didn’t have block after block with three or four houses vacant due to foreclosures.

That story made both an excellent article, and I recorded the tour for one of our election podcasts.

Virtual contacts and face-to-face connection

Twitter helped me organise my first of four blogger meet-ups on the trip. A Twitter contact helped not only arrange the guests but also a venue in LA. Having someone local who knew which venue to use was invaluable – it’s on-the-ground knowledge that is hard for a visitor to find.

Connecting and collaborating with fellow journalists

Twitter also connected me to other journalists. One of the stories I read was how the recession was increasing homelessness and creating tent cities, reminiscent of Hoovervilles during the Great Depression. Blogging and Twittering journalist Monica Guzman of the Seattle Post-Intelligencer told me about a tent city in Seattle. I doubt I would have learnt of that without her help, and she pointed me to details on the Seattle P-I site, saving me valuable time.

Real-time reporting and aggregation

Twitter proved invaluable throughout the trip, allowing me to stay in touch with friends, other journalists and those following the elections. It acted as a real-time reporting tool and, by using Twitpic, it allowed me to tell the story not just in words but also in pictures. It also was a real-time news feed with news organisations and people flagging up must-read stories and must-watch vidoes in the lead up to the election. One of my friends and followers, Adam Tinworth, said during the trip that he hoped I would get up soon because he needed his election news fix. He told me at media140 that my Twitter feed was the most efficient way to follow the elections.

The night of the election, I had planned to go back to my hotel and finish some writing, but I was caught up in the street celebrations in the city I had called home for seven years. On Twitter, I read reports of how 16th Street, the historic black district of the city, was clogged with revelers. I was downtown near McPherson Square and, early in the morning, people of all races were celebrating Barack Obama’s historic victory. Washington can be a very racially divided city, and I had never seen anything like this.
200905252139.jpg
Celebrations in Washington DC after Barack Obama’s election to the US presidency, by Kevin Anderson, Some Rights Reserved.

But everyone told me that the real party was at the White House. I didn’t have to wait until I got back to my hotel to report. I could report live from the streets, providing pictures (albeit grainy) and quoting the crowds as they chanted outside of the White House: “Whose house? Whose house? Obama’s house! Obama’s house!”

At the end the trip on election night, I heard from Ralph in California. He said on Twitter:

Big thanks to @GuardianUS08 for last month’s visit and chat and for pulling me further into the conversation.

That was the goal and a measure of the success of what I had hoped to achieve with my experiment in highly distributed, networked journalism. Despite the pressures of almost constant reporting over two months and the difficulties of driving across the US, more than 4000 miles in three weeks, Twitter proved incredibly useful as a reporting tool, an aggregation tool and as a tool to take part in a real-time conversation about the election.

The trip also proved the effectiveness of networked journalism. I really don’t think I could have achieved a fraction of what I did without Twitter. It is actually part of a larger trend of how mobile phone technology will open up new opportunities for professional journalists just as it has spawned the citizen journalism movement. Camera phones were just he beginning.

As I said at media140, there are still some work to be done to fully realise the promise of these technologies. In working on Twitter and other platforms, tying together all of the content and providing context was only possible through manual, editorial methods: writing posts on the Guardian and weaving a narrative through the tweets, Facebook questions and Flickr messages. That was an imperfect solution. I had to try to reconstruct Twitter conversations and Facebook threads and tie them together. It was easier with Twitter, seeing as most of the updates were public, but Facebook proved more complicated and less satisfying. But we have done a lot of work at the Guardian this spring to help integrate Twitter into the site, such as we did during the G20 protests when we used ScribbleLive to pull together the updates of several of our journalists.

As I have said in the past, I have been frustrated as a field journalist with having to leave the story to report, but Twitter allowed me to stay in the middle of the story while I was reporting. It also provided me with a real-time conversation with people while I was covering the story, something that seemed a dream four years earlier when I covered the elections in 2004. We’re still only scratching the surface of what is possible, and while it’s a challenging time to be a journalist, I still can’t help think we’re living through a revolutionary time for journalism.

Raising journalists’ expectations only to crush them

My colleague and compadre Jemima Kiss flagged up story making the rounds on journalism blogs that the University of Missouri School of Journalism is requiring new students to have an iPhone or an iPod touch.

Like Jemima, I speak to quite a few journalism classes as well. While everyone assumes that young people almost without exception embrace technology, it couldn’t be further from the truth. As Jemima writes:

Chatting to journalism students is always an eye-opener, because, despite the enthusiasm and the clear commitment to their career, there’s very often a rather romantic view of an industry that doesn’t really exist any more. It’s a world of smokey bars and clattering Fleet Street typewriters battling against a daily deadline, or, very often, a rather glamorous late night gig review by a wannabe music journo.

Sadly journalism students’ romantic notion of journalism is often 30 years out of step, and they are often even more resistant of new technology and new methods than those working in the industry.

I stopped off at the University of Missouri to visit my friend Clyde Bentley when I was traveling across the US last year for the elections, and it was great to see them thinking not just about the internet but also actively exploring mobile technology. The University of Missouri is a great institution, and it’s great to see them keeping ahead of the times. But the move to require an iPod Touch or an iPhone has not been welcomed by all.

Levi Sumagaysay at the San Jose Mercury News asked if the requirement was a conflict of interest. He questioned “what appears to be the school’s bias or endorsement of the aforementioned Apple products”.

However, I noticed something else that Levi wrote about, building up journalism students expectations. He writes:

An ironic side note: In most newsrooms I’ve worked, we’ve had to claw our way to “preferred equipment,” and we considered ourselves lucky if, in 1999, our work computers got upgraded to, say, Windows 95. If newspapers survive, future journalists being trained to work on the latest and greatest equipment are in for a huge letdown when they realize that that stuff is largely non-existent in the newsroom — we just write about them.

It’s actually more than moving journalism students from a world of shiny Apple engineering to a world of outdated, coffee-encrusted computers. It’s moving them from a world where they can install and run what they want to a world of locked-down, corporate machines.

I was talking to a friend this week who told me that she had to get a permission slip signed to get a piece of software installed on her work computer and another permission slip signed to actually use the piece of software. You would think she was a seven-year-old going on a field trip to an active volcano. When I was with the BBC, I traveled with two computers. My work computer, which I had to have to access certain work systems, and the computer that I actually got work done on.

I know that there are security issues. I know that IT administrators can tell stories of the senior manager’s kid downloading a virus via some Flash game and taking down the network. But a one-size fits all corporate IT policy is not only a soul-destroying experience for a technically proficient journalist, it’s also a productivity killer. There has to be a better way than this. Train staff in the basics of computer security. Allow them to try new things on a virtual machine that can be wiped if it gets infected with a virus. But we can’t expect journalists to explore and learn about digital tools if we lock all the doors ahead of them.

, , ,

Overcoming journalists’ sense of entitlement to an audience

Like many blogging journalists, I now find myself spending more time with Twitter and seeing the conversation take place there instead of on blogs. I suspect it is down to time constraints. As Stowe Boyd said last week at the Thinking Digital conference in Newcastle, blog rhymes with slog because blogging is a lot of work and has produced a natural barrier to entry. Yes, anyone can blog but few people have the time to devote to maintaining a vibrant blog. I find myself now often wanting to capture some of those Twitter conversations.

Today, Adam Tinworth said on Twitter:

I think that journalists’ sense of entitlement to an audience may be the most difficult challenge to overcome in jobs like mine.

Andy Dickinson, who teaches Digital and Online Journalism at the University of Central Lancashire, asked:

do you think it’s entitlement or just institutional blinkers?

To which Adam replied:

Entitlement. “I’ve made it as a journalist. Hence, I have an audience.”

I think the problem is actually deeper than that. I think the institutional belief is that if we work for a major publication or broadcaster that not only do we have a de facto audience but that we deserve an audience. It’s the height of institutional arrogance and self-importance, and it’s obvious to anyone who even has one foot outside of the bubble of institutional journalism that this is the case. But therein lies the rub. For many journalists, we never get outside of this bubble. I think it’s one of the reasons that journalists are bewildered by the fact that viewership and readership numbers are declining. Journalism matters, we say, and it does. But we are too often the authors of our own increasing irrelevance. We trivialise the important and amplify the trivial. In this noisy age, we don’t help our audiences find the signal but instead make a vain attempt to drown out the noise, often with self-serving arguments about our own importance.

Our audiences understand this more than we’d like to admit. I still remember as a cub reporter having a member of the public tell me I was full of shit because I was a journalist and that he wasn’t going to talk to me. I said fair enough and talked to him about the weather until he opened up and answered my questions. Put another way, if journalists’ relationship with our audiences was a marriage, the audience is filing for divorce.

This isn’t a bout of professional self-loathing. I am still very proud to be a journalist and, if anything, I am someone clinging to my journalistic ideals as I too often see my industry making a joke of them. I believe strongly in the public service that journalism can provide, but too often recognise that instead of a public service, our audience sees us a public nuisance, nothing more than professional gossips and self-appointed scolds. We don’t hold power to account. We don’t seek out facts and cut through opinion. Too often, we are playing a bit part in a what can only be called a high-stakes but low budget soap opera. We are nothing more than supporting and enabling characters to the drama queens of political and entertainment celebrity. Yes, in the UK, we have uncovered MPs abuse of the expenses system, but the journalism is all the more exceptional because it has become the exception.

This is also not about being liked but about being relevant and earning respect rather than assuming it. We don’t deserve an audience. We aren’t owed a living. We might think that we provide a valuable public service, one essential to democracy, but the public doesn’t buy it. We have squandered the public’s trust.

The issues as I see them:

  • There is no clear division in the industry between fact-based analysis and commentary. I find well researched analysis valuable. I rarely take the time to read commentary, no matter how inflamatory.
  • There is over-reliance on a few sources throughout the industry with very little original reporting.
  • We live in an age of information abundance. We need to seek information that is rare and valuable for our audiences, or we have no reason for being.
  • Finely crafted prose is no substitute for reporting. Our audience sees through our attempt to write around what we haven’t found out.

We live in an era of information abundance. As Andy says in a follow up to Adam, “the expectation is more that the audience comes as a given not earned or nutured.” We’ve taken our audiences for granted, and now we have to do a lot of hard work to earn them back.

Peering into the future of newspapers at the NYTimes R&D lab

New York Times R&D Group: Newspaper 2.0 from Nieman Journalism Lab on Vimeo.

Suw and I visited the New York Times R&D lab last August when we were in New York. It was an impromptu visit. A friend, Jason Brush, at Schematic put us in touch with Nick Bilton after seeing that we were in New York from our Twitter status updates. (Yet another example of how useful Twitter is.) Nick was kind enough to work around our hectic schedule, and Suw and I were both happy to be able to fit the visit in before we had to dash for the airport. Nick showed us his table of devices including the One Laptop per Child, various e-book readers and the odd netbook.

200905121752.jpg

photo by Scott Beale / Laughing Squid

The Nieman Journalism Lab at Harvard University is running an excellent series of interviews with Nick. It’s definitely worth watching the videos or reading the transcripts.

Nick not only showed us their collection of devices to show people at the Times how their audience might view their site, listen to their podcasts and view their video, he also showed us some of their projects. One that really impressed us was a print-on-demand customised version of the newspaper. However, this isn’t your father’s PDF to print. No, this was much more advanced and showed elements of effortless personalisation married to a future-looking mobile strategy. The system works by users having a card, similar to the Oyster cards used on the London Underground, that is linked to their account at the NYTimes. Based on the stories that you read on the site, it knows what your interests are, adding personalisation without the cumbersome box-ticking that has led most first generation customisation services to fail. Research shows that people say that want customised services, but they will rarely go through the hoops of ticking boxes to tell news sites what they want to read. This is not only customisation, but it also changes with users’ habits instead of being a static set of preferences. After the user swipes the card, they are presented with the top three sections of the site based on their reading habits. They can choose a version with the top story in full from each of those sections or a digest of those sections, similar to an RSS feed view. However, after each story, there is also a QR code or semacode. Using your mobile phone camera, these QR codes are translated to URLs and take you to the full story using the web browser on your phone.
Nick also showed us something that the R&D Team first came up with at a Hack Day in London, which is the idea of content following a reader throughout the day. They created a system with some of the ideas called shifd.com, which is actually a working site if you want to have a play.

The thinking behind shifd.com is actually realising that as we go through our days we actually shift from device to device, from form factor to form factor. Content that might be relevant or accessible on one platform might not be appropriate on another platform. The reader might begin reading a story on their computer before going to work and then want to continue reading that story on their mobile phone on their train ride to work. They might not want to watch a video associated with that story until they can come home. They can mark the video for viewing at home on their flat screen TV at home. This is the kind of user-centered thinking necessary to adapt to news consumption as it is instead of asking readers to modify their behaviour to our platforms and business models.

Nick and the rest of the team at the New York Times R&D lab are doing some great work that I hope drives thinking in the rest of the industry. I think it’s also an opportunity for cross-disciplinary academic research. How do we surround our audience with our content, delivering relevant information to the relevant devices as they move through their day? That’s a service I’d pay for.

The long view in building news businesses

Google News Timeline

When Google Labs released their News Timeline feature, it prompted Mathew Ingram at Harvard University Nieman Journalism Lab to call for more creativity from news organisations. Mathew wrote:

One question kept nagging at me as I was looking at this latest Google effort at delivering the news, and that was: Why couldn’t a news organization have done this? … Isn’t delivering the news in creative and interesting ways that appeal to readers what we are supposed to be doing?

In the comments, people pointed out projects that news organisations had done such as the a graphic visualisation of recent news at NineMSN in Australia. I pointed out time-based navigation at El Comercio in Peru. Mark S. Luckie who writes the excellent blog about journalism and technology, 10,000 Words wrote:

It’s kind of sad showing off innovative technologies over at 10,000 Words, knowing it will be years before most newsrooms adopt them, if at all.

Another commenter, Dan Conover, said, “I wish it wasn’t this simple, but the truth is that the newsroom culture is, and has been for years, overtly hostile to the geek culture.”

Getting past the frustration, how do we bring more innovation to news organisations? It’s something that Suw and I write about frequently here at Strange Attractor.

  1. Journalists, editors and senior managers need to learn about the software development process.  
    I often say that journalists think that technology is like Harry Potter. Many believe that developers need only to wave a magic wand and voila, faster than an editor can drain a cup of coffee, we have a new interactive feature. Web and software development is more like the Matrix. It’s a rules-bound world. Some rules can be bent, but others cannot be broken. Also, just like in life, some choices preclude others. Web technology is not a blank canvas. A good, dedicated developer can do amazing things, but no developer can do magic. They can’t rewrite the rules, rewrite a programming language or rebuild your CMS in a day.   
    Most editors don’t need to learn how to code, but editors do need to learn the art of the possible. Some things can be done quickly, in a few hours. Other projects take more work. A basic understanding of what is possible on a daily deadline is essential.
  2. Develop a palatte of reusable digital elements
    When I first started doing online journalism, we often built one-off projects that took a lot of time and had a mixed response from our readers. We were still learning, not only how to execute digital journalism projects, but also we were learning what type of projects people found engaging. We soon learned that ‘evergreen’ projects often were best, things that had a life-span much longer than most news events. Besides, there are very few editorial projects that merit huge one-off investments, and most news orgs can’t afford this in 2009.
    At the BBC, when I started, we had a limited palette of things that we could add quickly to primarily text-based news stories. The News website was still very young. But over time, we built on that limited palette. Our Specials team built things, and they tried to determine what worked and what didn’t. The things that worked were added to the ongoing list of elements that journalists could add to their stories.
    Modular interactive elements are easier in the Web 2.0 era. For instance, we often build maps, not just locator graphics but actual maps that draw on data (for instance one could create a map using data of the H1N1, swine flu outbreak). More news organisations are using Twitter and other third party services that call external APIs and cache the results.
    If you’ve got limited resources (and who doesn’t), you must think in a joined up way. Think of elements that will add value to your entire site not just to a certain section. Think of elements that will work in many areas of coverage.
  3. Interactivity is a state a mind and doesn’t always require technical development
    Much of this isn’t even about software development. It’s about a state of mind. Interactivity isn’t just about the web. It’s still about letters and phone calls. It can be about text messages. When I worked for World Have Your Say on the BBC World Service, Americans called or sent emails. Listeners in the UK mostly called, and Africans sent text messages by the hundreds. The first and most important step isn’t about developing a technology strategy but about developing a philosophy of collaboration with your audience.
    Everything will flow from that philosophy because there are many non-technical ways to get your audience involved. One of the most powerful things on World Have Your Say was getting people around a microphone in Africa to talk to Americans who had called in. The marriage of mass media and social media can be an extremely powerful combination.
    Add to all of this no-cost of low-cost web services, and you can do many things on a daily deadline.
  4. Strategic projects require long-term vision
    When I was writing the post for the Guardian about Google News Timeline, I found out that Google had begun creating a historical archive of news content in 2006. News is ephemeral, but as news is the first draft of history, news stories put in context can be a fascinating look at history. Google decided that archiving this content might have some value.
    There are a lot of things that take a strategic decision and not only long-term development but also a long-term commitment from a news organisation. I think that geo-tagging is one example. It’s a choice that takes a bit of development but actually more commitment from editorial teams, but the addition of a small bit of structured data generated by journalists creates a lot of opportunities, some which might have revenue.

Taking a long view is difficult as news organisations face very serious short-term challenges, but the lack of long-term thinking is one of the things that got a lot of news orgs into this mess. Developing a long-term, multi-platform strategy might have goals five years out, but that doesn’t mean developing the perfect five-year plan. It means setting some strategic goals and getting there one day at a time.

What content will people pay for?

Four years ago, I went to the Web+10 conference at the Poynter Institute in Florida. It was an honour to meet some of the pioneers in digital journalism, many of whom I had corresponded with online for years but never had the opportunity to meet. It was 2005, long before the depth of the crisis in newspapers was obvious to all, but everyone was asking the same question: How do we pay for professional journalism? Contrary to popular belief in the industry, newspaper websites were profitable, some quite profitable, but those profits could not sustain the size of newsroom that big-city metros in the US had at the time, newsrooms that dwarfed the size of the British national newspapers.

The crisis has been coming for years as newspapers have seen circulation declines for decades, but the Great Recession is amplifying pressures on newspapers. You read blog posts and articles from journalists and editors who say that the public should pay, must pay for ‘quality journalism’. We hear arguments that they will pay as content becomes scarce with the decline in the number of journalists and the number of newspapers. Leonard Witt, the Robert D. Fowler Distinguished Chair in Communication at Kennesaw State University in the US, says in this post:

So will people pay for high quality journalism and information? I do think so because I know one person intimately who already has. And trust me that person is very tight with his money.

Keep in mind, I am saying high quality news and information. Run of the mill junk is a worthless commodity. High quality journalism is scarce and will be more so in the future, and that’s when everyone who loves great journalism will begin to pay.

But I tend to agree with David Kohn, of spot.us, who says this in the comments:

I think this is right on Lenn – as you know, I tend to agree with you. But more and more I’m realizing that certain types of news and information that journalists think is priceless have less value than others.

David elaborates on his point back on his blog citing lessons he’s learned from various citizen journalism and crowd-sourced projects.

Increasingly I’m of the belief that the newspaper industry is relying far too much on its values in its estimates of what readers value enough to pay for. We need some solid facts and figures on what people will pay for. I might be hoping for concrete data that just doesn’t exist right now, but I think we as journalists have to move from asserting what people should pay for and do a little reporting and research to find out what people will pay for and the types of services that might be able to subsidise professional journalism.

Technorati Tags: , ,