Visualisation for news and community discovery

I think that visualisations and interface innovation hold great untapped potential for journalism, not only helping journalists and audiences to see trends and understand complex sets of data but also as a tool that will dramatically improve news site usability. The last few years have seen a lot of innovation in visualising data with the advent of mash-ups and easier visualisation tools from Google, Many Eyes from IBM, etc., but there has been too little interface innovation for news websites.

By and large, news websites still reflect their print heritage. They make the classic mistake of rigidly reflecting their own structure while ignoring the semantic connections that cross desks and departments. Most news web site interfaces obscure the vast amounts of information we produce as journalists. Good interfaces go beyond design and search to issues of information architecture, user experience and discovery.

I believe that interface innovation can unlock the power of technologies, helping them break out of a small group of technically adept early adopters to a much wider audience. The Windows-Icon-Mouse-Pointer interface helped open up computers to a much wider audience than when command line interfaces were dominant. The graphical web browser helped unleash the power of the world wide web. In 1990, when I first used the internet, I had to learn arcane Unix commands to even read my e-mail. In August 1993, I used the seminal web browser Mosaic for the first time in a student computer lab at the University of Illinois, where I was studying journalism and where that groundbreaking browser was created. I instantly realised that the web browser would become a point-and-click window to a world of information, communications and connection.

I’ve been interested in interface innovation since the late 1990s when I first saw the Visual Thesaurus from a company then called Plumb Design, now called Thinkmap which showed the connections between related words. The company did even more impressive work for Sony Music and EMPLive, an online exhibition for Microsoft co-founder Paul Allen’s Experience Music Project. In many ways, the work was way ahead of its time and sometimes ahead of the capability of the internet. The projects used advanced interface concepts more often found in CD-ROM projects of the day than the internet. One of the things that impressed me about especially the EMPLive project was that it allowed virtual visitors to the navigate the music collection a number of ways, whether they were interested in time, genre or a particular artist. The presentation also showed relationships between elements in the collection. I like Robin Good’s description on the Master New Media blog of Plumb Design’s work:

The original goal at Plumb Design was to create dynamic interfaces to information systems that reveal interrelationships often obscured by conventional methods of navigation and information display.

In many ways, Plumb Design showed what was possible with data, semantic analysis and rich interfaces more than a decade ago.

While interface innovation has not been an area of focus for most news sites, thankfully we’re seeing some tentative steps forward after a crash period of stagnation. Slate has launched a service called News Dots. Chris Wilson describes it like this:

Like Kevin Bacon’s co-stars, topics in the news are all connected by degrees of separation. To examine how every story fits together, News Dots visualizes the most recent topics in the news as a giant social network. Subjects—represented by the circles below—are connected to one another if they appear together in at least two stories, and the size of the dot is proportional to the total number of times the subject is mentioned.

Like EMPLive and the Visual Thesaurus, News Dots helps show the interconnection between stories. The feature uses Calais, “a service from Thompson Reuters that automatically “tags” content with all the important keywords: people, places, companies, topics, and so forth”. Slate has built its own visualisation tool using the open-source ActionScript library called Flare.
Slate's News Dot project
It’s a good first stab, but Slate admits that it is a work in progress. I like that the visualisation clearly links to articles and sourcing information. I like that the dots are colour-coded to show whether the dot represents a person, place, group, company or ‘other’. I think there might be a possibility to better show the correlation between the tags, but as I said, this is a good launch with a lot of possibility for improvement and experimentation.

Another project that I think shows the potential of improved interfaces is the Washington Post’s visual commenting system called WebCom. As Patrick Thornton explains, it is a visual representation of comments n the site. As new comments are posted the web expands. Those comments rated highly by other commenters or those that spur the most responses appear larger in the web. The web not only allows for navigation and discovery, but users can comment directly from within the visual web interface.

Thornton says:

The commenting system was built in two weeks by two developers at A front-end developer worked on the user interface, while a back-end developer created the database and commenting framework in Django. Because the user interface was built in one language — Flash’s ActionScript 3 — and the back-end in another, the Post can take this technology and put it on different parts of with different user interfaces.

Wow, that’s impressive in terms of turnaround time. Django is quickly becoming an essential tool for the rapid development of journalism projects.

Thornton points out that it doesn’t work on mobile browsers or older computers. I might quibble with the focus on most popular comments or comments that spur the most response; comments that draw the most responses can often be the most inflammatory or intemperate. Likewise, popularity often becomes self-reinforcing, especially when it drives discoverability as it does in an interface like this. I would suggest that a slider that weights other factors might be useful. A simple search or tagging system might help commenters to find threads in the discussion that interest them. Again, this is a good first attempt and, with the development time only taking a few weeks, it shows how rapidly innovations like this can built and tested in the real world.

It’s exciting to see these kinds of developments. News organisations are struggling during the Great Recession, but often these times of crisis spur us to try things that we might otherwise think too risky. Whatever the motivation, it’s good to see this kind of innovation. If this can happen during the worst downturn in memory, just think what we can do when the recession eases.

links for 2009-09-09

Will the Asus “Eee-Reader” be a sea change?

Lots of people were tweeting yesterday about the new Asus e-book reader which, we’re told, would be a form factor unlike any of the e-book readers currently out there. Due out, possibly, before the end of the year, it would be a foldable dual-screen reader which will let the user read a text on one screen whilst surfing the web on the other. It will be full-colour, with a soft keyboard on one of the screens. With a price tag of somewhere around £100, it could make a very compelling device.

But I fear there is a big, fat, juicy fly in the ointment. Neither Kevin nor I have been impressed with the software that comes built into cheap electronic devices. We bought my mum a little MP3 player a few years ago and whilst it looked nice enough and was within her budget, the user interface was nothing short of appalling. Even I had a few problems understanding how the thing was supposed to work and as far as I know, my Mum hasn’t touched the thing in months, if not years. And as for Kevin’s GPS device wrangling hassles, let’s not even go there.

We’ve also not been impressed by the Asus Eee PC’s operating system, Xandros. It’s not because Xandros is based on Linux, which we both use regularly, but because Asus’ implementation of Xandros makes it difficult for the casual user to install software not included in Asus’ package. It’s like Microsoft making it difficult to install anything but Microsoft-approved software on your laptop.

When it breaks, you need quite a bit of know-how to fix it. Kevin has spent hours working on a friend’s Eee, first getting it to run a Twitter client and then fixing a BIOS update that buggered things completely. Updates to the Eee change the location of user application preferences, which can then break shortcuts to user-installed software. That makes installing your own software challenging. This is something that users would be up in arms about if it were Apple or Microsoft.

The mock-up of the Asus “Eee-Reader” looks lovely and the price is certainly user-friendly, but will the software be? I have shied away from the other e-readers because a portable device of that size that I can’t write and check email or Twitter on is unappealing to me. The users interfaces of the devices I have played with have been at best clunky and at worse frustrating and proprietary software means users can’t install their own software (as far as I’m aware).

If, like the Eee PC, the Eee-Reader uses either a Linux or Windows variant as its OS, users will at least be able to customise their device to some extent (depending on hardware limitations and know-how). At the moment, netbook users who have the Windows machine actually have more freedom than those on a Xandros machine, because Asus have made it so difficult to install software on Xandros. If the Eee-Reader gave me that choice, I’d probably end up plumping for Windows, even though that comes with its own issues.

What might be interesting would be if it was capable of running Android. As Kev tells me, “people have some interesting hacks with Android.” I’ve never had a chance to properly play with Android so I’m not sure if I’d be keen on having it on my e-book reader or not. I would guess that ‘Hackintoshing‘ it won’t be possible; there are specific hardware requirements for a Hackintosh and as yet we have no idea whether the Eee-Reader will meet them.

My worst-case scenario is that Asus would produce some sort of proprietary OS with only limited functionality that users can’t add to. If Asus did that, they would be missing a trick – the success of Apple’s App Store shows that people want to be able to install applications of their own choosing onto their phone and that developers are willing to spend time creating them. If the Eee-Reader’s hardware specs mean that software needs to be specially developed or adapted for it, then Asus should use an OS that’s easy to develop for and create an open marketplace that encourages an ecosystem of applications for users to choose from.

The initial description of the Eee-Reader sounds attractive, but unless its software is usable and extensible it’s not going to tick the box for me. I can’t carry round a laptop, and iPhone and an e-reader; my back would never forgive me.