FoWA: Native to a web of data – Tom Coates

Spent the last couple of years working for the BBC, but now working for Yahoo!, but I’ve only been there a couple of months os if I say something controversial then that’s not official policy.

Presentation will be online afterwards.

For some reason I was put down to talk about user interface, and when people think about Web 2.0 and user interface, they think about rounded corners and gradient fills.

Blogger started this entire thing. I could do a whole talk on design topes for Web 2.0, but I’m going to talk about product design at a higher level, what it means to design for the web.

I’m going to talk about what the web is changing into; what you should be building on top of it, and architectural principles.

What is the web changing into?

Web 2.0 is clearly a buzzword, and a conference, but it’s also marketing to see the idea that things are changing, You could argue that it’s a shift and an attempt to get money out of VCs. Buzzwords are an attempt to create order, to make sense of what’s going on amongst some tremendous change.

Tim O’Reilly’s article What is Web 2.0. And Marcus Angermeier’s representation. But there are many difference, in design, infrastructure, server, business models, everything is changing. This idea of Web 2.0 can’t support the no. of ideas going on beneath it. The church is too broad, so I’m going to concentrate on one layer, a web of connected stuff.

Think in terms of APIs and data. We are moving from a world of web pages connected by links, we are now in a world of data connected by APIs.

The web is data sources, services for manipulating, and ways of connecting them together. Conflating content and data together.

Mash-ups, terrible word but interesting idea, shows that things can be cut together

Yahoo! Astronewsology, splices news and star sign, e.g. things that happened to Capricorns, or explore a news story and compare what should have happened to someone and what actually did, which is useful when looking at obituaries.

Can use non-standard data sources and hybridise them in ways that makes each data source better, so you can navigate one in terms of another.

Two things aren’t so interesting, but add a third or fourth, and it gets good, and you get a network effect of services. Every new service you create can build on top of every other service in existence, and every service which adds data to the ecosystem adds value to the other services.

This creates massive creative possibilities.

You get accelerating innovation because people don’t need to invent the same thing twice

increasingly competitive services

Increasingly componentised services

Increasingly specialised services

There is money to be made. Can you se APIs to drive people to your stuff. Worked on a project at the BBC to produce info about programmes, which if the BBC opened it up, people could do interesting things with. Amazon do it well.

Make your work more interesting by providing APIs because other people go and do stuff with it. Can use syndicated content as a platform for other things. Can turn your API into a pay-for service.

If you’re not part of that ecosystem, if you’re not opening up, you end up in a backwater, doing all the work yourself, disconnected from the environment around you, and that’s not going to work anymore.

Choosing what to build.

So if you buy this vision that if you’re part of the ecosystem you’ll be caught up in it and pulled forward, the question then is what kind of things do you want to build?

Ask, what can I build to make the whole web better? How can I add value with the aggregate web? Users are getting benefit from the connected web, and if you can’t add value to that you are nowhere.

Can you open up a dat source? Can you help users put their own data online in reusable ways? Can you help annotate? Can you help organise? Can you get their data into the ecosystem?

Important to data that is architecturally important to people’s lives that companies want to own it – location, identity, calendaring, names spaces etc.

So companies want to own that space. They want to own the data.

Also, exploring and manipulating data, improve it, navigate it, add metadata to it. Navigation is important, with increasing amounts of data being put up online, e.g. can you help people find video amongst all the TV that’s going up online.

Architectural principles

Need to read Matt Biddulph’s The Application of Weblike Data.

In this world, the core components are

– data sources

– std ways of representing data

– ID and URLs

– distribution

– interaction and enhancing data

– rights frameworks and financial

Believe that there is money here and this is going to happen in a solid way over the next 10 years.

1. Add value to the aggregate web.

2. Build for normal users, developers, machines (some of these may be synonymous). Normal users just want to use it, developers want to find hooks, and machines want predicability so makes sure that you’re consistent.

3. Start your design with data and not with pages, data is reusable asset, it’s the core part of the system so must get it right. You can do these processes together, so you need to be able to represent the data properly too. Design the data in weblike ways then manifest it as pages. Want to be comprehensible enough to be explorable and comprehensible for human beings.

4. Identify your first order objects and make them addressable, i.e. the core things that people refer to, e.g. films. Programs, not the time they are broadcast or the series, but the episode. That gives you the maximum options for aggregation and organisations. Events, which only happen once. People. Then make that addressable. Give it a unique and well structured URL so that anyone on the internet can point at it. If you do that then you’re in a good situation already, you’re winning because you’re part of an aggregate web of data because you’re comprehensible by search engine, service aggregator like Technorati, communities such as Digg or Del.icio.us can refer to it. All of these things are connected data resources connected to this data source.

5. Readable, predictable, guessable, hackable URLs. A good URL should be a permanent reference to a resource which must not change, and should represent the thing it’s referring to well, solidly, reliably, for ever. If your first order object has subordinate pasts, then ok to use hierarchy in URLs, but the URL that represents the definitive object should be in one place. Should not be underlying tech, particularly if that tech might change. So get reid of .html or .aspx or whatever, because you might move away from that technology and that would make it break. Should reflect the structure of the data, e.g. events only happen at one event os their structure can have the date in, so long as it’s a one-to-one correlation that’s ok. And there’s a temptation to make things human readable so much so that it breaks the URL, e.g. radio broadcasts shouldn’t have the date in because they are rebroadcast and the date breaks the URL. Let people guess the URL. More predictable and guessable the better. Readable is good, but don’t need to overdo it. Exposing identifiers is not always bad, if it’s the right sort. URLs are powerful, being moved into the UI of the page. Good URLs are beautiful and a mark of design quality. Don’t do bad ones because I’ll cry.

6. Identifiers are not enough. Lots of things that are on the web that aren’t well represented, things that maybe didn’t originate on the web, e.g. people, events, films. You need a way to correlate them, so if you can correlate with other identifier schemes then do so. Films are a good example, there are lots of other urls for specific films. Need to make it easy to talk about the same thing.

7. Build list views and batch manipulation interfaces. Need to find ways for people to navigate data and manipulate it. Three types of page: destination page; lists for navigation, ways to cut through things; manipulation space, interface for batch manipulation of first-order concepts. Manipulation is a really interesting territory. Problem with changing information on the web is that the interface widgets we have aren’t that powerful, so AJAX is trying to fix that problem to give more application-y style widgets to help us manipulate data. Core aspects are not to break the web, so if you’re doing to use AJAX, or Flash, on the destination page is should be to only change that concept on that destination page alone.

8. Parallel data representations. All types of pages can be queried by APIs; destination and list-view pages can be represented by microformats; and then there’s also parallel XML for destination pages and RSS for list-view pages. RSS in this environment is great, the ability to send data from one place to another in the easiest fashion. Delicious does that incredible ways – every page as a parallel RSS representation. So any app can go and get the RSS and use it. How you distribute the data is another matter and there aren’t many ways of doing that, so look at microformats.

9 Make your data as discoverable as possible. If you do 1 – 8 you’ll be doing 9 too.

FoWA: From web site to web application – Cal Henderson

Works at Flickr. Ten things that have been learnt from Flickr than can be applied to other web apps. Ways to move from a web site to an app. Not very geeky. Not going to talk about MySQL and nerd stuff.

Flickr

Is awesome. Photo sharing app. Has tags. Has an API. All these Web 2.0 buzzwords. Obviously there’s been the Web 2.0 conference for a couple of years. Has taken off as a term. Lots of people will be talking about what web 2.0 means whether they say it or not, and trying to explain some of those principles. It’s nothing really, just a name for a tech that’s been around for a while.

Flickr is going to be 2 on Friday. Big party in San Francisco with cake. All welcome to go.

Flickr has 2m users, who are very passionate. Passionate users are important to Flickr, but the developers who built it who are also passionate. People don’t start a business to make money. you do it because you care about what you’re doing. BNy having passionate developers you get passionate users.

have to start from a pov where you care about what you’re building.

With Flickr, there’s a difference between what users want and what they need. People didn’t necessarily want the things that Flickr built, but maybe they needed it. We thought about feature that people needed first and foremost. You don’t listen to what your users say because they will tell you what they think they want. You have to watch what users do and look at their behaviour to understand what they need not what they say they want. If you give them what they need you’ll make them passionate.

Collaboration

First of the ten things is collaboration. At the beginning of Flickr, before Flickr, there was Game Neverending, which was a realtime MMP game, based around a realtime engine. Flickr was built on the same tech – massively multiplayer photosharing.

Very much like a game – social network, friends list, etc. Already a load of photo site, not a new tech. That’s not a big deal. What is a big deal is sharing your photos with your friend. Very bottom up, is social network.

Create network effect, by create incentive to add people to the network, so people add value by encouraging others to sign up.

Collaborative metadata also core. Tags, notes, great, but if i can add tags to others, then that’s collaborative metadata. More uses than just pointing out things you missed.

Aggregation

A lot of web apps where you upload your own data would all be siloed into users, a ghettoised space. So huge collection by data, but instead of showing by user, show by other ways, e.g. latest photos. Loads of interesting slices of the data. So think about the whole bunch of photos as one big blob, can slice by tag, by geolocation, relation to other tags, interestingness etc.

Open APIs

Many apps have open API, but what’s the point? We needed it for our own development, for building in throttling and abuse protection etc., so why not let other people use it? Had a bit impact early on with it.

Whole tonne of value in just pushing out read data, without exposing your system.

Started build sites, then web apps, now web services. We can allow other peopel to build our interfaces, and allows othe rpeople to do really interesting things, stuff we hadn’t thought of, wouldn’t have had time fork, or which sounded insane.

Something really cool is that people built a game called Fastr, multiplayer game with a series of photos and you have to figure out as fast as poss which take the photos came from. It’s really cool, but there’s no reason for usto have built it.

If you don’t provide an API, people will just scrape data, so it makes it easier for you and them.

Clean URLs

Getting very popular in Web 2.0. Core reason is that you don’t need to expose the core workings of your system in your URL. Use mod_rewrite under Apache. So the URL doesn’t have to point to a file name, so just translate from file name to URL using mod_rewrite. Core to Flickr URL.

The URLs don’t reflect the folder structure at all, so none of the URLs map to physical part of the disk. But that’s good because they are human readable and they are guessable. If you can guess the URL to a page, then people can get around fast.

Sometimes we’ll find we’ve removed a link from the nav, though, and never realise because the developers always type in the URL.

URLs can’t change. If they point to one resource now, they have to point to that resource forever. When we started Flickr we picked some really bad URLs, but we can’t change them because people have used those URLs and you can’t break those links.

This was a problem when scaling. When the URL scheme was changed, have to support the old URLs forever, because you can’t have them break for people.

AJAX, been around for a while. Worst name ever. Asynchronous Javascript And XML. Not always about XML or Javascript, because you could write an AJAX-like script in VB if you wanted. But the Asynchronous bit is important.

After you’ve loaded a Flickr page and you want to add a tag, the box appears without the page reloading, and when you submit it the page doesn’t need to reload either.

Need strong API so that it can be accessed via AJAX. It’s used primarily to streamline interactions that you already have. E.g. keeping the tags on the same page instead of having to go to a new page to add them in. AJAX saves a bit of bandwidth, stops page reloading, don’t lose context etc.

Also use it for creating new experiences. Not seeing this so much on the web yet, but we build self-contained apps in AJAX which have no way to address in to them.

Unicode

Internationalisation comes first, and localisation later. Important thing to consider is whether you want basic international support from the beginning. E.g. do you store all your data in unicode?

Usual use is to store, present and receive data in UTF-8. Some apps use UTF-16.

Desktop integration

Or platform integration, because your platform isn’t necessarily a desktop. Need to move interactions out of the browser. Most of this is grounded in APIs.

Bunch of desktop apps which work with Flickr, e.g. the upload app. Some tasks are crappy on the web, especially uploading photos, and especially more than one photo. Desktop app allows people to perform tasks that would be difficult, suck or just be stupid, in a browser.

Not just desktop apps. Also possible to do browser apps, such as bookmarklets.

More complex platform integration, e.g. toolbars or dialogues into the browsers.

Also integrating the app with email. Everyone has email, and email is integral to the way people interact online, but we don’t often think about building it in to a web app, e.g. to send email to our system as well as receive it. Difficult to get a photo off a mobile phone, but most can email, so as soon as Flickr could accept photos via email then that’s an uploader for every phone.

Also, simple notification emails to draw people back to the system.

Mobile

Will become the most important platform. Heard this for the last five years. You probably remember WAP and how influential that was… but there are some standards so you can build stuff, and so some people will use them. But they usually all support XHTML Mobile, quite a sensible standard.

Build small apps for mobile devices using XHTML Mobile will work on most phones.

People used to think that it was about creating a smaller logo, but that just doesn’t work. Can’t have more than a couple of lines of text and expect anyone to interact with it. It’s not just a case of re-presenting the same content using a different format. Need to think about what you’re presenting. Needs to be snappy. Think about stuff you wouldn’t want to do on the website, maybe. But not all data is suitable for mobile devices. Need to think in small chunks.

Open data

Import and export of data from systems we build. Export through RSS feeds, but can only get 10, 15 or 20 most recent photos. But doesn’t give a mechanism to get a few hundred out of Flickr. Provide a method to get all their data out, or to import everything in from another app.

If you give people the feeling that they can leave at any time, they are more likely to stay.

It’s not just primary data that’s important. People may already have a photo back up because they upload it from somewhere. But they don’t have the metadata, so what’s important are the notes, tags, comments etc. and getting some sort of local back up. That’s done through the API.

There are 3rd party services that back up your photos to a DVD and then sell you the DVD. Makes people feel safer.

Open Content

Previous to Flickr, a lot of web apps that stored data, once you uploaded your data, they own it. Still the case with Google Video, and other photos sites – they can sell it, use it, do whatever with it because they own it. Flickr does not own their user’s data. Allow users to use Creative Commons licences if they wish.

Through the open APIs, open data, open content, and allowing people to reuse and remix and use the data for interesting purposes. There’s a video someone did with CC licensed photos, blog.flickr.com, and wrote a song about it.

All photos used in presentation were CC’d, and attributed in presentation, which is online at http://iamcal.com/talks

FoWA: Things We’ve Learned – Joshua Schachter

Browsers

Always people who some weird browser. CSS will drive you nuts. Header issues. Firefox extensions. Every broken interaction will hit your database and slow it down. It’ll drive you nuts. Need to get your browser shit fixed up straight off.

Scaling

Don’t do it. Whatever you think you’re doing to need to deal with is not going to be the problem. Read Cal Henderson and Brad Fitzpatricks’ presentations on how to make things go faster. These things talk about, not scaling but how to deal with databases. How to deal with SQL not being great. Think about splitting data over multiple machines. Things like one webserver talking to 8 dbs will blow up in your face. Test every single SQL query.

Set up a monitoring system because you’ll get paged at 2 am. No good being asleep if your db goes down because it’ll stay down til you wake up.

Understand your db. Lots of apps have tags, but that doesn’t map to SQL at all, so understand tricks and tips. Have different tables so you don’t have partial indexing.

Cache.

Understand where latency is ok. Figure out where you can be sloppy, and be sloppy, e.g. RSS feeds don’t need to be instant.

Idiots will break stuff in ways you can’t yet imagine. You can’t predict how what they will do.

Apache

Do stuff with Apache. Images off a different server, RSS. Throttle.

APIs

Were created early on in Del.icio.us. Helps the ‘priesthood’ get a measure of comfort in your system. They want to take their data and go home if you go offline. Make the API easier to get into and out of, the more it will be used. Make it simple. Del.icio.us is just XML.

Identifiers

Unique IDs in your db is a mistake for scaling. But do not expose that ID to the outside world, because some idiot is going to use that to try to scrape your database. That’s a hint that people want the data, but they aren’t going to wait for you to give it to them, so they will hammer your systems to get it.

Features

Significantly influence behaviours. Also, which ones do you leave out? If no tags, Del.icio.us wouldn’t have worked. Try not to add features that exist elsewhere. No need to come up with a new way to do things that are already being done, so don’t use messaging, because we have email already.

When people ask for stuff, that’s important info. Try to understand why they are asking for that. Extract the use case. E.g. people want boolean search on the tags, but hardly anyone searches on more than one tag at at time.

RSS

Important in Del.icio.us. It’s another set of tools to get in and out of the system. Everything that could have a feed should have a feed. This was more important a year or two ago, when RSS was the big thing. Now it’s not quite so exciting, and maybe there’s another feature that will cause people to show up.

Need to understand the headers, caching, etc. If you can stash the timestamp then this can save an enormous amount of effort.

URLs

Primary vehicle for people to to find your stuff. Don’t do session keys. Leave underlying framework out. It doesn’t help the user.

Also allows you to expose some functionality to the priesthood who care.

Surprises

Watch for interesting behaviour in the system. If people do things you didn’t expect or intend, that’s neat.

Passion

Choose a problem that you yourself have. Had a text file with 20,000 links in it. Couldn’t find stuff anymore. Had a URL, space, then descriptive text, e.g. wifi. That was the first tagging system.

Build a db system which was like Del.icio.us which was single user, for him. Used that for a few years, then built for other users. Del.icio.us came out end 2003.

Don’t look for problems you don’t have, because someone else who is passionate about it will solve it better than you can.

Release

See teasers. Limited betas. All horrible. Every day you don’t have something out in the world you are losing information, feedback, users, reputations. Get it out there, get the release done asap.

Attention

Anything like RSS has some element of attention. This is useful, interesting behaviour. We do the ‘what’s been popular in the last 24 hours’, and people pay attention to that. That works reasonably well when the population is small and all biased in the same direction, so that things the group finds interesting the whole group will find interesting.

As the group gets larger, the bias will drift. But you can aggregate with a given tag and then can compensate for the decrease in bias.

Figure out how to keep things on topic or fragment into different piles of attention.

Spam

Is attention theft. Spag – tag spam. But people will try to get into any aggregation of attention.

We don’t do a top ten, because it’s biased in favour of stuff that’s been around forever. And, as soon as you do, people will try to get to the top of that list.

Understand what you’re’ building as you build it to avoid these things.

Don’t provide feedback when someone spams, and you figure out the fix. Don’t give them an error message because then they know they’re doing it wrong and will try again.

Tagging

Is not really about classification or organisation, it’s user interface. It’s a way to store your working state or context. Useful for recall. Ok for discovery because someone might tag similarly to you. Bad for distribution.

Not all metadata is tags. People ask for automatic metadata, but that’s not the value – the value is attention, that you saw it and decided that it was important enough to tag. Auto-tagging doesn’t help you do what you’re trying to do.

If you make it too easy… because there’s a small transaction cost then that adds value. But don’t make them do too much work.

Beware librarians who want an official list of tags.

Motivation

Why are people there? Have to expect the user to be selfish. But build a system people like and this breeds evangelism.

Effort

Watch what you find your time doing. If you spend a lot of time building a feature that no one uses then that’s a waste. Be careful.

Measurement

Guesswork backed by numbers. If someone is using a feature in week one, do they also use it in week five. Measure the system itself. But also understand that in the data that the system collects, measure behaviour rather than claims. In Del.icio.us there’s no stars, because why would you bookmark something that’s bad? So rely on what people are doing not what they are claiming to the system.

Testing

User acceptance testing. Very important that everyone on the team sees the user testing. Don’t give people a list of To Dos and then watch them do that because they have a vastly different behaviour than what they do in real life. People don’t read, don’t follow instructions… people know this intuitively, but it’s far worse than you realise.

Language

Speak the user’s language. Del.icio.us is about bookmarking. Bookmarking was a Netscape or Firefox thing. In IE it’s favourites. So make sure that you speak your user’s language or they’ll leave.

Registration

Don’t make users register before they get into your site. Give them as much functionality as possible, even give them anonymous access to start with. Logging in is a big barrier. People want a good idea of what they are going to get if they register because it’s a lot of work. People are afraid of giving out email addresses, spyware, etc. They want to know what they are going to get out of it. You can’t tell them, you have to show them. Let them wander round and get a feel for it. That’s the only way to get them into the system.

Present the appropriate gestures and verbs, save, copy, bookmark, etc.

Then when you have to register, make it as short as possible, and take them back to where they were. Don’t dump them on the front page again.

Design Grammar

If you’re doing something different, then understand where you’re breaking away from normal behaviour. Design should be standard – tabs on top, nav, logo top left. What is the structure of the world? Emulate that as far as possible, but be careful of what your design implies, what it makes people expect.

Morals

It’s the user’s data, not your data. You get to use it, but it’s still their data. They have to be able to add, modify, delete their data. Up to and including removing themselves and their account from their system.

When Del.icio.us deletes a bookmark, the data’s purged from the system. Once it’s gone it’s gone.

Infection

Spent nothing on promoting Del.icio.us, ever. To do this, enable evangelism, so people want other in your system, want to tell people. So enable every communication method possible.

Email is tricky because you don’t want to be a spammer. But RSS. Think of every RSS read as a client app. Viral vectors. Desktop apps can eat a lot of data through http, so figure every app out, and see if you can get in there.

Communities

There’s not ‘quite’ a Del.icio.us community, because Del.icio.us is a tool, and the communities are elsewhere. The communities can use the tool, but no need for Del.icio.us to have a community. There are flame wars and all that, interactions that you don’t want people to have.

The Future of Web Apps

So I’m at the Future of Web Apps conference today, sat in Kensington Town Hall with 800 real proper geeks, hearing about how to develop, er, well, web apps. I’m sure at some point during the day someone will give a deeply techie presentation which will go right over my head, so notes may be patchy. Note are also going to be up on the wiki, but I’ll live blog too.

Communities, journalism and stories

Suw, Paula Le Dieu and I went out for dinner a few days ago to talk about iCommons, a new project that is growing out of Creative Commons.

There is some really interesting stuff being done by people under the CC banner, and I’m curious as to how the BBC might release some of our news content under CC licencing to give back to the community of participatory media. Just a thought right now, but I’m keen that we as a big broadcaster give back to these communities and not just take pictures, audio and video from citizen journalists, bloggers, podcasters and vloggers.

Paula used to work for the Beeb on the Creative Archive project so knows about some of the rights issues that we might run up against. It’s more difficult than it sounds or should be.

But we got to talking about communities and journalism. Paula said that the job of journalists, if you really boil it down, is to tell stories about their communities.

Living in a Bubble

I was at the Web+10 conference at Poynter last year, and I remember we were talking about blogging. Someone said that the world of blogging seemed like an echo chamber.

Well, as the barbian inside the gates, I stuck my hand up and said: “I’ve worked in the Washington for 6 years, and if the Washington Press Corps isn’t a echo chamber, I don’t know what is.” Even in a room full of journalists, applause broke out. If journalists repond like that, what about our readers and our viewers?

Sometimes, it feels like journalists and politicians are just talking to each other, and it frankly doesn’t have much to do with what the average citizen really cares about. Who’s communities are we telling stories about?

You decide. I report

As an American working for the BBC, covering my own country from one step removed, I had an interesting position somewhere both inside and outside. I wrote a blog of sorts during the 2004 election Technically, the blog were just static pages generated by our production system with some user comments, but I tried to behave like a blogger and have a conversation with my readers.

I took the view that the campaigns and the press corps that followed them stuck to their own scripts. Was there something more that people wanted to talk about? You bet. Healthcare. Social Security. Issues. It felt like a community.

I guess that’s why I’m surprised that this whole bloggers versus journalists battle still rages on. Bloggers are only a part of the communities we serve, but I don’t know why more journalists don’t blog. And I don’t mean using a blog as another way to package a column. As Bob Cauthorn wrote, that is just old school journalists “getting snaps from aging publishers for getting jiggy with the youngsters by jumping into that blogging thing”.

No, I mean blogging to actually have a conversation with your readers, your viewers, your communities.
I joked wih readers of the blog: You decide. I report.

I think sometimes our audiences feel like we’ve left them. It’s not surprising that they’re leaving us.

Thank you for that kind introduction…

I say taking over the mic. Oh wait, that’s over at our podcast. Suw and I have so many of these chats over coffee and crepes (I can’t believe it took an American to introduce her to Nutella) that we decided to capture some of our conversations and invite a few more people to the table.

You know Suw. I affectionately refer to you, her adoring masses, as Suw’s posse. But who is this Kevin character?

The Edward R Murrow of the internet

A friend once said of me that everyone wants something from me but managers don’t know exactly what to do with me. Sure, my journalism career started pretty traditionally. I went to J-school at the University of Illinois, but it just so happened that while I was studying to be an ink-stained wretch, Marc Andreessen and Eric Bina were on the other end of campus coming up with Mosaic.

Before that, I thought the internet was pretty cool, but I couldn’t see my parents getting into it. They had trouble with the VCR and the microwave. How the hell were they going to get their heads around this internet thing? (Bless ’em. I just got them onto Skype over Christmas.) But when I saw Mosaic, I thought as a journalist, this is going to change everything I do. I was just a little ahead of my time.

So when my managers scratch their heads and try to figure out where the hell to shoe horn me into the org chart, they ask, but what is it that you want to do? I want to be the Edward R Murrow of the internet.

Digital storytelling

My television professor told me that before Murrow, television journalism was really just radio with pictures. Radio presenters just sat in front of a TV camera. Murrow helped create a grammar for telling stories tele-visually.

What is internet journalism? Some 10 years into this project, it’s still way too much newspaper and TV journalism regurgitated on a webpage. I went to a great talk by Danish multimedia visionary Ulrik Haagerup last year. He said that at our most basic, journalists are storytellers. We’ve got all these new ways of telling a story, but we might as well be radio presenters reading out reports on a computer screen for all the innovation in the industry.

Our audience is doing it better

But our audiences aren’t waiting for us. Neil McIntosh says that blogging is the first native storytelling format to develop on the internet. A friend of mine said that he worried that blogging had stopped the development of digital storytelling in its tracks.

I initially agreed with him, and then I took a quick look at the really amazing ways that people are telling stories online, and then I realised that blogging and social media are driving digital storytelling online more in the last few years than we professionals had done in the last decade.

Colleagues ask me why I blog. Robert Scoble told me at a London Geek Dinner last year that blogging keeps him and Microsoft close to its customers. Blogging keeps me close and more relevant to my audience than the one-way journalism of yesterday, and blogging increasingly keeps me close to the digital storytellers that are leading the way.

PS. Thanks to Ben Hammersley who shot the picture of me at Les Blogs 2.0.

Welcoming Kevin Anderson to Strange Attractor

You might have noticed that Strange Attractor has been a wee bit quiet over the last few months. There’s one simple reason for this – I’ve been living in the petri dish instead of looking through the microscope at it. A few months ago I had a call from fellow Corante contributor Ross Mayfield asking me to work with Socialtext to help increase understanding and adoption of wikis at one of their clients, Dresdner Kleinwort Wasserstein, an investment bank in London.

How could I say no? For the last couple of years, I’ve been looking at the use of social software in business from the outside, or from brief forays into the business environment, extrapolating and working from first principals. Having the opportunity to put all that to the test, to spend a good solid amount of time on site, working directly alongside the business users and IT department was just too good to pass up.

And then of course I helped co-found the Open Rights Group, a digital rights campaigning organisation based in London. With luminaries such as Cory Doctorow on our Advisory Council, it’s another great opportunity for me to work on issues that are close to my heart, such as digital privacy and access to knowledge.

So my working week has been a bit full, to say the least.

But I felt somewhat reluctant to give up Strange Attractor. I’m fond of the ol’ blog, even though there are probably only about three people who still have it in their aggregator.

What to do? What to do?

The answer came to me as I was talking to my partner Kevin Anderson one day. Kevin’s one of the people working at the BBC on blogging strategy, as well as being a producer on the World Service’s radio programme World Have Your Say, a show best described as ‘it’s like blogging, but on the radio’. He also does a podcast with Ben Metcalfe and Paul Sissons called Talking Shop. So we’re talking about blogging, and journalism, and how the two can peacefully co-exist and it strikes me that Kevin has a lot to say, but nowhere to say it. I, on the other hand, have somewhere to say stuff but not enough time to say it.

I see a neat little solution to both our problems here.

Thus I would like to welcome Kevin Anderson to Strange Attractor. Kev will be talking about the intersections between mainstream media, citizen journalism, blogging, and anything else that strikes his fancy. I’m going to carry on blogging about blogging, and whatever else I feel like. Sometimes our threads might overlap, but between us, hopefully, we’ll manage to update Strange Attractor more than once a month.

Ewan Spence’s Edinburgh Fringe Podcast nominated for a BAFTA

Ewan Spence, occasional co-host of the Movie Show with me and Cameron Reilly, has been nominated for a Scottish BAFTA for his podcast of the Edinburgh Fringe Festival.

Now, let’s just get this clear. A podcast has been nominated for a BAFTA. A BAFTA. Y’know, the award with the golden mask statuette? The sort of award that Ewan McGregor gets. A BAFTA, ffs.

As far as I am aware, this is the first podcast, ever, to be nominated for a serious and well respected industry award.

Huge congratulations to Ewan (Spence, that is, not McGregor. I’d be a year late for him). I know how much work he put into the Edinburgh Fringe Festival podcast, and this nomination is well, well deserved.

The Media Battle: Why is it Google vs. The Rest Of The World?

Bear Storm Media and London South Bank University

(Bear Storm Media is a spin-off company from the London South Bank University.)

Intro

So a friend of mine told me about this mini-conference, and when I looked at the wiki I saw a bunch of names I didn’t recognise, which seemed like a good reason to go along and see what was going on. These are my notes, raw and unedited. Make of them what you will. A small origami giraffe, for example.

Greg Tallent

The way we access content is different. More digital content now, so because there’s more the customer is paying less attention to the content, advertising, anything we’re giving them.

Vin Crosbie, NY journo, said he pays more for his digital media than print, because the online versions are worth more and are more useful – archives, email-able etc. Print is not very easy to repurpose.

News and most other media content will be delivered either exclusively on the internet or as well as on the internet. Digital channels will proliferate, communities will develop, and the content (free or paid) will drive them.

Moving from an information world to an attention world: too much info; too little time; not enough attention.

NBC Universal CEO Bob Wright, says that network news will always have a place because people can’t be bothered to wade through online content.

At the moment

– too much digital content

– little customer attention

But is this changing?

Digital media will get and keep the customer’s attention. How? By making it relevant to the person. This is a big issue. People won’t buy content unless it is relevant.

– make it personal

– make it worthwhile

– make it valuable

In other words – talk to people

– look at the customer

– learn from customers in real time

– communities work best with market dynamic

– treat customers as people

– quality of individual experience is what matters

– delight the user

– interact and engage – has to be relevant and at the right time

– build trust

– chart interactions with the product.

Any media biz in 2006, who want to integrate quality content into a digital channel will ahve to consider

– communities, vast thin networks of members

doughnut communities that are temp and come together round a site

– combine human/algorithm filtering to make it simple to follow who’s saying what

– tags

– metadata (ensures that content can be used again and again)

All this becomes relevant to the reader.

Who’s building relevancy now?

– Microsoft

– Google

– Yahoo

– AOL

… and a bunch of others

How big is this?

Well, Google’s selling $6.1 billion ads, double what is sold last year. Have grand ambitions. Microsoft fighting back. Looking to build a seamless experience, capture some of the advertising revenue etc. But Microsoft look dated – the slide from the Microsoft Live Platform presentation that Bill Gates gave looks really dated. Compare to Steve Jobs presenting the iPod Video. Microsoft lost the plot a bit in the past two or three years.

[The shows Epic 2014, the Googlezon animation.]

There’s some truth to Epic, it’s not all sensationalism. People are working on changing the way we produce and consume media. It will be sooner rather than later that we use these new ways.

Leave you now with a brief mention of something planned for next year – this is just a mini-conference, and we’re planning a bigger one – News Media UK Convention, in March 2006. See Bearstorm for news of that.

Mike Butcher, Paidcontent.org – The Holy Trinity, or The Future Of News Media

Haven’t watched Epic for a while, and a copule of things occured to me. The idea that millions of people edit stuff and it turns into trash TV, and one thing that popped into my head was Paris Hilton – her mobile phone address book was leaked onto the internet earlier in the year, and of course it was blogged everywhere, because it’s just so fascinating. And that’s just trash. But everyone’s interested in it. And that’s what Epic is about – that a lot of rubbish gets put out there.

But the Googlezon idea of the video does kind of work. But it said NY Times became just a print magazine circulated to the elite and the elderly, but if the elite and the elderly can’t be reached by new media, how do we take part in their conversation?

Blackberry is used across Yahoo so people can get their email at any time. But the really powerful people at Yahoo don’t have Blackberries, so are unreachable. And the elite are more unreachable by new media than we think.

Trinity No. 1

– You and me

– blogs, podcasting, user generated content

Rupert Murdoch, not Trinity No. 1, but he said that newspapers were threatened by the net, that people wanted control over the media not to be controlled by it, and that the newspaper industry has been complacent.

Citizen media is really a tools revolution. There is a lot of stuff out there that makes life easier. Stats go out of date really time, so these are too, from 2004

8 Million American adults say they have created blogs

58% read blogs

12% of users post comments on blogs

[Yes, these stats are out of date!]

Most internet users do not know what a blog is.

RAJAR – no figures yet for podcasting but Pew says

6 million have downloaded at least one podcast

29% of 2021 users interviewed used podcasting

11 – 15% of US population owns an MP3 player

In the UK:

BBC In our time – 40k downloads a week

BBC Beethoven – started as 600k a week, ended up a million downloads

Virgin breakfast show podcast just links between songs, run at 80k downloads a week (3 months ago)

Perhaps this is why Murdoch is worried, and maybe that’s why he bought MySpace.com for $800m.

Thing is:

– early days

– emerging trend

Only a 20% of 18-34 year ols rank newspapers as their primary source of news

44% check out Google and Yahoo for updated information

Definite move away from old media.

Tools:

100% mobile phone penetration in W Europe by 2007

At least one mobile handset for every person – means ability to create content, photos, text etc.

Widespread internet access, broadband penetration etc, allows for proliferation of content

Where’s the money?

Advertising agencies interested in blogs because they are created by you; also want to track conversations in blogs; want to buy advertising on blogs.

Dyson was the first to use blogs in a major ad campaign, on Shiny Media.

‘Truth tools’ are out there – MSN opens blogs and IM to advertisers; Yahoo bought Flickr; Microsoft trials RSS Collector; London bombs: moblogging.co.uk ran one of the first pictures, which was syndicated to Sky news.

Because of this tools revolution, the big guys want to get involved. Yahoo! in particular are so interested in this because they want you to create content so they can sell ads for it.

Means of distribution are in the hands of the workers – RSS, Technorati, Feedster, Google/Google News.

Publishing passion – Andrew Sullivan’s Tip Jar; Treonauts; Weblogs Inc (sold to AOL, $25m); Gawker-branded blogs; Shiny Media; Google AdSense.

But: bloggers are not necessarily the ‘new journalists’. Marqui recently launched an adverblogging campaign, paying 20 bloggers $800 a month to mention their product and link to their site.

Why are the media interested?

– TV’s dominant share on verge of long-term decline; ad-skipping

– ZenithOptimedia predicts market share will decline from 2007.

Trinity 2

Advertising

Big media hiring bloggers; launching blogs.

Can’t just go out and launch a blog because they’re creating their own.

Final trinity

Search. 80% of lineusers start at a search engine. Very influential, are the leveller between gib and small media.

Search, big media and user generated content forms a holy trinity of online media that feed into each other adn rely on each other.

Conclusion

News media has to be more transparent.

Big media will co-opt citizen media

Big media’s not dead, it’s just resting

Difference between fast and slow media, raw and cooked, un-edited and edited

But blogs could be as big as Time.

Al Tepper, head of Online Dev’t, Caspian Publishing – Professional blogging

Word blog is misleading – blogging is software, it’s actually a website. The word blog is probably the biggest reason that blogging is not mainstream. People visit blogs and don’t know it.

Why is it Google vs. ROW, is because seeing a devolution of information, tools, opps, and anyone can broadcast anything on the web for virtually nothing in under 10 mins. Ish. Because there are bad bloggers. 99% of blogs are dross, and the whole Epic movie gets that point across. But we already do. But blogging gives everyone the opportunity to be heard.

Caspian is a B2B publisher. In a world of info overload, editors are really important. Great quote by Frank Zappa: A computer can tell you a story, but it can’t tell you the whole story. It just doesn’t have the eyebrows.

There is no AI that will be able to edit 500k words into a 200 word article. Impossible for a computer to do. Semantic web will be very slow to develop and not convinced it will be able to deliver relevant content.

Caspian launched a blog: www.thebusinesseditors.com. have 20+ editors, and they are all experts, and they all talk amongst themselves about what they’re doing.

Hypergene.net/blog have a recommended reading section and call it ‘usable exhaust’. Use Del.icio.us to put websites they come across into their blog, but it gets them lots of traffic.

Caspian’s ‘usable exhaust’ is their blog, where their editors blog the stuff they can’t put in magazines. Value is that it’s great content, good for search engines. Learnt that they need to provide good navigation between different sites. Didn’t learn quickly enough about editorial policy – getting offline editors to blog is difficult because they don’t know HTML, even using Typepad, and on OS9 the formatting doesn’t work so have to get people to mark-up. Learnt about comments process and libel issues, so has to be approved before publication.

Key stuff to understand is the value of it – good marketing tool. May monetize it down the line, but no great vision of that at all. Starts a conversation with the readers. Can be a part of the conversation or a subject of that conversation.

Andy Corcoran, Marketing Lecturer, Lincoln Business School – What’s the business model?

Current situation. Relevant content is there, but people don’t know how to get to it. Anyone can publish, and you could be the next Nick Denton, but the barriers to entry to that marketplace are very low. Highly competitive marketplace.

Media fragmentation. Mass media in decline, ‘other’ media on the rise. 249 channels on sky, not counting the +1 channels. Multiple media vehicles. Most content presented in really bad way. Sky TV guide is awful – laborious and difficult to do. Similar to new media – convenience, ease and accessibility are key factors.

Media is producing more places to get the same content.

Cash rich, time poor.

Individual households – people spend more time online to find community because they are living on their own.

Digi-phobic – 33% of the population don’t see the need or can’t afford to get online.

Increasing advertising spend on the internet

Trends

Stable TV viewing – 209 minutes per day in UK, 275 per day in the US; more media, more media consumption, so not dying just fragmenting

Stable newspaper market, (paid for media, not free), decline has arrested because newspapers easier to read now (smaller!)

Online everywhere, wireless. Will see people online in Starbucks, but also will be reading the Times. Easier.

Someone makes life easier by choosing stuff for us.

Growing no. of bloggers. Even a blog about brass rubbings in Madagascar. Riches in niches. Shift in the marketing paradigm.

Life is complex, with networked relationships

Danger of analysis paralysis – too much information so people can’t make decisions. People buy on emotion and the ability to communicate that emotion is crucial

Orgs need to deliver one of the following to succeed

– operational excellence

– product leadership

– customer intimacy

Moving away from 4Ps towards relationship marketing

Mass customisation not mass production (not bespoke, that’s too expensive)

30 sec commercial not dead

Product placement more attractive

Magazines more convenient, people are reading more magazines

Era of ‘must’ – must see, must hear, must watch, must read

Move to pictures – which is why we still watch TV. Visuals, logos, etc. More whitespace = perception of value and quality.

Google will be competing with Murdoch, Sky, etc.

Business Models

1. Drudge report style: get big and sell; but you won’t be the only one trying to do that. Producing a lot of stuff is hard work.

2. Riches in niches

3. Connecting and communities

– Drudge report

Lots of money in press classified advertising – 19.5% of the advertising spend in the UK.

Difficult for blogs to break in, but it’s going to have to be good, and you’re going to have to get people to visit.

Is it possible to become a big publisher? Yes, but difficult.

Hugely competitive market. Newspapers giving away DVDs, and are not going to lie down and die.

– Riches in niches: Treonaut. Sugar icing blogs. Got too be unique. Got to provide something useful. Lifesytle and psychographic profiling is done. RSS enables.

– connecting and communities. Net provides this as biggest opportunities for companies and business, not about space or advertising but finding out what people think about your products. relationship marketing. Dialogues with customers. Focus groups. Research. Brand communities. Tools like Flickr allow people to connect despite geography, and if companies can capitalise on that they can benefit. But must be congruent with your product.

Most likely business models are 2 and 3.

New business blogging survey

BlogOn and iUpload are doing a survey of business bloggers to find out more about how companies are using blogs. Preliminary results will be announced at BlogOn2005 Social Media Summit, 17-18 October at the Copacabana in New York.

As producer of BlogOn, and a chronic stats obsessive, I can only urge you to fill in the questionnaire – it’s fairly short, shouldn’t take you more than about three minutes – so that I have lots of data to play with. Word is we’ve already had a good number of respondents, which makes me deeply excited because I am just dying to find out what people really do with their business blogs.