Can comments withstand Google-scale communities?

Not long after I joined the Guardian as blogs editor in 2006, I was at an online publishers event in London. Forefront in my mind was how to build engagement at the scale that we would quickly find with Guardian blogs, a particularly important question given that this was several months after the launch of Comment is Free, which was already suffering from serious teething pains socially. I asked Tim O’Reilly how to scale community, and he said:

You have to stay small as you grow big.

Being at a conference, Tim didn’t elaborate on his Zen k?an, but I still ponder it today, especially as I read this: How Ta-Nehisi Coates built the best comment section on the internet—and why it can’t last.

Flipping back to 2006, I had recently done a lot of work in my previous job at the BBC regarding social media – blogging as social media was then – I wondered how well the social aspects of blogs would hold up when we threw the scale of audience at it that the BBC could generate. I foresaw some of the issues that BBC bloggers would have in terms of trying to deal with volume of comments that they would instantly face.

In traditional blogs, the core audience is a community of choice, a group of people that shared an interest in a particular topic. That community of commenters grew to have social connections, bonds that helped foster civility. At the BBC, our bloggers could quickly generate an audience, but that didn’t mean we could create anything like the thoughtful communities of choice that we saw with smaller blogs. Our commenters didn’t know each other and would often be drawn to hotly contested topics because of strong, often diametrically opposed opinions.

To make that kind of conversation work, you need people with a very different skill set than your traditional columnist, who often come at issues with a ‘what do I want to be outraged about today’ type of mindset. What you need in order to make comments sections really work is exactly the kind of mindset that Coates’ brings to his work, but that doesn’t mean that you don’t still face the challenge of staying small as you grow big.

The issue is that the internet rewards scale and some social strategies simply fall apart at Google-scale. Once The Golden Horde – the name given to Coates community of commenters – grows beyond a community of choice and starts to attract people wanting to vent about some of the most sensitive issues that we face today, the comments often become unmanageable.

Back when I was blogs editor at The Guardian, I was often asked how I measured success, and I said it was not by the number of comments. Any fool can generate comments. You simply pick the hot topic of the day, push people’s buttons until they bleed and then survey the wonderful wreckage of human outrage. That is why in 2015 the internet sometimes feel like one gigantic generator of human fury.

Outrage was the standard editorial strategy in the 20th Century, when the only return channel was analogue and scarcity of letters to the editor set a high enough bar to keep the Angry from Milton Keynes interplay to a manageable and highly controlled level. That editorial strategy does not work in the 21st Century with a completely open return channel for which the technical and social tools have not kept pace.

In this century, the big challenge is generating thoughtful conversation. I have tried it a number of times, to the point where commenters knew that I was building a digital media Skinner box: Rewarding productive contributions more than punishing transgressions and guiding the comments towards conversation rather than confrontation. It is hard work and it does not scale particularly well. I was blessed with the autonomy and time to do it, but it takes time and a lot of effort.

At the end of the of the day, maybe staying small as you grow big is like Google where you break up a team when it gets too large. Maybe the only way to make this work is to keep the communities and conversations small enough so that people actually develop the kind of social bonds that allow them to disagree with civility. But that runs counter to the gigantic scales that make a business sustainable on the internet.

So, what happens when the business imperative to scale comments runs counter to social strategies to manage them? Things fall apart. It’s that simple. They become unmanageable and eventually people burn out and the communities of choice leave, in search of some other space where things work on a more human scale. I’ve seen it happen time and again. Some people seem like serial early adopters, but what they are really doing is seeking a space in which they can find community.

As an editor, this raises all kinds of questions. But the one thing I would say is that while we all want the biggest audience possible, we have to accept that strong, highly-engaged community strategies operate on a different scale. Push them beyond their social bounds and they will simply fall apart.

Update: After thinking about, small communities of choice also tend to be rather homogenous. This begs the question on how we develop technologies and social techniques that allow for diversity of thought and civil dissent.