The effects of openness matter more than the degrees of openness

Platform strategy or more specifically API strategy is a very effective starting point from which to debate the many flavors and degrees of ‘open’ that play out on the Internet.

For me, the open API debate is all about catering to the means of production.

Developers want data to be hosted by machines at some URL that they don’t have to worry about. When they are building things, they like the data output from those sources to be structured in clean formats and easy to obtain in different ways.

Give them good materials to build with and maintain low overheads.  They will build better things as a result.  Your costs go down.  Your output and your ceiling of opportunity go up.  It’s that simple really.

Of course, there are certainly many nuances.

When Mathew Ingram of GigaOm recently posed the challenge that Twitter and NYT face a similar business model issue around openness he was right to point out the difference between NYT and the Guardian’s approaches to APIs.

The New York Times has experimented with open APIs, which give outside developers access to its data for use in third-party services or features…But the traditional media player that has taken this idea the furthest is The Guardian newspaper in Britain — which launched an “open platform” project in 2010, offering all of its data to outside developers through an API. Doing this has been a core part of Editor-in-Chief Alan Rusbridger’s concept of “open journalism.”

It’s useful to have an example of where an open API creates value.  The Guardian Facebook app is a good example both in terms of innovation with partners but also in terms of real commercial value.

The concept for the app had already been explored months before Facebook announced seamless sharing.  Michael Brunton-Spall, Lisa van Gelder and Graham Tackley built a clever app they called Social Guardian at a Hack Day.

When FB then gave us the opportunity to build something for their launch, we obviously took it.  The app was built by a 3rd party in record time, and it subsequently took off like a rocket.

As we all know, Facebook adjusted their algorithm and tempered the explosive growth, but it should be considered a success by any measure.  It was built quickly and executed well.  It cost us very little. Users adopted it very quickly.  It generated huge buzz for our brand and introduced the Guardian to a whole new audience we weren’t reaching.

It also drove dramatic traffic levels back to the Guardian web site which we then turned into advertising revenue for the business.

Low cost. High adoption rate. Innovative. Revenue generating.  What else could you ask for?

It’s a solid example of the generative media strategy I was trying to articulate a while back.

Martin Belam posted a detailed case study of the app here and here.

However, while we’ve pushed the envelope on openness and commercial leverage for APIs in the newspaper world, there are other API pure play businesses like NewsCred who have expressed the open API strategy for content in an even more complete form.

They are a content API warehouse. As a developer, if you are working on a digital product that could use some high quality articles or video from brand name media sources then you would be wise to browse the NewsCred catalog.

But NewsCred doesn’t allow just anyone to drop a feed of content directly into their platform. They want to curate relationships with their sources and their API customers…they make money being in the middle.

What’s the trajectory on the sliding scale of open APIs?

There was an interesting marketplace forming several years ago around similar types of businesses we’re seeing today that never completely catalyzed.  It might be instructive to look at that space with fresh eyes.

The blog, RSS feed and personal start page triple play was a perfect storm of networked information innovation in 2004 or so. Several companies including Twitter CEO Dick Costolo’s company did very well executing an open platform strategy and exiting at the right moment.

Today the new blog includes context in addition to words and pictures. RSS feeds evolved into APIs. And personal start pages learned to listen to our behaviors.

The killer open strategy now would be one that can unify those forces into a self-reinforcing amplifier.

Arguably, Facebook already did that, but they’ve applied a portal-like layer to the idea creating a destination instead of an ecosystem.  They are also using personal connections as the glue that brings out the best in these 3 things.

That is only one approach to this space.  Another approach is to do one of those things really really well.

Twitter, Tumblr and WordPress are doing great on the creation side, but they need to keep an eye on open participation platforms that marry context with content. Mass market API activity is nascent but bound to explode again given how important APIs are for developers. FlipBoard and some newcomers are reinventing the old idea of automated aggregation through better packaging and smarter recommendation algorithms.

Enter the business model question.

One thing I’ve learned to appreciate since joining the Guardian 4 years ago now is the value of the long game.  The long game forces you to think about what value you create for your customers more than what value you take from your customers.

Of course, going long should never be mistaken for being slow. Marathon runners can still do a sub 5 minute mile.

As I recently said about the WordPress strategy of generosity, the value you create in the market will then come back in the form of stronger ties and meaningful relationships with partners who can help you make money.

The open debate often gets ruined at this point in the argument by those who only think of success in terms of quarterly P&Ls. That’s fine and totally understandable. That matters, too…massively. But it’s not everything. And it’s as big of a mistake to focus only on P&L as it is to focus only on the long term.

I once got some brilliant advice from my former boss at The Industry Standard Europe, Neil Thackray, who said to me when I was struggling to work out what my next move was going to be after that business failed.

He said, “what are you going to tell the grandkids you did during the war?”

It’s a great way of looking at this problem.

The battle we’re all fighting in the news business is how to make the P&L work.  We will win that battle with hard work, creativity, and perseverance.

But the war we’re all fighting in the news business is about securing the long term viability of journalism or a journalism-like force in the world that can hold power to account and amplify the voices of people that need to be heard.

Profit is one force that can secure that future.  But profit is not the goal itself.  Nor is the success of one media brand at the expense of another.

I’m also of the opinion that Twitter has made a long term mistake by prioritizing advertising on their client experiences over the value of their partner ecosystem.  But it’s easy to have that opinion from outside their board room, and perhaps advertising will make them a stronger force for good than they would have been as a pure platform service.

Similarly, NYT is using their APIs to improve innovation within the business. Effectively, the Guardian is doing the same except that it views the success of its business through the eyes of its partners in addition to itself.

Is that ‘more open’, as Mathew asks?

Who cares?

Is the NYT form of an open API helping them secure a future for the effects of journalism in the world?

If the answer to that question is ‘yes’, then the degree of openness compared to others is totally irrelevant.

The generosity strategy

I’ve wondered for a long time why WordPress doesn’t get the dotcom homage some of the other perhaps less interesting organizations are showered with.

There are many reasons to pay attention to them, but there’s one primary aspect of what they do that’s worth spending some time thinking about – what they give to the market in order to fuel a network that they benefit from in the end.

As Andy Weissman wrote about TED, sometimes giving away the core assets of your business is exactly what will create success for you.

“With the content, processes and brand more freely available, the community and the set of values can instead drive the business. And those are not as easily replicable.”

This attitude is what won them the war with their first rival in the blogging world, Movable Type.  It turns out that generosity is a very competitive strategy in a globally connected world.

Except it’s not my impression that was what they were intending the strategy to be used for. I think they used that strategy because it resonated with what type of company they wanted to have first and foremost.

It’s also true that ‘free’ can destroy established markets in order to create advantage for alternative models.  Bill Gurley has written before about how Google is intentionally using a scorched earth policy with Android, in particular, in order to build an unapproachable moat around their core business.

The WordPress approach has similar effects in the content management market, but they’ve built the core business itself on the open strategy.  They have made themselves dependent on the success of their customers.

I had the good fortune of inteviewing Matt Mullenweg on stage at The Guardian’s Activate Summit event last week where we spent most of our time talking about how the WordPress team operates. This is not a man chasing wealth for the sake of wealth, though wealth may in fact be chasing him. This is a person who understands the DNA of the Internet and knows intuitively how to craft a movement optimized to use the most powerful aspects of the network.

In case you’re unaware, WordPress is a publishing platform. They sell access to the WordPress tools, and they also give away the software.  The whole thing. They put it out there to download for free with an open license. They even make it super easy to install. No tricks. It’s genuine. They want you to use their software even if they don’t see a shred of direct value coming back to them as a result.

Their software is their core asset. Without it they have nothing. Why would they give it away?

What they are building is not your traditional enterprise software business. What they are building is at the very least a partner network if not something even bigger, something that looks more like a movement.

Looking at their business through the enterprise sofware lens is easy to do and certainly worth more consideration. They are leaving a lot of money on the table. They know this, and they’ve made impressive progress recapturing that lost opportunity with their VIP business.

But the founder’s philosophies lead the commercial strategy, not the other way around. WordPress wants to be a platform for free speech. Everything else comes after that.

As Matt said at Activate, “We are a neutral force. We participated in the SOPA blackout because we felt it posed a threat to our ability to stay that way.”

Operating the business strategy at that level creates a framework for all their decision-making.

They can open source their core assets because it strengthens the collective power of the WordPress toolset as a platform for free speech. In addition, it gives them a sensible model for working with developers who want to contribute code to the platform. They can operate with a small staff, prioritize product over profit, and play fast-follower to the break-neck pace of innovation that most of the rest of the top players in the business may be forced to play.

What’s the result of the generous nature of their business?

75M blogs, about half of which are hosted by them, and many of those pay them a monthly hosting fee. 341M monthly users across the network. 20,000 software plugins built by a huge network of developers working on the platform…many of whom make money being professional service providers and premium template designers for WordPress.

Now, they have a lot of powerful forces challenging their existence. Not least of which is the atomization of everything and challenges to the idea of blogs and even articles.

But by embracing a strategy of giving and a deep-seated commitment to enabling others to speak their minds on the global stage, WordPress has something more valuable than robust revenue streams. They have a network of customers who need them to succeed in the world.

That network of people is more valuable than any software or hardware distribution platform.

The power of collective research, task-based investigations and swarm intelligence

In January 2007 a well known computer scientist named Jim Gray was lost at sea off the California coast on his way to the Farallon islands.

It was a moment that many will remember either because Jim Gray was a big influence personally or professionally or because the method of the search for him was a real eye opener about the power of the Internet.  It was a group task-based investigation of epic proportions using the latest and greatest technology of the day.

I didn’t know him, but I will never forget what happened.  Not only did the Coast Guard’s air and surface search cover 40,000 square miles, but a distributed army of 12,000 people scanned NASA satellite imagery covering 30,000 square miles.  We all used Amazon’s Mechanical Turk to flip through tiles looking for a boat that would’ve been about 6 pixels in size.

They attacked the search in some phenomenal ways.  Here is Werner Vogel’s public call for help. You can also go back and read the daily search logs posted by his friends on the blog here.  Both Wired and the New York Times covered this incredible drama in detail.

Since then we’ve seen the Internet come to the rescue or at least try to make a difference using similar crowdmapping techniques.  Perhaps the most powerful example is the role crisis mappers and the Ushahidi platform played in the major Haiti earthquake in 2010.

But it’s not just crisis where these technologies are serving a public good.  We’ve seen these swarming techniques applied in a range of ways for journalism and many other activities on the Internet.

Perhaps the gold standard for collective investigative reporting is the MPs Expenses experiment by Simon Willison at the Guardian where 170,000 documents were reviewed by 15,000 people in the first 80 hours after it went live.  The Guardian has deployed its readers to uncover truth in a range of different stories, most recently with the Privatised Public Spaces story.  We’ve also looked at crowdmapping broadband speeds across the UK, and Joanna Geary’s ‘Tracking the Trackers‘ project uncovered some fascinating data about the worst web browser cookie abusers.

Last year Germany’s defense minister Karl-Theodor zu Guttenberg, a man once considered destined for an even larger role in the government, was forced to resign from his post as a result of allegations that he plagiarized his doctoral thesis.  It was proved to be true by a group of people working collectively on the investigation using a site called GuttenPlag Wiki.

ProPublica is a real pioneer in collective reporting and data journalism.  For example, their 2010 investigation into which politicians were given Super Bowl tickets provided a wonderful window into the investigative process.  And the Stimulus Spotcheck project invited people to assess whether or not the 2009 stimulus package in the US was in fact having an impact.

Also, Kevin Anderson reminded me of http://www.ipaidabribe.com tracking local corruption and http://oilreporter.org/ which came out of the Gulf of Mexico Oil Spill in 2010 and helps people report wildlife damage, share photos, etc.

Of course, swarming projects can have a range of different intentions, and if one were to try and count them I would bet only a small percentage are high impact journalistic endeavors.

Andy Baio is a pioneer in this kind of concept and has either been the curator of data already in existence or the inspiration for a crowdsourced investigation.  For example, his “Girl Turk” collective research uncovered an exhaustive list of artist and track names sampled for Girl Talk’s Feed the Animals album.

The big advertising brands intuitively understand the power of swarming intelligence, too, as they see it as a way to use their loyal customers to help them acquire new customers or to at least build a stronger direct relationship with a large group of people.  This is essentially the pitch once used by MySpace and adopted by Facebook, Twitter and Google +…Step 1: create a brand page where people can congregate, Step 2: inspire people to do something collectively that spreads virally.

The technologies that make these group tasks possible are getting easier and more accessible all the time. The wiki format works great for some projects.  DocumentCloud is a tremendous platform.   Google Docs are providing a lot of power for collective investigations, as we’ve discovered several times on the Guardian’s Datablog. And, of course, crowdmapping can be done with little technical intervention using Ushahidi and n0tice.

Of course, you can’t discount the power of the social networks as distribution platforms and amplifiers for group-based investigations.  Creating the space for swarming activity is one thing, but getting the word out is a role that Facebook and Twitter are very good at playing.  It’s a perfect marriage, in many ways.

An army of helpers may be accessible in other ways, too.

Amanda Michel who famously drove the Off The Bus campaign at HuffPo (more on that below) produced a guide to “Using Amazon’s Mechanical Turk for Data Projects” while at ProPublica where she describes how they hired workers to complete short, simple tasks.

But I imagine that the next wave of activity will arise as some of the human patterns of group tasks inspire more sustainable technology platforms.  As Martin Kotynek and ‘PlagDoc’ acknowledge in their wonderful report “Swarm of thoughts” there’s a need for some sort of centralized research platform so this kind of activity is easier to trigger and run with.

Perhaps it’s a matter of identifying a few very specific collective research concepts that work and fueling ongoing community activity around those ideas.  Citizen journalism, for example, is an obvious activity where communities are forming.

CNN’s iReport has a ready-built citizen journalist network incentivized by exposure on cnn.com, and the n0tice platform can enable citizen-powered crowdmapping activity for a range of different projects and get exposure and distribution across different platforms.  Both are capable of serving an ongoing role as useful every-day citizen journalism services that can crank up the volume on a particular issue when the appropriate moment arises.

Platforms can create some ongoing momentum, but so can issues.

Off The Bus was an 18-month HuffPo initiative where readers and staff covered the US elections collaboratively from their own communities. The project had the additional benefit of generating insights that turned into larger editorial investigations such as the Superdelegate Investigation, a report on the Evangelical Vote and the Political Campaign HQ crowdmapping project.  Ryan Tate’s book The 20% Doctrine goes into some detail about Off The Bus, how it developed, and how Amanda managed it all.

I suspect that a whole class of swarming intelligence projects is starting to bubble up that may only appear when the human story, the technology, and the amplifier join up and create a perfect storm.

In the end, it comes down to projects that resonate with people on a personal level.

Though Jim Gray was never found, the thinking about how to conduct the search amongst the leaders of the crowd at the time could not have been more cogent.  The instructions for participants were inspiring, detailing a simple task and the result of completing it:

You will be presented with 5 images. The task is to indicate any satellite images which contain any foreign objects in the water that may resemble Jim’s sailboat or parts of a boat. Jim’s sailboat will show up as a regular object with sharp edges, white or nearly white, about 10 pixels long and 4 pixels wide in the image. If in doubt, be conservative and mark the image. Marked images will be sent to a team of specialists who will determine if they contain information on the whereabouts of Jim Gray. Friends and family of Jim Gray would like to thank you for helping them with this cause.

It’s conceivable that the most important thing social media has accomplished over the last 3-5 years is that it has unlocked the natural desire people have to impact what’s happening in the world in a way they may not have felt empowered to do for decades.

Now it’s simply a matter of joining up the technologies in ways that enable those ideas to come to life.


 

A List of Collective Investigations

Below are some of the projects mentioned above and several others that have been sent to me.  I’ve included a few things that aren’t journalism investigations that are worth a closer look simply because they can be instructive.

Tenacious SearchSince January 28, the San Francisco police, the Coast Guard and Jim’s friends and family have conducted an extensive search to find him and his sailboat, Tenacious, off the California coast. I want to summarize the status of that search here, so that the broad volunteer community that’s done so much knows where we stand.

Embedly Powered

Crisis mapping brings online tool to Haitian disaster relief effortPatrick Meier learned about the earthquakes at 7 p.m. Tuesday while he was watching the news in Boston. By 7:20, he’d contacted a colleague in Atlanta. By 7:40, the two were mobilizing an online tool created by a Kenyan lawyer in South Africa. By 8, they were gathering intelligence from everyplace,…

Embedly Powered

The Brian Lehrer Show – Are You Being Gouged?Our latest “crowdsourcing” project asks listeners to go to their local grocery store and find out the price of three goods: milk, lettuce and beer. You don’t have to buy them (or consume them), but we want to know how much they cost in different neighborhoods throughout the New York area.

Embedly Powered

via Wnyc
Investigate your MP’s expensesWe have 458,832 pages of documents. 33,105 of you have reviewed 226,139 of them. Only 232,693 to go… Start reviewing Please read our privacy policy to find out how we use your data. You must also read our terms of service.

Embedly Powered

Privately owned public space: where are they and who owns them?We’re in the middle of a creeping privatisation of public space. Streets and open spaces are being defined as private land after redevelopment. It began with Canary Wharf but is now a standard feature of urban regeneration. In future, one of the biggest public squares in Europe – Granary square, in the new development around Kings Cross – will be privately owned.

Embedly Powered

Broadband Britain: how fast is your connection?With your help, the Guardian is creating an up-to-date broadband map of Britain, showing advertised versus real speeds. We want to highlight the best and worst-served communities, and bring attention to the broadband blackspots.

Embedly Powered

Tracking the trackers: help us reveal the unseen world of cookiesCookies and other web trackers monitor our online behaviour and store our browsing habits, but who are the companies behind them and what are they doing with our data? We have teamed up with Mozilla to try to find out.

Embedly Powered

GuttenPlag WikiAchtung: Dies sind keine Initiativen von GuttenPlag Dies ist eine kollaborative Dokumentation der Plagiate – jeder ist eingeladen, hier mitzuarbeiten. Ergänzungen und Änderungen in diesem Wiki sind transparent und jederzeit nachvollziehbar. Jede Bearbeitung wird protokolliert. Siehe: Letzte Änderungen (ohne Diskussionsbeiträge) Guttenbergs Dissertation und die Plagiatsvorwürfe wurden seit dem 16.

Embedly Powered

via Wikia
ProPublica’s Super Bowl Blitz: Which Congressmen Are Getting Super Bowl Perks?Carson, André (D)(202) 225-4011 7th IN Don’t call [ Sebastian Jones, ProPublica ] Don’t call [ Sebastian Jones, ProPublica ] Awaiting reply [ Kathleen McLaughlin, Indianapolis Business Journal | Congressional staff Glendal Jones, press secretary, Feb 3, 2010 ] Delahunt, Bill (D)(202) 225-3111 10th MA Staff doesn’t know.

Embedly Powered

I Paid a Bribe | Uncover the market price of corruption in Indiaipaidabribe: Share your story on bribes and corruption. Read latest news on corruption in Indian bureaucracy and civic agencies. Read corruption and bribery related stories from all over India

Embedly Powered

Deepwater Oil Reporter Crowdsourcing PlatformHere are a few things we think you need to know before joining this open data sharing initiative. Please read before you proceed. Know that all data reported on Oil Reporter is PUBLIC. If you don’t want to share information with the public, Oil Reporter isn’t for you.

Embedly Powered

Girl Turk: Mechanical Turk Meets Girl Talk’s “Feed the Animals” – Waxy.orgGirl Talk’s Feed the Animals is one of my favorite albums this year, a hyperactive mish-mash sampling hundreds of songs from the last 45 years of popular music. Gregg Gillis created a beautiful, illegal mess of copyright clearance hell, which you should download immediately.

Embedly Powered

via Waxy
HuffPost Launches OffTheBus Citizen Journalism Project Ahead of 2012 ElectionsWASHINGTON — If you are like most people, you don’t much like the way the “national media” cover politics. As a long-time member of the Washington press corps, I agree with you. We can be trivial, shortsighted, credulous, ideologically blinkered and timid — on a good day.

Embedly Powered

Netflix Prize: HomeThe Netflix Prize sought to substantially improve the accuracy of predictions about how much someone is going to enjoy a movie based on their movie preferences. On September 21, 2009 we awarded the $1M Grand Prize to team “BellKor’s Pragmatic Chaos”. Read about their algorithm, checkout team scores on the Leaderboard, and join the discussions on the Forum.

Embedly Powered

HerdictWeb : AboutAbout Us Herdict is a project of the Berkman Center for Internet & Society at Harvard University. Herdict is a portmanteau of ‘herd’ and ‘verdict’ and seeks to show the verdict of the users (the herd). Herdict Web seeks to gain insight into what users around the world are experiencing in terms of web accessibility; or in other words, determine the herdict.

Embedly Powered

The High Price of Creating Free Ads – New York TimesFrom an advertiser’s perspective, it sounds so easy: invite the public to create commercials for your brand, hold a contest to pick the best one and sit back while average Americans do the creative work. But look at the videos H. J. Heinz is getting on YouTube.

Embedly Powered

SpotCrime Crime MapArrest Arson Assault Burglary Robbery Shooting Theft Vandalism Other Loading Crime Data… City and county crime map showing crime incident data down to neighborhood crime activity. Subscribe for crime alerts and reports.

Embedly Powered

The Peer to Patent Project – Community Patent ReviewThe Community Patent Review: Peer to Patent project On June 15, 2007, the United States Patent and Trademark Office (USPTO) opened the patent examination process for online public participation for the first time.

Embedly Powered

via Nyls
Prize4LifeOur mission is to accelerate the discovery of treatments and a cure for ALS by using powerful incentives to attract new people and drive innovation. We know that the solutions to some of the biggest challenges in ALS research will require out-of-the-box thinking, and some of the most critical discoveries may come from unlikely places.

Embedly Powered

FixMyStreetHow to report a problem Enter a nearby GB postcode, or street name and area Locate the problem on a map of the area Enter details of the problem We send it to the council on your behalf 1,616 reports in past week 2,529 fixed in past month 204,852 updates on reports

Embedly Powered

Reporting Recipe: Using Amazon’s Mechanical Turk for Data ProjectsOf all of journalism’s recent evolutions, data-driven reporting is one of the most celebrated. But as much as we should toast data’s powers, we must acknowledge its cost: Assembling even a small dataset can require hours of tedious work, deterring even the most disciplined of journalists and their editors.

Embedly Powered

HuffPost’s OffTheBus Superdelegate InvestigationWe asked HuffPost readers to join with us and profile the hundreds of superdelegates who are likely to decide the Democratic nomination for president. Hundreds of you responded and we can now present our initial findings. Just click on a state or territory and a list of superdelegate profiles, as compiled by our citizen journalists, will pop up.

Embedly Powered

The Political Campaign HQ Next Door: OffTheBus Special Ops PhotographsWhere are the state campaign headquarters located, exactly, for the party that claims to represent Main Street? Where are they located for the party that claims to represent everyone? Thanks to the work of HuffPost OffTheBus Special Ops, you can visit offices around the nation in just a few key strokes.

Embedly Powered

Introducing Stimulus Spot CheckJuly 20, 2009: This post has been corrected. It’s the middle of July and we’re all wondering whether the stimulus is working. If we do as the administration has advised, we should remain patient – and let the administration measure its own success.

Embedly Powered

WNYC – Mapping the Storm Clean-upWe’ve been asking readers and listeners to let us know if their streets have been plowed. Here are maps from Tuesday, Wednesday and Thursday (white balloons represent unplowed streets, blue plowed). Click the balloons for full information and voice messages where available. Submit yours by texting PLOW to 30644.

Embedly Powered

via Wnyc
How Do You Feel About the Economy? – Interactive Feature – NYTimes.comEnter the word that best describes your current mood. You can submit a response once a day.

Embedly Powered

Adjunct ProjectThe Project The Adjunct Project exists for the growing number of graduate degree holders who are unemployed and underemployed. Many of these highly educated and passionate people are being forced to take jobs dramatically below their achievement and earning potential.

Embedly Powered

The Scrapbook – POPS Report: Tell Us About New York City’s Privately-Owned Public SpacesListen: Project Intro from October 19th // Listen: Wrap-Up from November 9th // WNYC’s Brian Leher Show and The New York World are collaborating on a project to map and report on New York City’s Privately-Owned Public Spaces, aka POPS. We want to figure out how public these public spaces really are.

Embedly Powered

via Wnyc

What media can learn from swarming activities

The old saying, “if you build it they will come” doesn’t apply to participation in the same way it can sometimes work for information and entertainment.

However, active participation is possible and potentially very meaningful when the conditions for swarming exist.  If bidirectionality is the way forward for media then it seems to me that great success lies ahead if editors and advertisers can evolve their models to fuel swarming projects.

The business of publishing online has come a long way since the early days of broadcast web sites and banner ads, though the high impact story or campaign is still very elusive on the Internet.

News operations are tackling this problem by adopting cultures of participation, and brands are getting wiser to the power of direct relationships with people.

John Battelle has been exploring this trend brands are making and even goes as far as stating that “all brands are publishers“:

“Dictating a message to your audience is no longer acceptable. Consumers online expect dialogue, so pairing your brand with relevant and passion-driven topics is one of the best ways to ensure that you are engaged with key audiences.”

Now, publishing and having conversations is much better than interrupting people, but this strategy can easily become broadcast disguised as conversation if you’re not careful.

Even worse, that strategy can reinforce the dependency on the major network firehoses where people spend their time online and create a layer of context between the individual and the source instead of the direct and meaningful relationship both publishers and advertisers want to have with people.

There is another way, a better way for everyone involved.

Swarm intelligence is about simple beings following simple rules, each one acting on local information.  National Geographic published an influential feature in 2007 talking about how the swarm tactics of ants and bees have inspired new transport systems and even military tactics.

“Decentralized control, response to local cues, simple rules of thumb—add up to a shrewd strategy to cope with complexity.”

The mathematical challenges inherent in this type of world view are considerable, which, of course, makes swarm intelligence projects very alluring for most alpha geeks.

Author John Robb described how this swarming approach has fueled a new kind of protest movement, recently demonstrated by the Occupy demonstrations.  He says, “Open source protest is an organizational technique.”

It’s made up of a few key ingredients, described here by mathematics professor Lee Worden(*):

  • Plausible promise: An simple goal that people can get behind, that you can believably offer
  • Open invitation: you don’t have to agree on everything, just on what we are doing
  • Many leaders: let everyone innovate, do multiple things at once. Support anyone in a leadership role that either a) grows the movement or b) advances the movement closer to its goal. Oppose (ignore) anybody that proposes a larger, more complex agenda or those that claim ownership over the movement.
  • Open source: If a new technique works, document it, use it again, and share it with everyone else. Copy everything that works.
  • Spread the word of the movement as widely as possible.

It’s the antithesis of the Baby Boomer protest model which was about a collective barricade, a massive force of immovable inertia.

The open source protest conditions are not exclusive to a protest.  They are natural tendencies that draw on human emotion and our sense of purpose.  We want to belong to something and to participate in that thing, even if it’s just a small role in the overall goal.

This is precisely where media and marketing brands need to focus now.

How do you either initiate or participate in meangingful swarming activity?

We all know now that collaboration in and of itself is not interesting as an objective.  But when a project does have a purpose collaborating with people from around the world who have varying views and levels of expertise can be absolutely thrilling.  Ask anyone who contributes substantially to an open source project of any shape or size.

Just like open source protests or open source software development, swarming media activities tend to share the same principles and include the same ingredients – a widely understood purpose, simple little participatory actions that feed into the whole, a high level of openness in the system, authoritative advocates and demonstrable leadership among them at least on a part-time basis, repeatability when successes appear and efficient ways to share learnings, and strong signals to participate spreading far and wide.

There can be big successes with swarming activities in a more task-like point solution approach.  It’s the viral marketing equivilent of breaking the Billboard Top 10 list.  We experienced this in dramatic fashion at the Guardian with the MPs Expenses scandal.

Creating a more long term and sustainable solution for swarming activities that modify themselves, adjust over time, and fluctuate in intensity is a bit more complicated.

I would have trouble believing that either Jimmy Wales or Jack Dorsey had an explicit plan for turning their swarming engines into global phenomenons.  They had a lot of help and a bit of luck along the way.  That said, you can be sure they both intuitively understood the open source model and how to both lead and get out of the way at the right time.

I suspect many alpha geeks, as Tim O’Reilly calls them, will continue to find success working on various approaches to swarming tools and technologies over the next few years.  Media organizations would be wise to think more broadly about swarming strategies and specifically about how to use these techniques in the news agenda and in branding campaigns.

It would be presumptuous to say we have an answer with the n0tice platform, but its undeniably capable of serving this function for customers who want to use it for swarming projects.

For example, look at the recently launched Best Bookshops project on the Guardian which is sponsored by National Book Tokens.

Both the Guardian editors and National Book Tokens are clever to imagine an activity that encourages people to reacquaint themselves with their local bookshops.  It’s an interesting editorial proposition and a brilliantly selfless brand campaign that encourages people to do something good for themselves and local business.

They are clever to approach that campaign in a way that will fuel a collective interest in spending time at local bookshops through a swarming exercise rather than trying to push the idea on people.

It’s also interesting how many different constituents are involved in this idea.  In addition to Guardian editors and the advertiser, National Book Tokens, bookshops across the UK are collectively posting events on the Bookshops noticeboard, and people are encouraged to post photos of their experiences at their local bookshops.

There’s a shared experience at the local level that feeds a larger context with an understood purpose: local bookshops matter.  To reinforce this larger purpose the campaign offers a unified view of the swarming activity presented as a map residing on the Guardian web site.  It will continue to live there indefinitely.

Everybody wins here.  People become reacquainted with their local bookshops.  Bookshops build better ties with their community.  National Book Tokens strengthens its brand and its role with bookshops and book shoppers.  The Guardian earns money from the sponsorship and provides a great service to its readers.  And n0tice builds a stronger user base across the n0tice network.

It’s a classic case of generative media in action.

The swarming media concept may need adjusting a few times before people get it right.  But the Internet is ideally suited for it.

Sometimes I wonder, actually, is it possible that swarming activities are THE network-native format for successful campaigns?  It’s early days still, but the opportunity seems absolutely massive.

Generating value at the edge with the n0tice platform

I used to spend a lot of time on the San Francisco – Sunnyvale Caltrain route.  Though my wife remembers that I complained a lot about how much time it took, I mostly only recall the enjoyable time spent blogging, listening to new podcasts and thinking hard about where the Internet was heading.

One of the themes I would keep coming back to over and over was inspired by John Hagel and John Seely Brown talking about motorcycle manufacturing in China.  It’s the idea that networks of activity can form a better whole when the nodes or the edges in the network can operate with autonomy and authority – fueled by a collective purpose rather than answering to an imposed one.  Hagel and Seely Brown call it Edge Economics.

The concepts stuck with me, and I began to value different kinds of projects happening out there across the Internet.  While it didn’t take off the way many hoped, Outside.in, for example, was groundbreaking in its ideas.  It was part of a movement toward generative media and the idea of media as a platform.

At about the same time the photosharing revolution was in full swing.  Admittedly, the Flickr concept didn’t really capture me until after the Yahoo! acquisition, and even then it wasn’t real to me until I got a phone that could publish images instantly to Flickr (the Nokia 6630, to be exact).

One of those ah-hah moments hit me after the train I was on smashed a truck at a crossing, and I captured a photo of the surprising damage done to the train.  The truck was a mile behind us by the time we actually stopped and evacuated the scene.  The driver was fine, apparently.

I was very eager to get that photo out there knowing that the Caltrain commute was going to be awful for everyone in both directions that morning.  But at that time there was no way to spread information about the incident and the photo evidence to anyone in the area unless they were already my friends.

Now, there are many twists and turns in the story of the Internet since then that have altered the way I value projects happening in both startups and elsewhere.  But the principles of empowering people and organizations at the edges, linking media platforms to activities happening at those edges, and fueling collective behaviors through useful actions have been constant, at least in my mind.

The Guardian has given me some room to explore these old ideas with some new concepts that are important to the future of journalism and the news business.  And as of this week we now have the seeds of a potentially very interesting approach to citizen journalism in the form of an open platform called n0tice.

There are 3 elements of the service, a web site for users at n0tice.com, a set of tools for partners at n0tice.org, and now finally a n0tice iPhone app that lets you see and post what’s happening near you wherever you are right now.

This idea is not new.  It’s pretty old, actually.  It is basically just an evolution of the public noticeboard or shared bulletin board.  Email tackled this idea with mailing lists back in the ’80’s.  The web made it possible for open directories to do the same.  And now that the social, local and mobile worlds have collided it is happening once again.

But rather than try to centralize the entire networked universe on a single platform to rule them all, we’ve worked very hard to put the power of this idea into people’s hands in ways that helps them in what they already do out there today using tools that they already know.

n0tice can be used as a completely invisible partner through our APIs.  There are a few ways that n0tice can be used as an open and public complement to a WordPress site, for example.  Equally, the n0tice user experience can be bent and shaped for a customer’s specific needs through the use of self-serve white label noticeboards.  People can create their own branded version of n0tice which comes free with web analytics, moderation tools, and a few sharing and viral features for getting traction quickly.

Crucially, we try to create value in the network edges by helping people make money when they spend time making n0tice work for them.  Everyone understands the classifieds model, and we’ve iterated on that idea as one of the many value engines that the n0tice platform offers.

There is still a very long way to go to realize the potential in this kind of platform, and it won’t be without challenges.  For example, we’re very aware that n0tice could be perceived as yet-another-social-media-site if we fail to demonstrate how it can be an engine for healthy community activities.  Also, the n0tice team is very small still, and if we fail to evolve the product as fast as the core users want we could lose their enthusiasm and, worse, their trust and loyalty.  Early users of the service have been unusually supportive of the effort, so far.

What we’ve accomplished so far has been really really fun and interesting to do.  We hope other people see the value in the project and help us expand the scope further and in directions we haven’t yet considered.  I think success at this stage would mean that, in order, 1) a wide range of partners use the API for a wide range of concepts, 2) the iPhone app gets some decent uptake and a healthy percentage of users are on it daily, and 3) the noticeboards on n0tice.com become active public spaces where groups are collaborating.

If any one of those things happen then we’ll be growing a generative media platform, a space where many people are benefitting from the presence and actions of the others in the network.

Now that all 3 services are live and public – n0tice.com, n0tice.org and the n0tice iPhone app – it feels like we’re already somewhere along that journey.

I have to say it… I love it when a plan comes together.

 

Not saying ‘no’ is far from committing to ‘yes’

I had the good fortune of attending the Paley Center’s International Council in Madrid: “News at the Speed of Life: A Global Conversation on the Reinvention of Journalism

There were some very interesting themes on where journalism is heading including views from Facebook, Google, BBC, El Pais, Zeit Online, Hearst and some groundbreaking new services like Ushahidi and Newscred.

While the diversity of approaches seemed very healthy I was struck by an apparent divide between those who view technology as a threat to journalism vs those who see it as integral to its evolution.

Some, such as the Economist, have taken the view that platforms like the iPad may finally give them the digital positioning they’ve struggled to capture, a concession that nothing else digital has yet worked as well as print has for them in the past.

While others, such as Brazil’s Abril and Digital First Media, are seeking new ways to embrace all digital platforms and create new opportunities for themselves for the future.

In other words, technology is happening TO some media companies while others are making it work FOR them.

The danger in the victimized view is that the market will eventually erode every advantage your brand has achieved over many years. New startups will replace things your core business once benefitted from doing internally, and capabilities in the dominant technology platforms will squeeze out things you’ve always done your way by offering another, perhaps even more relevant version of the same.

Andrew Rashbass’ refreshingly humble perspective from the Economist is admirable, in many ways. In true British style he sarcastically noted that their failure in the past was not inventing the iPad. That’s not something any news org would’ve had the talent or resources to do.

Equally, I couldn’t help but think that the failure to try to think big even if it amounts to preposterous ideas is precisely why many traditional journalism outfits are struggling to make digital businesses really sing.

Success is not about developing a sustainability strategy. Reducing or offsetting the rate of decline is really more of a job protection plan. The best offense may be great defense, but you still have to score.

Actually being successful is about creating a meaningful business, a relevant business, one that makes money as a natural outcome of its value to people in their lives.

Given how dramatically technology is affecting the relationship people have with information and how important information is becoming in our lives, you can’t afford to play wait and see.

It’s not enough to not say ‘no’ to change.

Fueling new ways of approaching everything about the way journalism works and the business of media itself has to be a core competency at the very least. Otherwise, market forces will continue to happen TO you until you have nothing left but an ageing mission statement that you can’t execute.

Dedicated to being adaptive

The last 9 months we used n0tice to put into practice some of the things that I’ve learned the last decade or so about development and some of the things that I always wanted to try but didn’t have the chance.

Anyone who has ever worked in a startup will recognize most of what I describe here, but I think the way the n0tice team operates also has some lessons for larger projects happening in larger groups, as well.

The n0tice team is made up of 1 lead developer (Daniel Levitt) who drives the web site and most of the new concepts, 1 community strategist (Sarah Hartley) who sets the tone and spends time working face-to-face with customers, 1 infrastructure man (Tony McCrae) who not only handles plumbing but also builds services like the API, a mobile development pair (more on them later) who are designing and writing the iOS app, an apprentice (Andre Moses) supporting our social media efforts, and a host of volunteers, occasional contract help, and a cast of supporters who help us out along the way when they can (or when we ask).

Almost everyone has a hand in at least one other major project in addition to n0tice.

We chat most mornings at 11am for about 30 minutes, not always. None of us sit together physically. We try to work together in the same space every two weeks for an afternoon, not always. There are no other meetings.

We decide what to build as individuals, though everyone shares what they’re doing so we can talk about the work and feed ideas to each other.

I like the principles of agile development, but I’ve never found it great at handling multidisciplinary activity, particularly when you are dependent on the talents of the people around you as opposed to the timeline or milestones.

So, as a result, we just let everyone work at their own pace, doing what they can do when they can do it, united on a direction of travel.

We choose release dates based on when something is ready or when it might make sense for co-dependencies to join up. In some cases, a date is a codependency, but generally we care more about what is built rather than when it’s built.

Everyone uses their favorite tools to build whatever they are building. That means we’re running multiple programming languages, but you don’t have to trade simplicity for creativity if you can loosely join separate systems through a service-like approach…even with a relatively small stack like the n0tice stack. It seems to actually make scalability easier, too.

I’m as guilty as the next person who cares about their work of micromanaging, but I think I’ve solved that problem for myself and the team and the effort by attracting individuals who are not just talented but also very very creative. We can therefore deflect any tendencies I may have to define solutions to things because we all know that I could never have a better solution to a problem than the person responsible for the problem.

They force me to stay focused on where we’re going rather than how we’re getting there.

We pay close attention to what our users say. We setup a Google Group early in the process and invited people to say whatever they want. And they do. We also spent time face-to-face with many of the beta users to ask their opinions of changes before we completed them. We know what we want to do, but we take care to marry our ideas with their desires.

The whole effort is guided by a few principles that everyone on the team can interpret individually.

Everything ultimately serves the vision: “what’s happening near you.” Observe constantly and respond quickly. Think in a network native way. Technologies and tools are there to empower people, not the other way around.

We certainly benefit from being close to the Guardian, too.

We have internal advisors looking over our shoulders like Guardian platform architect Graham Tackley, and we get bursts of insight from UX specialists like Martin Belam and Alastair Jardine. We can test ideas out on the Guardian editors, mobile teams and ad sales teams. We also get informal advice from some of the Guardian executives and some very insightful external advisors who check that we’re not being stupid.

Now, all of this is less of a method and more like a state of play.

We can be sure that the next 12 months will change around us and that users will change what n0tice means. But we’ve taken great care to make adaptation a core competency so that the core factors that got us to where we are now continue to help us do well.

That’s a principle inherent in the medium itself.  The Internet is a messy, ever-changing, human-powered, technically and creatively diverse platform that means different things to different people.  In my view, succeeding online means aligning what you’re doing with how the Internet works and the characteristics that make it meaningful and interesting and important in the world.

It feels like we’re on that journey with n0tice, so far.

Of course, all of this is a recipe for building stuff.  What we haven’t yet proven is whether or not what we’re building fully captures people’s imaginations and becomes important in their communities.

Hopefully, I’ll have a blog post like this in about 6 or 9 months time describing an approach for successfully empowering healthy community activity, too.

Start noticing everything again

Today we are removing the invite-only door on n0tice.com and opening up for the world to join us. The announcement details are posted on the n0tice blog here. But I’ll use this space to share some of the thinking behind what we’re doing.

There’s a really interesting film from the mid-90’s called Smoke. Harvey Keitel plays a shopkeeper who takes a picture of the street from his shop every day for several years.

Looking at his pictures it seems that nothing changes in some ways, but the little details that do change begin to surface. It turns out that the characters that pass through his shop are loosely connected and that their personal stories actually impact each other profoundly.

It’s a great reminder to look around and to be part of what’s happening right in front of us, something that is increasingly difficult when the network follows us everywhere we go – it’s always with us right in our pockets.

While the temptation to escape reality and spend more time in digital land is increasingly challenging, the network can unify and amplify things in meaningful ways when the digital and physical worlds come together for a purpose.

The catalysts for this symbiotic effect include things like festivals, protests, art, sports, debates, gatherings, etc. All of these things can be planned, promoted and chronicled digitally while the real experiences are shared with real people in real places physically.

The digital and physical experiences reinforce each other and make a stronger experience possible together than either the digital or physical experience operating without the other.

Can you imagine a protest without twitter or youtube today?
Mobile phone cameras capture protest moments - #Jan25 Egypt Revolution
Photo By sierragoddess

With headphones on and eyes locked to a screen we are missing both the beauty and the danger that coexist around us. But perhaps by unifying the things happening around us with the power of the network our lives will be more meaningful, not less.

And maybe as a result we will become more interested in participating in what’s happening around us with more commitment and enthusiasm, too.

It’s this idea and many other inspirations that set the stage for us to build n0tice:

We applied some ideas from a fun little game developed by Tom Taylor and Tom Armitage called noticings – a game about learning to look at the world around you. It was also inspired by aspects of the street art movement – an attempt to wake people up, and an attempt to have conversations in, about and because of public spaces.

Of course, we’ve learned a lot from Twitter, Foursquare and many other successful platforms, too. We’ve witnessed incredible innovation over the last 3 years or so, and n0tice is benefitting from those advances. We are standing on the shoulders of giants.

But we’re also hopeful that n0tice can play an important new role in your world, helping you to become part of your surroundings.

Take a moment every day to notice what’s happening near you. Look closer. Listen carefully. Get to know the stories that you didn’t notice before.

Help others notice what’s happening nearby, too. Post photos. Report what you notice.

If there’s one thing we hope n0tice can do it’s that it may encourage us to be better participants and keen observers in the world.  By using the power of the digital network to amplify what’s important and interesting in the world around us perhaps the concept of a community will be more meaningful to everyone.

Why we’re supporting the SOPA protest

The n0tice team decided that we should join the SOPA protest.  We’ll be self-censoring the web site on January 18 and blocking our own users from participating.

The full explanation of why we are participating is on the n0tice blog, but here are a few of the excerpts:

We believe the role of law and politics in an open environment like the Internet should not be to create weapons for fighting bad behavior but rather to set boundaries and to mediate acceptable behavior.

Capitalism is an adaptive system, and the TV and music industries will find other ways, perhaps better ways to make money and fund creative works.  There are many models and success stories appearing everywhere including within their own businesses that will help them transition to more network-friendly, digitally sophisticated business models.

They don’t need and shouldn’t have the power to take down an entire web site because of a copyright claim.

Inasmuch as the initial concept for these bills questioned the state of protections for people and businesses on open networks, we are in agreement. We want laws that protect people from harm. We want politicians to raise awareness of threats to civility.

The solution to those problems, as we see it, is about supporting open spaces, protecting open spaces and collectively reinforcing positive behaviors.

I don’t consider myself a very political person.  I take a lot of time to decide what I think about stuff, and I find it difficult seeing any issue through totally black and white lenses.

But I’m conscious that the Internet is going through some difficult growing pains right now, and this issue may reinforce a way of thinking that threatens the founding principles that have made the Internet such a positive force in the world.

Of course, there’s no doubt that the team agreed to support this protest out of self-interest.  The bills are a direct threat to what n0tice and the many services like us are all about.

Plus, sometimes taking sides has other effects.  It’s character-building for a startup like n0tice.  It helps us and our users to understand what our brand means, what really matters to us, who we want to associate with, and why we’re here.

We all felt that this is one of those moments when we could do something very small to help with something very big.  I can’t imagine a better way to frame the n0tice culture.

Rolling out n0tice

It wasn’t until we stumbled onto the name n0tice.com that I started paying closer attention to noticeboards.

You probably see them around you, too, now and again, and you probably read 1 or 2 things that catch your eye.  But you probably don’t think much about them.

It’s because you don’t have to.  They just work.  Like magic.  Everyone just knows what they’re for and how to use them.

In the 1980’s and 90’s the dial-up online bulletin board systems or BBS’s made the noticeboard concept come alive in the digital space based on what technology was available at the time.  Email enabled mailing lists that acted like noticeboards.  And, of course, the web and Netscape made browsable noticeboards possible in digital space, such as Craigslist.
But few models for community noticeboards have taken off in a social-local-mobile world, so far.

Now, I don’t count Facebook because I don’t think most people in a local community know each other well enough personally to connect on Facebook, nor do they intend to.  Location can be a great starting point for social activity in ways that your known contacts can’t provide.

We may or may not have the answer to the new digital noticeboard with n0tice, but I think we’ve made something pretty fun in that space.

The past month we’ve been inviting people to join us on the platform, as we release new features and experiment with this theme.

The release today is a big one for us.  We’ve added the ability to create your own n0ticeboard.

You can customize branding, look and feel, and subdomain.  We’ll also give you options to customize the content using some filters like following people, tags and locations, though that feature is still being developed.  The read API (RSS/JSON) will be exposed soon, too.

What started as a hack day project became a prototype which was rebuilt as a real community platform that you can see today.

We’re keeping it somewhat limited to invite-only access still or ‘Private Beta’ status.

Two people have been intimately involved in launching n0tice – Daniel Levitt and Sarah Hartley.  Daniel has worked with the Guardian’s Open Platform in the past developing both the Recipe Search and the WordPress Plugin.  Sarah is an experienced community strategist having launched the Guardian Local project and several other hyperlocal initiatives over the years.

We’ve also benefitted from the contributions of several others such as Tony McCrae who setup the backend systems, Andrew Travers who tightened the user experience, the prototype testers notably Nigel Barlow and Will Perrin, and the members of the n0tice Google Group who share their ideas with us.

These people have all shaped it into something very powerful.  In many ways they’ve created a new kind of social platform, or a really really old one reinvented for the new world.

If we can make citizen journalism possible in more contexts for more communities then I think we will have done a good thing.  If we can also make citizen journalism a financially sustainable activity then we will have done a great thing.

As we go along we are increasingly unsure of what happens next.  Participants are starting to determine what we do more and more.  So, if you want this platform to do something, please get in early and share your thoughts with us.