WilbertWelcome on my blog, it's my personal space about things I like, projects I do and thoughts I share. Feel free to comment, I enjoy reading your ideas and opinion.

You can also find me blogging at the electronic music blog eclectro.nl and journalism blog onlinejournalismblog.com.

Wilbert (more & contact)

Recent Comments

Nic Nice article. Discussion here : http://www.fubiz.net/blog...
Wilbert Did you make sure to use the right embed tags? You have to a...
Bran I use flash and dreamweaver, I have tried fiddling about wit...
Wilbert @Alex, thanks for the overview, nice link....
Wilbert @Inge True, a human (editor, friends) selection is special a...
Alexis Brion Hi Wilbert, I like your article a lot. It's interesting to m...
Inge I think Google News does the basics of this already in their...

Thoughts about a news algorithm

Hi, hypernarrative is a blog by Wilbert Baan about Art, Media and Technology with a focus on interactive storytelling. If you're new here, you may want to subscribe to my RSS feed with Google or Netvibes. I'll post a few messages a week. Thanks for visiting!

Amazon Recommendation system based on your personal profile
Last week I was reading a Wired article (March edition) about how the video rental service Netflix is awarding $1.000.000 to the person or group who can improve its recommendation algorithm by 10%.

Todays popular websites use smart algorithms to determine what we want or might like. Google is famous for its mix and so is the Amazon recommendation system. Your actions tell these systems about your behavior. And your actions make these services better in recommending you information. For example Google tracks what results people click. If most users click the second search result they make this the first result.

I love news selection
I really like how news websites, blogs and other person driven websites make a selection. Most often this works best if there is a sharp focus. A popular blog can’t be about everything. It has to be about a person or a subject to keep the blog interesting.

In the future this fragmentation might be happening to news websites as well. The traditional newspaper told you everything. It was your primary source of information. With websites we see a different pattern. People don’t just read one news website, they read many. They might have a favorite, but it is no such thing as exclusive readership. Will we see focus in newspaper websites as well? Although media operates independent it is almost always marked as ‘left’ or ‘right’ by the type of stories they focus on.

The news algorithm
Why wouldn’t news sorting be captured in algorithms? There is nothing that makes this impossible. Stories are written as closed interchangeable containers. News websites might make a selection on the frontpage, they also provide lists and rss-feeds where they sort the same information on time or popularity.

Journalists have multiple tasks, they create stories and they sort them on relevance. Maybe with this sorting we can experiment and create a more personal version as well?

Sorting news by machines
Sorting news is not just making a selection on popularity. Sorting news by systems is difficult. The presentation of what you like consists out a complex set of variables.

  • What do you like (personal interest)
  • What you might like (if you like a subject you might like to read about)
  • What do you need to know (because it is important to you, and it will dominate the media landscape for a while)
  • What everyone needs to know (breaking news)
  • What do you officially don’t like, but occasionally read (the stories everyone says they don’t read but always seem to get the highest click-through rates)
  • What do your friends (colleagues) read (news creates conversation and small-talk)
  • What do your friends recommend (you trust your network)
  • What you don’t want to know (things that really bore you and are irrelevant in any way)
  • Where do you like to know more about (if you are an expert in something you don’t want another article that explains it all again. You would prefer analysis and background articles)
  • What is your (current) location (for large groups of people location based information has extra value)
  • Surprises (they change your interests and habbits)

* If I forgot something please ad your thoughts in the comments

These are the variables that construct personal relevance of a news website. It’s a complex set, but if you can manage a good balance you are able to create a website that sorts news by personal relevance on another level than we are used to.

I don’t know if an algorithm can create a better news experience and what it should look like. I do think there is value in tracking and learning form your users behavior and return new or additional value to the reader.

Update: Concept Design

What this could look like and how you can keep this simple for the reader. The text is in Dutch. The screens ask for your location, favorite topics, company you work or would like to work and friends.

Relevancy? The first experience sucks

What your friends are reading (LinkedIn)
At the Next Web conference there was an overall urge for relevancy. You noticed it in presentations and startups. Unfortunately there weren’t many speakers that had exiting answers. In his presentation Robert Scoble made clear that for most new web applications ‘The first experience sucks‘.

Why?
This is inherent to how these new web applications work. The webservices that are doing something new are often ‘connected‘ applications. Websites and widgets connect information and people resulting in a new collections and new relevancy. This relevancy will only show itself when using the service for a while. Which is - of course - difficult to explain to a user when he or she signs up.

This is a user experience problem, but not one we will not find a solution for. The friendfinder button in most new web services enables you to import your Gmail contacts or another social network. Most applications are doing something similar to a service that already exists, with the open web (API’s and feeds) technology should be able to suggest a personal social profile before you start.

When information gets fragmented
What’s more interesting about this is what this search for relevancy really means. The web was always used similar to previous media. We made pages and domains on the web. Information was reserved for one place and relevancy was made by the website editor. This can be a news website or a blog.

Now the web is evolving in something that goes beyond what we are used to. Everything gets fragmented, distributed and aggregated. Information (text, photos and video) transfer from one online place to another. Information gets distributed and duplicated. The collection made by the creator is getting less relevant.

The distributed future of this blog post
For example this blog post is distributed through RSS and it will be picked up by a dozen of spam blog that will all duplicate the entire text and distribute it again. All these blogs are indexed over and over by aggregators like Google or any other. This blog post is written in the context of my blog, but most people will probably read it in another context. Specialized companies trace discussions about brands on the web and redistribute relevant articles. Social networks are crawling the web to show articles that are personal relevant to your profile (LinkedIn).

Data is made to be duplicated
The incredible amount of fragmented information is what makes the web interesting. New social recommendation tools, networks, online friends, aggregators, feeds and widgets are breaking the web apart. This is what makes the web really exiting and work like a network.

This is difficult to understand and use by publishers, copyright lawyers and designers but more relevant for the user. The reader doesn’t care what blog or website presents a good article or where they read it, as long as they can read it. The most important value is the relevancy of the presenter, this can be a system or your friend.

The news article as an object

Meta information and tags
Since we started with the concept of EN we had a certain idea of what it would be like. Now we have the first working version the possibilities seem endless, but what is the killer application or function? What is it that gives new options to the things we do with news?

In this post I’m just thinking out loud and writing down some thoughts. Please share your ideas or fallacies you see in my thoughts.

In News presentation we see the article as an article. It’s a finished story. On a news website, newspaper or television broadcasts we present a collection articles and items. These articles are also objects. Finished stories presenting a near live experience, but not live.

For the presentation and sorting of these objects news media are using a few options.
1. We show it by editorial selection (the far most popular by newspapers, television and news websites).
2. We show it sorted on time (often combined with the first)
3. We show the article list sorted on popularity (often somewhere on an extra page or column)

This works very well. We are used to see a pre-selection made from all the information and from this selection we choose the things we like. News reading is scanning through a pre-selection made by editors.

But the object (article) itself has a very interesting set of meta-information. This is what we potentially know about, and can extract from an article on EN.nl.

Tags, time published, pageviews, updates, incoming links, comments, votes (1-4), urgency levels (1-3), edits, editors, editors popularity, dateline (geocoordinates), related articles, favorites, pictures, videos, hyperlinks

This is information we know about each article. It is metadata connected to the object. What can we do with this information? Obviously presenting the news is critical for a news website, but the added value is in the selection made by editors. Why do these selections work so well? A selection by editors is based on the values of the presenter (newspaper) and often focus extra on certain aspects of the news. Left, right, popular, politics, celebrity, sports, art…

Most news media present the same facts. Is it the hierarchy and presentation that really counts? Is it what you show or don’t show that adds value? Is it what you’re friends read and what you can talk about with them? Do you go to certain websites for coverage about certain items? Are it the extra stories that add value? Are it writing skills? Is it the fast coverage?

Adding relevancy and new value
How can we make the selection and the sorting of objects (articles) more relevant to your needs? Should we ask you what you like? Should we track what you read? Should we ask you social profile? Should we ask your social network? Should we do things with your location? Should we read the tagging you did on your blog, del.ico.us, flickr and youtube and use this to determine what you like? Should we make your music taste count, the weather or how you feel today?

I think news is social by itself. We want to be able to talk about it with friends. Serious news, but also weird or funny news, sports and celebrities. Every real-life social network connects to certain news media. Your friends are often reading the same newspaper or same websites.

Would you be interested in what news your social network reads? Or your favorite bloggers? If you look at articles as if they are objects with metadata you can think up a lot of new ideas and possibilities. But what does really add extra and new value to presenting the news?

Reinventing the News Website


EN.nl (and.nl) is a new project where we are experimenting with new media, users, technology and journalism. This project is an open project where the public process plays an extremely valuable part in designing and shaping the news website.

The online news industry really changed over the last years. I think we’re at a point where every self respecting news organization takes the web as a serious medium that requires a different approach then previous media (newspaper, television, radio).

Some see these new possibilities as a threat and try to protect what they have. Which is I think the worst possible strategy (looking backwards into the future). Others see chances, new competitors, new technology, new journalism, new markets and new ideas.

I love a quote I heard in an interview with someone at the Washington Post. He said his ambition is to be the new CNN. With new media and technology this ambition is realistic. A company like the Washington Post (newspaper) can see CNN (television) as its competitor.

Google / AP
Google can be a news service. Why wouldn’t they? They have the database of intentions, Google knows what people are searching for and they can - like any other company - subscribe to press services. The value of press agency news is devaluating in a way that it often ends up in duplicate copies with a different lay-out. Try to search for an AP article headline. I’m sure you will find a dozen versions of it, all exactly the same.

Online news is moving to something where added value counts. What can you add to the news (omnipresent). Is it a personal or political view? Is it the selection you make? Is it a community? Are it your reporters or journalists? What is your added value?

In technology communities, collaboration tools and social networks are redefining most services and institutions. Why shouldn’t services and technology like this redefine how we consume news?

This is what EN.nl is about. We want to experiment with everything around news from a practical point of view, let’s make things.

Wisdom of Crowds
The Wisdom of Crowds believes a group is smarter than the individual. The Wisdom of a crowd can be very valuable for news. In the public opinion the idea of a wiki collides with news. I think a wiki-based system can work for news if you make sure the process is transparent and everyone can join the discussion.

Sure you will have to deal with vandalism, this a technical problem to solve. A reader doesn’t have to be an expert on everything, the valuable wisdom of an individual can be something he has read or seen somewhere else. The Wisdom of a crowd is about all the knowledge, not just the expert knowledge. The biggest challenge is get the knowledge and use it as a contribution.

Traditional media floats on the wisdom of a few wise people who create value by the choices they make. Social media uses the wisdom of your network en wiki media taps into the wisdom of a crowd. All have advantages and disadvantages.

The design
For the design of this new website we also experiment. The most important object is the database, we designed the database from a view that almost everything is possible with the data. We store a lot of information that might be valuable in the future. This allows us to experiment freely with the design and think up new features. The database is the most valuable asset of a news organization.

The newsriver navigation
Newsriver concept
The newsriver is a principle that regards news as a continues flow of information, where you can hook in whenever you want (An RSS feed). For the first version of EN we are experimenting with this idea in the navigation. I don’t know if this is it, it’s different from the navigation we are used to.

En.nl article newsriver concept

What we can do?
Almost everything. We can make mash-ups, feeds, aggregated pages (screenshot draft design below). Hook in to social networks, extend the wiki functionality, and more. Technically everything is possible.

What does the news site of the future look like? Join the debate and discussion here or in Dutch at http://ontwikkelen.ning.com.

Draft theme page

Interactive storytelling experiment #2: The urban areas of tomorrow

We live in Cities

Last week I did an experiment with a linear story and loading photos from Flickr. This week I made a second experiment using the same code and adding a map. I will try to tell a second story.

About the story
This story is about how fast urban areas are growing. These growing areas aren’t in the west. Of the 100 fastest growing urban areas only two are located in what we call the western world.

In an era where our lives get globally connected through similar culture, mass production and consumption these emerging areas will play a very important role in the near feature.

I’ll try to tell this in a short linear story with the latest photos loaded from Flickr and a map that shows the lights of the world. I love that map.

Try it yourself http://www.wilbertbaan.nl/flickrcities/

“UN figures for urbanisation, published this week in the State of the World 2007 report, show that more than 60 million people - roughly the population of the UK - are added to the planet’s cities and suburbs each year, mostly in low-income urban settlements in developing countries. Unplanned urbanisation is taking a huge toll on human health and the quality of the environment, contributing to social, ecological, and economic instability in many countries.”

Guardian January 17th 2007

Difficult
The most difficult part in making this animation is to actually tell a complex story in slides. I want to make something that will make you think about things for a while. The previous Flickr project was easy because you didn’t have to pay much attention. It was a collection of things. This one is more a story making it more difficult to make an impression.

Storytelling tips
The most important thing in interactive storytelling is probably to kill your darlings and only use effects, technology and interactivity if you think it will benefit to the story you want to tell.

Make sure to write out what you want to say. It doesn’t have to be final, but it gives you an idea of what you want to do.

Focus on what you want to say. Focus on the impression your story will have.

We live in Cities

We live in Cities

Thank You

All data used in the animation is from this list. Hypernarrative won’t be updated until the first week of March.

Share your best tips and tricks to tell an interactive story? How can I make this better?

Storytelling with the Flickr API

Flickr API test tag art

Today I experimented with the Flicrk API. An API is an external programmable interface that connects to a database, it allows external developers to access the content in the database. In this case I can access the photos on Flickr by using a free license (API-key).

2.269.526.982 photos
Everyday millions of photos are uploaded to Flickr. While writing this post 4.871 pictures are uploaded every minute and the total of photos uploaded to Flickr is 2.269.526.982. Most of these photos are tagged with meta information, like a title, description, user generated tags and device generated (shutter speed, type of camera, coordinates). That’s a lot of information.

Slideshow experiment
For this first experiment I use thirteen slides to tell something general about myself. Every slide loads the most recent images from the Flickr database based on a tag that corresponds to the slide.

The slideshow plays by itself and has no interaction, it’s linear, but not static. Every time you play the slideshow the content can be different, the story won’t.

www.wilbertbaan.nl/flickrapi/

How would you combine live data feeds with storytelling?

Flickr API test tag music

There is more, go the next page