Home Create Watch Help News Mobile Login

SXSW2009 - The Wisdom of Crowds

  • Elements of wise crowds: Diversity, Independence, Decentralization, Aggregation
    by thody at 3/15/2009 4:39:55 PM
  • Small Simple Tasks: example - Hot or Not?
    by thody at 3/15/2009 4:40:29 PM
  • Blank comment form = petrie dish. Without guidance you get mold
    by thody at 3/15/2009 4:41:38 PM
  • Large Diverse Groups: Important because they prevent group think (priorities of the group ahead of individuals)
    by thody at 3/15/2009 4:44:13 PM
  • Design systems to encourage participation
    by thody at 3/15/2009 4:44:26 PM
  • Lower barriers of entry to get more voices
    by thody at 3/15/2009 4:44:49 PM
  • Design for selfishness
    by thody at 3/15/2009 4:46:02 PM
  • Large groups of people don't participate in your "happy thing" unless they're getting something out of it.
    by thody at 3/15/2009 4:46:44 PM
  • Users ask "Is this worth my time?"
    by thody at 3/15/2009 4:47:15 PM
  • There are also indirect examples. Google's page rank algorithm is a wisdom of crowds algorithm - #sxsw
    by rosskimbarovsky via twitter at 3/15/2009 4:48:59 PM
  • #sxsw #crowds Users are always asking "Is this worth my time?" Threadless: Submit an idea for chance at friends, fame and $2500. This works.
    by brontestreet via twitter at 3/15/2009 4:49:02 PM
  • Selfish needs can be harnessed to make something wise.
    by thody at 3/15/2009 4:49:16 PM
  • When I tag my photos in Flickr, I'm not trying to create anything more than a way to find my own photos. Our selfish motivations can become business value is properly harnessed.
    by remarkk at 3/15/2009 4:50:25 PM
  • Result Aggregation: How to take all that noisy stuff and turn it into something smart
    by thody at 3/15/2009 4:50:31 PM
  • Scores create games.
    by thody at 3/15/2009 4:50:56 PM
  • Taking votes, creating lists of winners/losers. Scores create games. How do you take the aggregate and make something useful without turning it into a game.
    by remarkk at 3/15/2009 4:51:15 PM
  • favrd.com aggregates Twitter favorites and shows the top fav'd tweets.
    by AdamSchwabe at 3/15/2009 4:52:16 PM
  • favrd.textism.com Favrd - what the crowd in Twitter voted as favourite tweet. Really funny snippets of text. No public voting mechanism. Not DIGG, just monitor normal behaviour without asking them to vote.
    by remarkk at 3/15/2009 4:52:25 PM
  • The Heisenberg Problem: Scoreboards make the goal to participate to get on the scoreboard, and not necessarily in a positive way.
    by thody at 3/15/2009 4:53:48 PM
  • Once we surface the list to the world, we create a new motivation - to be top on the leaderboard. Flickr "interestingness" created a game, to be #1 on this list. Takes the ranking and created an incentive for bad behaviour: spamming, bugging people to vote/comment. Changed to a random collection of interestingness photos, away from a ranked list, it makes it interesting, useful and less of a game.
    by remarkk at 3/15/2009 4:54:55 PM
  • [Same can be said for Twitter followers – people try to get more followers at whatever the cost and stupid crap comes up like TwitterGrader to encourage it –A]
    by AdamSchwabe at 3/15/2009 4:56:05 PM
  • Popularity does not have to rule.
    by thody at 3/15/2009 4:57:06 PM
  • The most popular thing is often not the best thing.
    by thody at 3/15/2009 4:57:22 PM
  • Explicit feedback vs. implicit feedback. Tons of explicit controls, sliders, buttons, checks.
    by AdamSchwabe at 3/15/2009 5:00:25 PM
  • He just dropped the "It depends" bomb.
    by AdamSchwabe at 3/15/2009 5:00:54 PM
  • Implicit vs. Explicit Feedback: Never use more options than you think you need
    by thody at 3/15/2009 5:01:05 PM
  • Most 5-star rating systems boil down to 2.5/3.5 – thumbs up and thumbs down more discrete choice for users.
    by AdamSchwabe at 3/15/2009 5:01:53 PM
  • Implicit Feedback: Pageviews, Searches, Velocity, Interestingness.
    by AdamSchwabe at 3/15/2009 5:02:35 PM
  • Implicit vs Explicit Feedback. Explicit, like voting/rating widgets. Implicit feedback like monitoring pageviews, searches, velocity (how much is something changing), interestingness (algorithms).
    by remarkk at 3/15/2009 5:02:40 PM
  • explicit feedback: voting and rating. implicit: pageviews, searches, velocity, interesting #sxsw #crowds
    by mapgoblin via twitter at 3/15/2009 5:03:17 PM
  • How you ask questions changes the answers you get.
    by thody at 3/15/2009 5:03:23 PM
  • kvetch.com A complaints department by Powazek (presenter).
    by AdamSchwabe at 3/15/2009 5:04:26 PM
  • Classic. Powazek showing colors to the crowd, asking for emotional reaction. Red: "Anger!" Blue screen goes up, Tom Purves shouts out, "Microsoft!"
    by AdamSchwabe at 3/15/2009 5:06:17 PM
  • brooklynmuseum.org allowed people to rate photos and say 'who' they are: expert, beginner, etc. so photos are curated/displayed, bigger photos are printed larger.
    by AdamSchwabe at 3/15/2009 5:10:42 PM
  • getsatisfaction.com using wisdom of crowds techniques very effectively. "I like that idea" to tally up important issues by company/product. Data is aggregated to show the best post. Aggregated data shown for 'marked best', 'replies made', 'people participating'. Also, 'the mood in here' to aggregate how posters are describing their feeling.
    by AdamSchwabe at 3/15/2009 5:11:31 PM
  • If you take away some of that input, we do the opposite – brains work twice as hard to fill in the blanks to make a story in our head. Our brains are great at taking a lot of feedback and weaving it into a story. This is how we understand the world.
    by AdamSchwabe at 3/15/2009 5:14:53 PM
  • This is relevant online because we're deprived from all input we get in real-life social situations like expressions, emotions, etc. All we have is text to relate to each other. Therefore, brains work twice as hard to fill in that missing data. What we typically fill in those blanks is a by-product of our insecurities.
    by AdamSchwabe at 3/15/2009 5:16:12 PM
  • When you feel out of control, you make up stories that don't have anything to do with what you're being shown.
    by AdamSchwabe at 3/15/2009 5:18:04 PM
  • When communicating online, we miss all the facial and body language cues, so our brain works doubly hard to fill that in. #crowds #sxsw
    by Greeblemonkey via twitter at 3/15/2009 5:18:11 PM
  • When we show more data, there's less reason for our brain to make up shit.
    by AdamSchwabe at 3/15/2009 5:19:18 PM
  • "My challenge to you: Wisdom of Crowds systems provide context, fill in the missing spaces, see patterns in the chaos."
    by remarkk at 3/15/2009 5:19:22 PM
  • Nobody ever talks about designing for the wisdom of angry mobs.
    by SuBySW via twitter at 3/15/2009 5:19:58 PM
  • by Andre at 3/15/2009 5:20:15 PM
  • Challenge for designers: How can we bring wisdom of crowds to communities we create. How do we give people 'in-control' experiences that make them less crazy online.
    by AdamSchwabe at 3/15/2009 5:20:45 PM
  • Q&A time.
    by AdamSchwabe at 3/15/2009 5:20:56 PM
  • Spend 60 seconds to tell me about something your passionate about. Get people in touch with something they care about, the feeling of being out of control disappeared. Give people tools for being in control to make them less crazy.
    by remarkk at 3/15/2009 5:20:59 PM
  • Q: What role does curation play in gathering/presentation of data?
    by AdamSchwabe at 3/15/2009 5:21:11 PM
  • When you are out of control, you make up stories to explain things. Systems for crowds can help people avoid being insane on internet. #sxsw
    by oninformation via twitter at 3/15/2009 5:21:24 PM
  • #sxswwc Wisdom of Crowds helps/ needs to provide context to help keep conversation in control.
    by AndrewPWilson via twitter at 3/15/2009 5:21:30 PM
  • A: We get so excited about wisdom of crowd scenarios that we sometimes forget to participate too. Every crowd has a ringleader/moderator/curator. If you can't name them, that person is you. Digg gets in shit all the time because they shoot down editors (but they still fuck with the algorithm). Altering the algorithm is curation, it's like changing the 'recipe' for the algorithm. Don't be anti-curator because everything needs a curator.
    by AdamSchwabe at 3/15/2009 5:22:14 PM
  • Q: What can we learn from most popular vs. most e-mailed? (like for a NYT story)
    by AdamSchwabe at 3/15/2009 5:23:28 PM
  • A: Should take all of those things and mix them up. It would make the system harder to game and would be a more authentic representation of the community.
    by AdamSchwabe at 3/15/2009 5:24:08 PM
  • Q: Any specific examples of more complex user feedback interfaces that gather more complex data?
    by AdamSchwabe at 3/15/2009 5:24:42 PM
  • A: Forum conferencing software is incredibly complicated. Having a blank box makes you think a lot about what you're entering.
    by AdamSchwabe at 3/15/2009 5:25:18 PM
  • Q: Crowd is very small for most sites on the Net. What are your thoughts on pulling wisdom from a big group without it being ridiculous? (YouTube employee. LOL)
    by AdamSchwabe at 3/15/2009 5:26:31 PM
  • A: Sites like Flickr/YouTube are incredibly diverse. Does everyone feel inclined to participate or feel intimidated by the rowdy commenters. Discussion systems fall prey to groupthink. (Tipping Point - Graffiti causes crime). If there's a lot of noise to start, it turns away better participation. Trick: How to include lots of people without having lowest common denominator rule.
    by AdamSchwabe at 3/15/2009 5:28:05 PM
  • That's a wrap!
    by AdamSchwabe at 3/15/2009 5:30:46 PM
  • by remarkk at 3/15/2009 5:23:01 PM
Who's Blogging
  • AdamSchwabeAdamSchwabe
  • mapgoblinmapgoblin
  • thodythody
  • GreeblemonkeyGreeblemonkey
  • remarkkremarkk
Translate
Options
Comments

Turn viewer comments off and on.
Turn comments off

Share
Twitter
Tweet this event!
Social Bookmarks
Bookmark and Share
RSS
Subscribe to this live blog via RSS