SIDEBAR
»
S
I
D
E
B
A
R
«
Designing for Big Data
Apr 29th, 2009 by analyticjournalism

Much of this is well-known by those of us who have worked with dataviz for the past decade or two, but his ending conclusions are solid and worth reviewing.

Key quote from Jeffrey Veen: “We need to create tools to help people manipulate THEIR data.”

 Good examples of how to use large data sets to find and tell stories and, if desired, to answer YOUR questions about the data.


Video: Designing for Big Data

This is a 20-minute talk I gave at the Web2.0 Expo in San Francisco a couple weeks ago. In it, I describe two trends: how we're shifting as a culture from consumers to participants, and how technology has enabled massive amounts of data to be recorded, stored, and analyzed. Putting those things together has resulted in some fascinating innovations that echo data visualization work that's been happening for centuries.

I've given this talk a few times now, but this particular delivery really went well. Only having 20 minutes forced me to really stay focus, and the large audience was very engaged. I'll be giving an extended version of this talk in June at the UX London conference, with a deeper look at how we integrated design and research while I was at Google.

http://www.veen.com/jeff/archives/001000.html


 

Turning Statistics Into Knowledge – 3 Days Left to Sign Up
Apr 29th, 2009 by analyticjournalism

Turning Statistics Into Knowledge – 3 Days Left to Sign Up

Posted: 27 Apr 2009 09:28 AM PDT

The US Census Bureau, World Bank, and OECD have organized a seminar to discuss innovations in visualization and blossoming Web technologies to disperse the stories in data. Innovative Approaches to Turn Statistics into Knowledge will be held July 15-16, 2009 in Washington, D.C.

While dynamic graphics and communication tools are at the heart of the seminar, we also want to focus on a broader range of tools. The seminar will also include the use of videos, as explored by GapMinder and others, and participative approaches, as seen in some web 2.0 initiatives; and – although innovative tools are themselves of great interest, and worthy of being presented at the seminar – the focus of the seminar will be on innovative applications of tools, for example, so-called story-telling applications.

With participants [pdf] from all over the world and major organizations, and no registration fee, the seminar looks promising. Hurry though, there are only three days left to sign up. The deadline is April 30.


 

Turning Statistics Into Knowledge – 3 Days Left to Sign Up
Apr 28th, 2009 by analyticjournalism

Turning Statistics Into Knowledge – 3 Days Left to Sign Up

Posted: 27 Apr 2009 09:28 AM PDT

The US Census Bureau, World Bank, and OECD have organized a seminar to discuss innovations in visualization and blossoming Web technologies to disperse the stories in data. Innovative Approaches to Turn Statistics into Knowledge will be held July 15-16, 2009 in Washington, D.C.

While dynamic graphics and communication tools are at the heart of the seminar, we also want to focus on a broader range of tools. The seminar will also include the use of videos, as explored by GapMinder and others, and participative approaches, as seen in some web 2.0 initiatives; and – although innovative tools are themselves of great interest, and worthy of being presented at the seminar – the focus of the seminar will be on innovative applications of tools, for example, so-called story-telling applications.

With participants [pdf] from all over the world and major organizations, and no registration fee, the seminar looks promising. Hurry though, there are only three days left to sign up. The deadline is April 30.


 

Tracking the bucks — Yours, mine and ours
Feb 16th, 2009 by analyticjournalism

A number of organizations — but mostly non-journalism sites — have come along to provide web sites to help us follow the twists and turns of the “stimulus” bills moving through the political system at all levels.  “ShovelWatch,” from ProPublica, is one of the more interesting.  Understand, though, that this isn't just for the public: the ProPublica journos can and will draw on this in months to come.

shovel1

Watch the dollars with us

ShovelWatch is a joint project of the non-profit investigative outfit ProPublica, the morning news program The Takeaway and WNYC, New York’s flagship public radio station.

With investigative reporting, interactive features, and (not least) help from you, we’ll be tracking the stimulus bill dollars as they travel from Congress to your neighborhood. With your help, we’ll make sure that one of the biggest, fastest appropriations ever has a big, fast army to track whether it is well spent.

One note: This is only a first step. We’ll be building and improving the site quickly.


 

Good, and accurate, write-up on the Santa Fe Complex
Jan 24th, 2009 by analyticjournalism

As long-time readers know, the IAJ has been actively involved in the Santa Fe Complex, a unique building-community-R&D site.  Sue Vorenberg, of The [Santa Fe] New Mexican, our local daily, gave the complex a nice turn today with this story, “Creative Force.”  Said she:

Creative force



Photo by: Jane Phillips/The New Mexican

In some ways, you can think of the Santa Fe Complex as an ant farm.

On any given day, some of the ants — well, people, with their varied specialties in computers, arts or science — will group together and find interesting ways to make the anthill larger or more efficient.

Other times, individuals ants will forage for their own sustenance, completing daily work with their ears open for calls for help from their comrades.

But if you look at it from afar, a bigger organism emerges, one that's an example of complexity theory in action, said Don Bagley, one of its founders.

“Complex systems generally mean that there are many actors working in an environment — like an ant colony or beehive with queens, workers, drones and whatnot,” Bagley said. “The colony itself is an organism, but everyone within it operates with their own task in mind. And in a way, that's something we're creating with people here.”

The Complex, at 632 Agua Fría St., opened in June in some ways as an experiment using complexity to grow the economic and creative forces in Santa Fe.

The facility is part livingroom and part cybercafe, with a little office space thrown in for good measure. The goal is to bring people from a vast array of backgrounds together to form projects, and perhaps even spur some new start-up companies for the City Different.

“We're trying to make a hive to give people from a lot of different backgrounds a place to work together — and make a whole that's greater than the sum of its parts,” Bagley said.

The city of Santa Fe supported the idea at start-up, providing $29,000 in match funds to help the ball get rolling. The matching funds were donated by users of the site, Bagley said.

“We've found huge popular support in Santa Fe, and it's continuously growing,” Bagley added proudly.

In December, the city gave a grant of $165,000 a year over three years to keep the site going, which has been a godsend in the poor economy, Bagley added.

“It gives us the revenue we need to cover our basic operating expenses, but so far, nobody's getting a salary,” he said.

Still, if the site grows some new businesses, it could certainly pay off for Santa Fe.

And the complex is working on educational programs and internships for local high-school students that could help train new workers that technology companies are looking for, Bagley said.

The idea of making such a strange site grew out of the dot-com sector. Many Santa Fe technologists work out of their own homes, and the thought was to give them a place to go, get together and spawn new ideas, Bagley said.

“We call it a project space,” Bagley said. “A project could become a business that goes to the Santa Fe (Business) Incubator. But as a project space we try to create a community of people who can work together in different situations.”

People from all walks of the City Different are welcome to join, he added.

It costs $100 a month for a “laptop member” to hang out in the main room and use the Complex's wireless network. For $400 a month, users get their own desk in a more private studio. And when projects grow, there's space for that as well, in another building. The complex asks for a 20 percent donation from projects that grow through use of that space, all as a means to support the nonprofit.

On a Wednesday afternoon in January, a group casually came together in the corner. Bagley looked over, noting the informal meeting had brought together a computer programmer, an expert in printer interfaces and a psychologist, among others.

At other times, dancers and artists have descended on the facility.

And sometimes, new creations are spawned by the complex's eclectic members.

In the back of the main site, a Wii video game remote, a Web camera and a video projector hang from the ceiling, attached to a computer and hovering over a sandbox.

While the device appears a bit Rube Goldberg-esque, it's actually a clever little invention that could help the city's emergency planners during fire season, Bagley said.

The projector and computer beam an image onto the sandbox, and people can gather around the sandbox and turn it into a topographic map of the city by dragging and smoothing the sand.

In case of a fire, you could literally light a lighter in part of the sandbox — at an origin point — program the wind speed and other factors into the computer, and watch where the fire will go, Bagley said.

“What this does is move the computer out of the central focus, and lets you take a hands-on approach to managing the data,” Bagley said. “One thing I think about computers is that we're too focused on what's under the hood, and we need to get away from that.”

The device cost about $1,500 and could be used for a variety of other purposes, he added.

While the Santa Fe Complex is still a fairly young facility, it's something that scientists at the more well-known Santa Fe Institute find fascinating.

Chris Wood, vice president of SFI and a board member for the complex, said he's curious to see what will evolve from the site.

“The opportunity to translate the creative ideas that arise in Santa Fe arts and science is an important opportunity for the city,” Wood said. “What the Complex is trying to do is take many of the lessons learned from basic complexity science and apply them in the world — through the world of business or economy or other areas.”

Eventually, he could see somebody from SFI doing a study on the Complex and how members work through it creating complex systems, he said.

“In our view, they're quite complementary to us,” Wood said. “I could certainly see somebody interested in organizational development make a good study out of them.”

Contact Sue Vorenberg at svorenberg@sfnewmexican.com.








Doig pegs inaugural crowd at 800k
Jan 21st, 2009 by analyticjournalism

 As a follo on his MSNBC story related to crowd counting, IAJ co-director Steve Doig crunched the numbers using some essentially real-time images.

Professor estimates crowds with satellite image

01-21-09 Obama

President Barack Obama delivers his inaugural address at the U.S. Capitol in Washington, D.C., Tuesday, January 20, 2009. (Nancy Stone/Chicago Tribune/MCT)

Wednesday, January 21, 2009

An ASU journalism professor using satellite images calculated that 800,000 people attended President Barack Obama’s inauguration ceremony.

Walter Cronkite School of Journalism and Mass Communication professor Stephen Doig calculated the official inauguration crowd estimate after analyzing a GeoEye-1 satellite image shot at 11:19 a.m. from a height of 423 miles. GeoEye-1 is a military-controlled satellite.

Doig said the image was taken 40 minutes before Obama’s swearing-in, but adjusted his estimation to include people who were still coming in before the swearing-in.

“The space-based image is fascinating because all the low-level shots make you think the crowd is much larger,” Doig said. “You see the very dense clots of people in front of the Jumbotrons but then the wide open spaces elsewhere.”

Doig originally tried to calculate the crowd size through a camera hanging from a balloon 700 feet off the ground.

The balloon was operated from the ground by a company called Digital Design & Imaging Service. The Virginia-based company specializes in taking scenic pictures for planning projects of architects and developers.

Company president Curt Westergard asked Doig to calculate the amount of people at the inauguration from an image the camera took.

The camera initially went up at 4:50 a.m. and took its last photo at 7:30 a.m. MST.

Westergard said the camera was intended to take a picture two hours before the inauguration began, but because of George Bush’s early arrival and temporary flight restrictions, officials had the balloon come down earlier than expected.

Doig said one of the issues with the camera was the clarity of the vantage point. He said that is the reason why he was unable to calculate the crowd size.

“It was a beautiful photo but useless for crowd counting because it was not a clear photo,” Doig said.

Jody Brannon, national director of the Carnegie-Knight News21 Journalism Initiative, said technology has become a tool to help journalists report fairly and responsibly.

“For this historic event, not only is technology now available to help with accuracy, but Steve is a specialist experienced in reporting on crowds,” Brannon said in an e-mail. “So it’s a double-win to help chronicle history with great precision.”

Dan Gillmor, director of the Knight Center for Digital Media Entrepreneurship, said Doig’s involvement in measuring the crowd size is significant.

“Steve is one of the real stars in understanding how data and journalism fit together,” Gillmor said in an e-mail. “So it makes perfect sense for him to be involved with this.”

Gillmor said aerial imagery has become a useful tool when making crowd estimates.

“In the past, we’ve had deliberate over- and under estimating of crowds to fit political agendas,” Gillmor said. “If technology can help us be more accurate, all the better.”



http://www.asuwebdevil.com/node/3654


 

CNN uses satpics to show inaugural crowd in mall
Jan 20th, 2009 by analyticjournalism

Satellite shows mall crowd 2:44 A Geo-Eye image for CNN shows ant-like people crowding the Mall in Washington. CNN's John King reports.

But wait! There's more, thanks to Gary Price:

“Satellite company GeoEye is now live with a satellite image (half-meter) of the National Mall taken this morning. You can also download/save a hi-res version of the image. Image here with publishing guidelines: http://geoeye.com/CorpSite/gallery/detail.aspx?iid=220&gid=1 Hi-Res image here: http://geoeye.com/CorpSite/gallery/image-viewer.aspx?m=h&iid=220&gid=1


Rules of Database App Aging
Jan 20th, 2009 by analyticjournalism

Peter Harkins, at his blog Push CX, suggests “Three rules for data base creation and management“:

  1. All Fields Become Optional

  2. All Relationships Become Many-to-Many

  3. Chatter Always Expands


Here's why journalism doesn't and isn't "getting it."
Jan 18th, 2009 by analyticjournalism

One of the things most frustrating about the apparent inability of journalists and journalism educators to grasp — and utilize — the Digital Revolution showed up in my mailbox this week.

I received a note from Nicholas Lemann, Dean of the Graduate School of Journalism at Columbia University.  The note starts by pointing out that “We are living through a perilous, but fascinating, time in journalism.”  Then he — or more likely some copywriter — goes on to suggest that the “future of journalism” depends on my subscribing to and reading the Columbia Journalism Review.  Dean Lemann closes: “…I hope you will subscribe to CJR.  We won't disappoint you.”  The solicitation included a postage-paid envelope and this form:

Here's the thing: Nowhere in any of this communication is there a suggestion that I can — should, in fact — subscribe and pay for that subscription online!  Not only would it be easier for me, but at the very least the CJR wouldn't be billed by the post office for that return envelope.  Forget about the fee charged by some last century copy writer, the printer and the mailing and fulfillment houses. 

This is just one example of the poor list management from the CJR.  In fact, I already am a subscriber, but there is nothing on this solicitation to tell me when my subscription will lapse.  Without that data, why should I re-up?

The CJR isn't alone.  Here's another from The Atlantic offering me a great deal on a renewal.  Once again, no data about how long I have on my current subscription.  No suggestion that there might be a way I could renew and pay for that renewal online.

We subscribe to a lot of magazines.  This type of know-nothingness happens weekly.  It's no wonder the industry is in decline.  Its management just doesn't grasp how to reach and relate to subscribers and customers, both actual and potential.



 

 

 

 

 

Calculating crowds
Jan 18th, 2009 by analyticjournalism

It's good to see some analytic methods creeping into event coverage, at least when it comes to a known site and an event with a long walk-up.

A couple days ago, IAJ co-director Steve Doig had a piece on MSNBC.com “How big will inaugural crowd be? Do the math When people gather in vast numbers, 'official' estimates often run wild.” Steve suggests that the wild numbers running toward 4 million are simply not possible. You can't put a gallon in a quart jar.

The NBC Chicago also weighed in with 'Record or Not, No Head Count Planned for Inaugural.” This story, like Doig's, discusses how contentious crowd-counting can be, especially if the methodology is shall we say “Informal.”

And Saturday, old friend Ford Fessenden, at the New York Times, and his colleagues offered up “A Million Here, a Million There.” The Times' graphic does a great job of mapping the Mall in Washington and giving some good estimates of the crowd.


 

»  Substance:WordPress   »  Style:Ahren Ahimsa