Archive for the ‘Innovation’ Category
[Updated:] If you give a pig a Python …
As part of the Knight News Challenge grant for OpenBlock Rural, I’d like to build capacity of North Carolina journalism students to contribute to the application’s code. It’s not the main point of the project, but it’s an element that will help the longterm sustainability of the community — both the OpenBlock community and the rural communities we hope to serve.
But building that capacity from scratch is no short task. As I’ve begun to map out a class or workshop on it, I was reminded of a book that I read to my kids.
- If you’d like to learn how to use OpenBlock, you need to know Django …
- If you want to work with Django, you’re going to need to understand how to edit files with nano or some other text editor, and you’ll need to know PostgreSQL, and you’ll need to know some Python …
- If you want to use Python in any meaningful way, you’re going to need to install some Python packages, or modules …
- If you want to install Python packages, you have to know how Python works on your computer’s operating system (Mac, Windows, and Unix) …
- If you want to know how Python works on your system, you have to be comfortable using the command line of Windows or Unix. You need to be able to list directory contents, change directories, read and change file permissions, manage Linux users, download and decompress files using gunzip and tar commands.
- … and you’ll need to know HTML and CSS
The paradox of teaching these things to students is that as the user interfaces of Web applications and computers get easier, and their use becomes more ubiquitous the proportion of students with the hacker ethic they need to approach projects like this is reduced. That’s not a dig on students. The better something works out of the box the less the need to tear them apart, fix them, improve them. It’s like me and my car. Wheels turn. Radio works. Doors open. I couldn’t care less how the gears actually shift or how the “snow” traction works.
But I hope we’re not just training college students to be users of technology. College journalism students need an entrepreneurial mindset. It’s not just about teaching the technology. It’s about cultivating an entrepreneurial spirit, a way of skeptical knowing, and a hacker ethic.
Bracken’s right: Print IS the new vinyl
It might have been an offhand comment, but the idea that “print is the new vinyl” is a rich analogy. It was made last week by the Knight Foundation’s John Bracken speaking at the Asian American Journalists Association conference.
After getting pulled down for a bit in the undertow of Twitter, Bracken expanded on his comment.The last few graphs are the key point:
“Bands … have recognized that vinyl encourages exclusivity, maximizes design potential and creates a depth of involvement that 0s and 1s cannot. Vinyl’s renaissance is not due to nostalgia — it’s due to the fact that musicians, labels and fans have built a creative and consumer experience based on what the format does well.
“I don’t want to beat this metaphor to death. Here’s the core of the comparison: as more and more of the content we consume is based on bits, the ability to engage with atom-based media will, for some, gain value.”
That’s an idea I’ve been thinking about since March when Bon Jovi accused Steve Jobs of killing music. And it’s not uncommon to hear from music fans this same love for the tangible.
Based on a lot of time talking with people who prefer print to digital, the tangibility of it must be the top reason people prefer print.
The analogy is good because it not only deals with consumption habits, but also production.
Albums — in vinyl or CD – are a product, a good, a widget. They are a complete package. Digital music is disaggregated. It’s becoming increasingly a social experience. I suspect that one day soon we’ll be paying more for the service of digital music storage and delivery than we do for the content itself. This is going to be the same for news. Maybe its always been the same for both news and music businesses.
In any case I do think that print is going to be primarily for “hipsters.” The presence of high quality print is going to become a social signal — “I’m considerate. I invest time and money into my collection of knowledge. I enjoy learning about the world around me, not because it helps me make or save money but because I enjoy being aware of the world. I’m not a news junkie; I’m a news connoisseur.”
Vinyl signals the same things. Both the person with 100 records and the person with 10,000 digital songs can legitimately say “I’m REALLY into music.” But they mean different things.
OpenBlock Setup/Matintenance Costs
As I wait for the Knight Foundation to give OpenBlock Rural the official “Go!” I’ve been talking with developers and working on nailing down an estimate of what it would take to get OpenBlock up and running. For that conversation, please tune in to this discussion thread on the eb code Google Group for developers.
“Bringing OpenBlock to Rural America” is a Knight News Challenge Finalist
I posted an earlier draft of this proposal already, but here is the full version of the proposal that has been selected as one of the finalists by the Knight Foundation in their 2011 Knight News Challenge. Let me know your thoughts. Thanks to everyone who has helped spawn and cultivate this project. Every conversation has me more excited about what we’ll be able to do for rural newspapers in North Carolina and across the country.
Describe your project
We will build a not-for-profit clearinghouse of data from state, county and municipal governments in North Carolina and deploy them through pilot OpenBlock installations at the websites of nine rural newspapers in the state. The datasets will include public records of particular interest, such as crime reports, real estate and restaurant inspections.
We have already conducted research, funded by the McCormick Foundation, that indicates deployment of OpenBlock on the websites of small and mid-sized papers could provide significant digital revenue potential – given the interest readers have in understanding their communities. But that the main barrier to implementing OpenBlock is a lack of technical expertise at small papers as well as the high cost of ongoing data collection.
At the end of our 27-month funding period, we will have reduced the costs of acquiring, aggregating and publishing public data at community newspapers. We will also have developed one or more revenue models that demonstrate how meeting the information needs of a community can also be good business, even in small towns and rural counties of fewer than 75,000 people.
Rural news organizations are struggling to move to the digital age in part because their staffs are so small that they don’t have the capacity to identify, digitize, re-aggregate and map all the various public records available at the state and local level into databases that can be accessed intelligently by both reporters and the public.
This project tackles the lack of capacity at rural papers from two directions. It will create a centralized clearinghouse of state, county and city schemas and datafeeds that could be easily used in OpenBlock. It will also create compelling editorial content that will draw new, young readers to community information presented in a format and medium they want. Audiences for this kind of editorial product are loyal. They generate repeat visits by returning to seek updates on crime especially. And they also generate page-views and increased time-on-site as they search and sort the information.
We expect through this project to lower the costs of data acquisition and organization through a variety of methods that we will be able to assess and compare. In some cases, volunteers will pick up CDs of data from county offices. In others, journalists may scan and upload PDFs of hand-written police incident reports. In still other cases, people would key into a database the information on those PDFs. This job is so big that no single small news organization could do it. But with the support of a not-for-profit organization that provides centralized technical, editorial and advertising expertise, we could create a model for gathering valuable public records from rural America. To individual communities, these records are necessary to foster an informed civic dialog and healthy economy. But in aggregate, these records may also be able to shed light on trends in rural America that would otherwise go unreported.
This project will demonstrate one way that universities can support and advance journalistic activity – by providing a launchpad for new ventures that draws upon broad faculty expertise and student workers to lower the costs of professional, independent public affairs journalism and by absorbing some of the risk associated with new editorial product development.
Knight funding will get us off the ground and put us in a position to be a self-sustaining not-for-profit company, serving North Carolina journalists and citizens and providing a model for other states and regions to adopt.
Improving Delivery of News and Information to Geographic Communities
In small towns and rural America, the local newspaper is more than just a source of information and an engine of commerce. More importantly, it fosters and builds geographic community and sets the agenda for public policy debate. By making public records readily available and well-organized, we will support decision-making and accountability in local and state government.
This project most clearly improves the delivery of news and information to geographic communities by helping rural community newspapers make the transition to the digital age and remain relevant for younger audiences that are less informed and engaged in their own communities.
We expect several community newspapers to incorporate crowd-sourcing – a technique once known in their newsrooms as “neighbors editors” – into the process of data acquisition. Where this happens, we expect an increase in civic and community engagement. – first, by forming a network of knowledgeable volunteer citizen-journalists and by creating greater demand for truly open government records.
Unmet Needs
In many cases, data that is readily available in GeoRSS or at least CSV format from big cities is simply not available even in print from rural governments. For example, journalism students at the University of North Carolina working last semester to gather and organize public records in two rural counties for an OpenBlock application met with a number of obstacles – ranging from significant photocopying fees to inappropriate redactions and denial of access to public information.
Even when acquisition of public datasets is relatively simple – for example, public health restaurant inspections — someone must request that data from a specific county be exported in fielded data format. It is inefficient for each rural news organization to make separate requests for this data in each of North Carolina’s 100 counties. In these cases, our centralized organization would outline an initial request for the data for each county.
When Rick Thames, the editor of The Charlotte Observer, reviewed our proposal, he offered his enthusiastic endorsement. “There is no question but what this would fill a need,” he said. “Small papers can’t do this sort of work on their own. So, sadly, it just isn’t getting done. What a gift this would be for those communities. A very worthy effort that would be warmly received by the editors and publishers of every small and mid-sized paper that I know.”
What’s New?
Currently there is no tool or service that can efficiently gather, format and publish public records on rural news organizations’ sites. In part, this is a technology problem that may soon be overcome with the alpha rollout of OpenBlock later in 2011. But a much bigger piece of the problem is the data itself – neither OpenBlock nor any other technology has the ability to obtain public records as fielded digital data and create a newsworthy user interface for all the various types of records that a news organization might need.
Without a project like this there is no indication that OpenBlock will be a viable option for papers in rural communities.
What Will Change?
By the end of the project, we will have …
1. About 95 up-to-date feeds of local government data in standardized, fielded formats such as GeoRSS. These feeds will be available under a Creative Commons Attribution, Share Alike license. By providing public information in this format, we will lower the barriers to North Carolinians interested in researching trends or patterns in public policy and we’ll provide the raw material for the development of mashups or entrepreneurial applications we haven’t even thought of yet.
2. Nine community newspapers using OpenBlock to publish fresh, local government data to their audiences. These newspapers will be on the frontlines of a statewide effort to get complete and current government datasets in open, machine-readable formats. They will demonstrate multiple approaches to implementation that will be relevant to others’ during the broader roll-out.
3. Identified new revenue opportunities structured around the presentation and analysis of this data that will support their journalism.
4. Journalists and citizens interested in public policy issues will have a new tool for analyzing trends and patterns in rural issues such as environmental stewardship, public health, crime and justice, education, and economic development. Community newspapers will be able to more easily compare the experiences of their communities with the experiences in other places across the state.
5. A cost-effective model for building similar independent, not-for-profit data repositories in other states.
6. Most importantly, we will have raised public awareness of open government and we will start seeing rural counties and towns publish public data in standardized, machine-readable formats on the Web.
Why are you the right person?
This project would be tested in North Carolina and rolled out nationally. While the Raleigh-Chapel Hill area is a hub for information technology, the state has a high percentage of rural counties (roughly 70 out of 100) and a strong tradition of quality community news organizations.
The project builds on extensive and longstanding collaborations between the University of North Carolina and North Carolina Press Association.
“WOW! This is an interesting and ambitious project and I know there will be many Carolina newspapers that will want this service,” Beth Grace, the director of the N.C. Press Association, told us. “At a time when papers have lost staff and have had to postpone in-depth/investigative and trend reporting, this could bring some of that information back to papers and their readers. The North Carolina Press Association stands ready to assist — we can work with you to help assess what records most papers –and importantly, their readers — would want.”
This project will address a critical need that’s been identified through the work of UNC Knight Chair Penny Muse Abernathy with three rural papers, and in partnership with professor Ryan Thornburg, whose students have already begun collecting digital public data in these rural counties. The project was funded by the McCormick Foundation to develop sustainable business models for community news organizations.
“Our newspaper has worked with Ryan Thornburg for the past year as we try to figure out how to take advantage of OpenBlock for Whiteville.com,” said Les High, the editor and publishers of The Whiteville News-Reporter. “As is the case in most rural communities in this state, the public information we plan to display is not readily downloadable to the site. This project would provide an important community service to residents of all of North Carolina’s 100 counties – bringing the benefits of the digital highway to even the most remote areas. And just as important, OpenBlock could well be an important source of new revenue for community newspapers everywhere. This is a very important first step in making OpenBlock economically feasible for small papers to implement and use.
A database of local information – and we believe OpenBlock is the best solution at this point — is a central component of the financial strategy in the digital age. Yet, the obstacles in collecting and digitizing loom as a barrier to successful implementation.”
What tasks/benchmarks need to be accomplished to develop your project and by when will you complete them?
The project has three phases, each with its own tasks and benchmarks. We have developed a detailed timeline and budget that are available immediately upon request.
Phase I is underway with funding from the McCormick Foundation to install the OpenBlock codebase on a virtual machine, to format, ingest and publish two datasets from North Carolina local governments, and write a public report on the technical risks of the project.
The report and any code we develop will be shared with the OpenBlock community. We will publish this report by April 15. (We understand this is before funding would be available from the Knight News Challenge.)
This summer, with Knight funding, journalism students and community newspaper reporters around the state will conduct a census of public records. We will pay participants to complete forms describing the location and characteristics of state and local datasets.
At the completion of Phase I, we will publish a directory of the datasets and a report that describes the economic cost to journalism of governments not publishing data in machine readable format.
Phase I will end September 30, 2011.
Phase II: The focus in this Phase will be on reducing the costs of deploying OpenBlock at rural papers as well as the costs of acquiring, organizing and maintaining data feeds that can be easily integrated into the OpenBlock application.
By the end of this Phase, we will install eight additional OpenBlock sites, publish relevant data feeds and make them freely available under a Creative Commons non-commercial, share alike license.
We will also design, test, iterate and document sample data-collection processes for a variety of scenarios we expect to encounter during the statewide deployment of OpenBlock installations. The documentation will be critical to news organizations across the country as they plan and budget their own efforts.
Phase II will run from October 2011 through September 2012..
Phase III: During the final phase of the project we will focus on generating for community newspapers revenue models that will be used to support and encourage the continuing maintenance and development of our OpenBlock installations.
During this phase we will begin a phased, statewide rollout of OpenBlock to community newspapers and we will have a comprehensive, statewide collection of public records feeds available from our clearinghouse.
Phase III will also see the incorporation of a not-for-profit organization that will house the project after the end of the grant. It will be funded with the annual membership fees from community newspapers at which we have installed OpenBlock. This organization would also maintain the clearinghouse of public data, some of which may come from places where we don’t have media partners. Finally, it will provide editorial guidance to anyone interested in using the data to create their own data tools or to write stories about trends or patterns revealed by the aggregated data.
Phase III will run from October 2012 to August 2013.
How will you measure progress?
We will measure progress primarily by meeting our benchmarks on deadline and within budget. We will recruit partners, successfully install OpenBlock at community news websites, and collect and distribute feedback from partner newspapers.
We have developed a detailed timeline and budget that are available immediately upon request.
Ultimately, we hope to see a statewide movement to support laws and systems that make government documents and data more easily accessible to North Carolina citizens. With those public policy shifts, we believe we will see more and better public affairs journalism as well as faster and more equitable resolution of civic debates.
The risks of our project fall into three categories: data acquisition, data management and publication, and revenue generation.
Data Acquisition — The goal of the project is to reduce the cost of acquiring current and complete local government data in small communities. The costs now make widespread deployment of the OpenBlock application prohibitive for small publishers.
Challenges to low-cost data acquisition are technical, political and legal. The technical problems are all surmountable – at some cost, perhaps higher than we hope. In our early going, we anticipate many data sources that will require manual entry. The risks with these data sources will be accuracy and efficiency. We hope to test various quality assurance methods across our nine initial sites.
But the real challenge we believe will be reticent government agencies and uncooperative vendors with government that make their money through government contracts for digital data storage and management.
Our experiences with student efforts to collect digital, fielded data in rural communities give us a pretty good idea of the type of challenges, if not their scope. For this project, we intend to employ reporters within each community to leverage their community-based knowledge and relationships to help overcome these challenges.
Through conversations with attorneys for the N.C. Press Association, we don’t see any legal reason that we cannot gather the data we need for the feeds to be editorially meaningful.
Data Management and Publication — This project depends significantly on the successful alpha launch of the OpenBlock installations at The Columbia Daily Tribune and The Boston Globe. We anticipate these Knight-funded launches to happen late Spring 2011.
To mitigate this risk, we have already consulted with developers to help us more clearly see the technical challenges that might stand between data collection and our goal of deploying the OpenBlock application at nine community newspapers by the end of August, 2012.
As we understand it now, the technical challenges involve scraping data, developing locally meaningful schemas for various datatypes, the development of a simple user-interface for data editing on the backend, and customizing the front-end look and feel of OpenBlock to match the websites of existing community newspapers, many of which use the commercial TownNews CMS/service.
To ensure this is adequately addressed by those with sufficient technical experience to assess and solve these problems, we will hire a qualified and cost-effective group of developers to help us.
Revenue Generation – Community newspaper publishers will participate in this project only if we can demonstrate a positive return on their investment. While Foundation support is essential to the launch of this project, sustaining it will only be worthwhile if we can help small newspapers generate revenue. On the cost side, we quickly discover the most efficient strategies for data acquisition and maintenance. On the revenue side, Penny Abernathy has been working with three small newspapers to develop sponsorship models that we believe will yield enough revenue for publishers to justify the annual cost of the service.
How will people learn about what you are doing?
There are three critical audiences for this project. First, is a national audience that we will reach through trade websites and conferences as well as the OpenBlock community that is being so well nurtured by OpenPlans and its Knight-funded efforts.
In North Carolina, we have a statewide audience of newspaper publishers, editors and engaged citizens. Our affiliations with the N.C. Press Association, the N.C. Open Government Coalition, and the School of Journalism and Mass Communication at the University of North Carolina will help us identify partner newspapers and datasets that are editorially significant.
Our most important audiences will be the local news site users and advertisers. We expect and need these citizens to become consumers of public records and advocates for digital, fielded government local government data. In many cases, we also expect that these audiences will also be our collaborators and key elements of the data collection workflow. For these audiences, the local newspaper partners will be our most important channels of communication.
But even if one of the risks we’ve outlined prevents us from creating a self-funding not-for-profit, the journalism community at the end of this grant will have several hard deliverables that will be used to guide further efforts:
- A description of state and local datasets in one of the nation’s most populated states. (August 15, 2011)
- A Paper that describes the economic cost to journalism of governments not publishing data in machine-readable format, compared to the costs of the governments – and taxpayers – to do so. (September 30, 2011)
- A clearinghouse of state and local government datasets, in open, machine-readable format. (September 30, 2012) A handbook of data collection processes suitable for six different public records request scenarios. (September 30, 2012)
- Nine installations of the OpenBlock application at community newspapers. (July 2011 to August 2012)
- Scraperscripts, schemas and other contributions to the OpenBlock Project. (April 2011 to August 2013)
Social Media and News Judgment in the Classroom
When I walk into the classroom to teach my introductory news writing students at UNC, I remind myself that I’m giving a map to people who have always driven sports cars, but never out of their neighborhood.
Some of the students are younger than Mosaic, and throughout their lives, their access to information technology has outpaced their understanding of it.
The answer to the question of “What is news?” for many of them is “Whatever my friends share on Facebook.” And that means popularity — and for many of them it’s popularity among a narrow subset of people who look, act and see the world similarly — trumps all the traditional news values of impact, proximity, prominence, timeliness, emotional appeal, oddity and conflict.
But rather than try to replace one with the other, I’m trying a technique that I hope will use their familiarity with social media to get them to think more about their audience. Try the following and let me know how it works for you, too.
1. Have the students organize their Facebook friends into various lists, using traditional news values. So, for example, students might organize their friends by geography, share experiences, relationship status, number of friends they have, frequency of posting, or a combination of those. Instructions for Creating a Facebook List
2. Throughout the semester, your students are already required to read the news. But this technique also asks them to share the stories they read with their friends on Facebook. Instructions for Sharing a Link on Facebook
3. The key is that they can’t share a link with ALL their friends. They have to pick no more than two lists with which they share each story. This gets the students thinking about how different audience value different information. Or how different audiences value the same information, but for different reasons. Instructions for Sharing Links With Specific Lists
4. Finally, with each link that a student posts she is required to “Say something about this link …” It doesn’t count if the annotation is merely a re-phrasing of the facts in the story. And it doesn’t count if the student merely writes about why she likes the story. The annotation must answer the question “So What?” for that particular list. The goal here is get students to change their belief that writing is about self-expression into a journalistic mindset in which writing is selfless expression.
Journalists have to give audiences what they want and need, and often must go to great lengths to explain to them why they need it. This isn’t paternalism. This is a service, and it’s the same one that attorneys and physicians and financial advisers provide. The choice remains in the customer’s hands. But we — as journalists — have a professional obligation to provide the best advice on the most relevant information possible.
Grading: You have two choices for grading this assignment. One option is to get a Facebook account and require that all of your students friend you and put you on every list they’ve created for the class. That way you’ll be able to see what they’re doing and use your own rubric to score their efforts. The other option is to have the students write a weekly reflection about their experiences sharing stories with their friends. What did they share with whom? How did they describe it? What didn’t they share? Why not? What responses did they get from their friends?
(For the sake of ease, you may consider creating a mock version of this assignment in which students simply write Word documents using imaginary friends, imaginary lists, imaginary stories or use an imaginary social network. But do not do that. It smacks of being phoney. And students — and journalists — hate phonies.
Knight News Challenge Proposal: Crowdsourcing Data to Bring OpenBlock to Rural America
At the top of my To Do List this week is the completion of one of the proposals I’ve submitted to the Knight News Challenge this year. I’m posting it here in the hope that you’ll have some feedback on whether/how a service like this would be technically feasible. editorially useful and financially viable. I’m especially interested in hearing from editors of small papers, public records experts, civic/community organizers and anyone who’s worked on the OpenBlock code.
Under what conditions would you volunteer to help a project like this in your community? News organization — how much would you pay for a service like this? What characteristics would it need to have to make it worth your money? What else do you see here that needs further clarification?
(And a big hat-tip here to Penny Abernathy, the Knight Chair in Digital Media Economics here at the UNC-Chapel Hill School of Journalism and Mass Communication. She got this project kicked off with a grant from the McCormick Foundation and who is my co-pilot on this application.)
Here’s our draft pitch:
Crowdsourcing Data to Bring OpenBlock to Rural America
This project would create a co-op to develop and deploy public records databases at news organizations, especially those serving communities of fewer than 75,000 people, preparing those records for presentation and integration in an OpenBlock format.
These rural news organizations are struggling to move to the digital age in part because their staffs are so small they don’t have the capacity to identify, digitize, re-aggregate and map all the various public records available at the state and local level into databases that can be accessed intelligently by both reporters and the reading public.
The project would tackle the lack of capacity at rural papers from two directions. It would create a centralized repository of state, county and city schemas and datafeeds that could be easily used in OpenBlock. This a job well-suited for a small group of experts. In addition, the project will create a statewide corps of amateur data-checkers and records requesters. Data quality assurance and data gathering are jobs well-suited for a crowd of many people, each working on a small piece of the puzzle.
These volunteer citizen-journalists would actually be member-owners of a co-op business. Each task they perform would earn them additional shares in the company’s annual profits. We would generate revenue by charging rural newspapers a fee. The more records and the better their accuracy, the more news organizations would sign on for the service.
In some cases, volunteers would pick up CDs of data from county offices. In others volunteers would scan and upload PDFs of hand-written police incident reports. In still other cases, people would key into a database the information on those PDFs. This job is so big that no single small news organization could do it. But with a corps of member-owners working together, we could create a model for gathering valuable public records from rural America. To individual communities, these records are necessary to foster an informed civic dialog and healthy economy. But in aggregate, these records may also be able to shed light on trends in rural America that would otherwise go unreported.
Improving Delivery of News and Information to Geographic Communities
In small towns and rural America, the local newspaper is more than just a source of information and an engine of commerce. More importantly, it fosters and builds geographic community and sets the agenda for public policy debate. This project will foster civic and community engagement — first, by forming a network of knowledgeable volunteer citizen-journalists, and also, by making public records readily available and organized to support decision-making and accountability at all levels of government.
Unmet Needs
In many cases, data that is readily available in GeoRSS or at least CSV format from big cities (such as this example from San Francisco) is simply not available even in print from rural governments. For example, journalism students at the University of North Carolina working last semester to gather and organize public records in two rural counties for an OpenBlock application met with a number of obstacles (which they describe in their blogs) – ranging from significant photocopying fees to inappropriate redactions and denial of access to public information.
Even when acquisition of public datasets is relatively simple – for example, public health restaurant inspections — someone must request that data from a specific county be exported in fielded data format. It is inefficient for each rural news organization to make separate requests for this data in each of North Carolina’s 100 counties. In these cases, our public records coop would outline an initial request for the data for each county.
What’s New?
Currently there is no tool or service that can efficiently gather, format and publish public records on rural news organizations’ sites. In part, this is a technology problem that may soon be overcome with the alpha rollout of OpenBlock later in 2011. But a much bigger piece of the problem is the data itself – neither OpenBlock nor any other technology has the ability to obtain public records as fielded digital data and create a newsworthy user interface for all the various types of records a news organization might need.
Without a project like this there is no indication that OpenBlock will be a viable option for papers in rural communities.
What Will Change?
By the end of the project, we will have
• at least one member-owner in each county in North Carolina
• at least 12 news organizations subscribing to the service
• at least one type of schema for which we’ve collected data from each county
Most importantly, we will have raised public awareness of open government and we will start seeing rural counties and towns publish public data in standardized, machine-readable formats on the Web.
What tasks/benchmarks need to be accomplished to develop your project and by when will you complete them?
How will you measure progress?
Do you see any risk in the development of your project?
How will people learn about what you are doing?
Is this a one-time experiment or do you think it will continue after the grant?
Journalism at Universities: Research Should Lead, a Journ.D. Would Raise the Ante
(This blog post is a belated act — an encore shall we say — in the Carnival of Journalism, organized by David Cohn. It’s a rushed draft. Please send me corrections in grammar, fact or logic.)
Leadership Will Come From Research
Fewer Journalists, Better Journalists, Higher Pay
Journalism Schools and We the Media
Why Have Journalism at Universities Anyway?
At least once a week I get an e-mail with an amazing offer for students – “write for my fledgling entertainment/product-review/sports/music/opinion Web site and be rewarded with fame, a clip and a variety of other compensation that don’t pay the rent.”
If you’ve sent me one of those emails recently, there’s a pretty good chance you’re still waiting for me to take advantage of the opportunity.
Maybe I’m missing out on the chance to make UNC the “hub of journalistic” activity in a changing news environment. After all, this recommendation from the Knight Commission on the Information Needs of the Community is really an economic one – its goal is to reduce the cost of providing news and information. And one of the ways that news organizations have always reduced the cost of production is to rely on an apprenticeship system of unpaid college students. The benefit for the student has always been that “clip” – currency that can be later traded for a paying gig.
But with those paying gigs becoming fewer and farther between, this relationship between the classroom and newsroom is going to change. The only students left taking unpaid writing opportunities are those who do it for their own psychic gratification or who don’t get the changing economics of journalism.
If universities are going to be “a hub for journalistic activity” in a world where Demand Media and Associated Content have turned low-quality “news” writing into hourly shift work, we’re going to have to be part of this economic shift in a way that benefits our students, our faculty and the communities that those of us at public universities are paid to serve.
Leadership Will Come From Research
Universities can lead change not my managing it, but by informing it – by providing the road map of answers to complex questions.
Innovation is the buzzword that we all toss around when we talk about the risks that many media companies are unwilling to take. The theory goes something like this: universities can innovate because they don’t have to show a return on their investment. They don’t have to spend resources on product maintenance.
But innovation without a problem and a hypothesis is aimless. Universities don’t need to create new stories or better stories for a market in which there’s insufficient demand. They need to formulate precise questions with answers that will impact the free exchange of ideas and support communities’ information needs.
It’s not that universities aren’t conducting research in the fields of psychology, economics, management, political science, sociology, biology that are relevant to the information needs of communities. But it seems as if there’s a failure to connect that research to environments where it can be applied.
The failures come both from the newsroom and the classroom side. Newsroom leaders, as a broad generalization, are too myopic in the questions they think are significant to the futures. Driven by incredibly demanding and increasingly frequent editorial and financial deadlines, the requests they make of universities are narrow in scope and short in term. On the other hand, academic research tends to further theory rather than change newsroom behavior. The standards of academic research FAR exceed the standards of industry research. The statistical rigor, the theoretical grounding, the editorial process of academic journals and conferences favor slow, careful dialog. We need to find a way to get “half-baked” research into the hands of industry where it’s more important to take an educated guess today than to make air-tight reviews of missed opportunities.
If I had the time, I’d love to go through the last five years of published academic research on all fields of mediated communication and create a “So What?” guide that would identify places where the direction of research can lead newsroom decisions about story choice, story presentation, audience development and information efficacy. Maybe someone’s already done this, but I’m going to bet that fewer than 5 percent of all working journalists in the U.S. today could name a single academic journal related to their field. If I’m even close to being right, then this is a foundational disconnect for which both the newsroom and classroom bear responsibility and for which the price is a an industry and a public discourse that is less healthy than it could be.
And maybe industry – and government – is already paying for academics’ time. But my guess is that the information industry invests far less in research and new product development than they spend on research in the health sciences. If universities are going to be the hub of journalistic activity then they are going to need to make research a spending priority and they are going to have to find businesses, governments and foundations willing to provide long-term financial commitments to it.
Universities aren’t going to lead the journalism industry by providing undergrads with new skills. They will only lead if they are providing a new roadmap founded in research. This is primarily the job of faculty in journalism, but also faculty in a broad range of fields with which academic journalists need to continue to seek collaboration. We can and should expose our undergrads – and certainly our grad students – to research. If we do that, then we’ll be churning out leaders who can get into newsrooms with an appreciation of research and understand how to manage its application.
Fewer Journalists, Better Journalists, Higher Pay
My UNC colleague Phil Meyer was right when he said back in 1991 we are “raising the ante on what it takes to be a journalist.”
Part of my emphasis during my four years on the faculty at UNC has been to find a way to “infuse online journalism” into courses that already exist in the curriculum. Lord knows I’ve tried and continue to do so. <plug>The most tangible evidence of my efforts is my new textbook Producing Online News.</plug>. But my problem has been this: the Accrediting Council on Education in Journalism and Mass Communication requires that at least 80 hours (out of a typical 120-hour four-year undergraduate career) be taken “outside of the unit.” Infusing new skills and concepts into journalism education is a zero-sum game. I can’t add new lessons without removing something. Or I have to find a VERY creative way of teaching the old and the new both at once.
I actually strongly support the goal of the ACEJMC requirement. Journalism students MUST have a broad understanding of the world. A broad liberal arts education ensures that a journalism degree doesn’t just mean that students have learned the trade of laying out pages in CSS or operating a camera or applying AP style. I tell my intro news writing students that a good definition of news is when the world doesn’t behave as you’d expect. And that means you have to be familiar with the natural, social and economic rules that determine how the world usually behaves. You don’t learn those rules in the J-school.
So rather than narrow the breadth of a journalism degree or reduce the importance of spelling and grammar, I’d like to see the ACEJMC introduce a new professional journalism degree that is neither an undergraduate nor a graduate degree program. The model for this would be the Pharm.D program that the American Association of Colleges of Pharmacy created in 1990 for pharmacy students.
(For those of you heard me mention this idea at the ONA conference in October, I hope this further explanation helps with your well-founded suspicions that I might have finally gone off the deep end.)
Here’s how a “doctor of journalism”, or Journ.D., program would work. Students would take the standard 80 hours of “General College” requirements, half of which would need to be in communication-intensive courses (selections in departments such as communications, psychology, politics, literature, sociology, computer science, and – yes – even journalism). Introductory course from the journalism school – such as news writing, media law & ethics, design, photography, media history, and media criticism — might even be required
This requirement would be similar to requirements at the Pharm.D. program at UNC — 40 hours of general education and 45 hours of math and science course at the undergraduate level.
After completion of the general education requirements, students would take a test and be selectively admitted to the Journ.D. program. This program, again modeled on the Pharm.D. program, would require another 80-100 hours of classroom instruction in communication skills and subject-specific reporting techniques. It would also require nine to 12 months of supervised field work. From freshman year to graduation, the degree would take six years to complete.
The supervised field work supports the Knight Commission goal of creating a hub of journalistic activity and it has a model in the Pharm.D. program. Pharmacy students at UNC are sent to work with one of 500 “preceptors” – or professional mentors – at one of 275 sites around the state. Some students also choose – at greater expense to themselves – of working at national or international sites. While many of the students want, understandably, to work near Chapel Hill, the field work is done all over the state including urban and rural environments that desperately need health care professionals beyond those that the private market alone can support. Can these communities need any less the civic capital and personal decision making tools that high-quality journalism supplies? Are a community’s information needs any less important to just public policy and rural economic development? I know from working with small and medium sized newspapers, non-profits, public radio stations, and hyperlocal bloggers that there ain’t a one of them that couldn’t use more journalistic firepower. They do, after all, come seeking free undergraduate labor…
Precpts, for their part, may or may not get some salary from universities. But they certainly all get free labor and access to the university’s faculty expertise and research. In exchange, they develop a curriculum with learning goals and give the students a pass/fail grade. And that to me seems like a fair trade.
In some cases, universities provide pharmacy students with subsidized housing at their fieldwork sites. But in other cases, the students foot the bill.
And discussions about footing the bill is perhaps where the Pharm.D. model begins to show some flaws. From my cursory research as well as from anecdotes provided by friends in both fields, starting pharmacists in any market and at any level of experience make about twice what journalists make. Pharm.D. students are willing to invest in six years of tuition payments because their return is much better.
I think Phil Meyer was right – being a great journalist today takes a lot more than being a great journalist 15 years ago. The need for advanced training is clear. But the justification for students to invest in it is pretty weak. Until the demand for high quality journalism increases and/or the supply of high quality journalists decreases, we have a pretty weak argument for requiring students to spend more time and money breaking into the field.
Universities, through research, should play a role in increasing demand. If advertising, social pressure and public policy changes can get people to exercise, quit smoking, seek counseling, stop bullying, recycle, and eat local then those same tools can certainly be used to increase demand for public policy news and information – maybe not among everyone equally, but some.
Universities can also help throttle back the supply of journalists who are anything less than excellent. The market is doing a pretty good job on its own of reducing the ranks of experienced, expensive journalists. But we owe it to our young students that they are not just cheap production inputs that the industry needs today. Every journalist student must be equipped for long-term success and inoculated as best as we can against the next generation of young, cheap, inexperienced labor.
Many of our journalism students are incredibly idealistic and would work for not much more than food. But how are we rewarding and supporting their engagement in public life by chucking as many of them as possible as quickly as possible into a market that doesn’t value them?
Looking at the success of trade publications, Congressional Quarterly and Bloomberg lead me to believe that high quality reporting that has a direct impact on its audience will always have a market.
We need to raise the ante on what it takes to be a journalism student.
Journalism Schools and We the Media
For at least 100 years, one of the biggest criticisms of journalism programs at universities is that they are anti-democratic. Who are you, pointed-headed professor, to tell us who is and who is not qualified to participate in public debate, to watchdog the government and to tell our own stories of the world the way we experience it?
And with the decreased barriers to publishing journalism, this criticism only gains traction. The distance between a non-partisan professional journalist, a professional advocacy journalist and an amateur journalist – once the audience – is smaller than ever.
More and more people are banging down the door of the MSM and the institutions that develop it. While raising the ante on what it takes to become a professional journalist, J-schools can also throw open their doors and take advantage of amateur interest to develop more and better journalistic activity and capacity in the communities we serve.
Journalism schools – perhaps staffed by some of those new Journ.D. students in their fifth or sixth years – should be running programs that teach technical – and that includes writing – skills as well as programs that advance the journalistic values of verification, precision, brevity, relevancy.
Amateur journalists, engaged in narrow and personally satisfying swaths of public life, are an important tool in filling the information needs of a community. These amateurs will report small datapoints that aren’t economically rational for a professional journalist to ferret out. Those datapoints, in the hands of professionals, can help illustrate trends and structures that might otherwise remain obscured or misunderstood.
Amateur journalists who appreciate journalistic values will also have a greater appreciation for professional journalism.
Journalism schools should be places that train and – hang with me on this one – accredit amateur journalists. I would never – NEVER – support any legal privilege that would make the First Amendment work better for one person than another. Accreditation of amateur – or professional — journalists is merely a way that can help the marketplace of ideas function more efficiently. The more accrediting bodies the better (up to, I suppose, a point of diminishing return). The market of individual choices can determine what the different accreditations actually mean. But at least give that blogger who completed nine continuing education credits in reporting, community management and communication law put a little JPG on her site. Degrees have value, and they differ from accreditation badges only in scope and scale.
Why Have Journalism at Universities Anyway?
I don’t know whether the Knight Commission intended this, but it seems to emphasize the role of community colleges as hubs of journalistic activity. Maybe I have my own insecurities about this, but I wonder if that’s not part of a broader trend in academia that historically, and I suspect increasingly, doesn’t value journalism schools, classes, departments as much as it values history, biology and mathematics. I think that many professors at research universities might see journalism as a trade more apropos for a community college.
Perhaps that’s because we in J-schools talk – a lot – about job placement of our undergrads. The students and faculty measure our own success in these terms probably as much as any other. But journalism belongs at universities not because we teach students how to be journalists, but because we teach students how to think journalistically.
Journalistic thinking approaches the world in a certain way. As I mentioned earlier, it values verification, curiosity, precision and brevity. And those values – perhaps sparing brevity – are the values of the academy. But journalistic thinking also values immediacy and proximity. A shorter way of saying it might be that it values impact. Curiosity leads to verification. That leads to answer that help people make personal and public decisions here and now.
Journalists, as the Knight Commission said, connect the university to the world. Journalists democratize intellectualism. Universities and higher education aren’t just a tool for economic development. Curiosity and verification and precise communication are tools for civic engagement – for social change as well as social stability.
For all our emphasis on changing communication technologies and changing economics of media, universities are a hub of journalistic activity when they yield curiosity, rigorous verification of fact and wisdom that has immediate impact.
Journalism is essentially applied or clinical social science. Universities should just be hubs of journalistic activity. Journalism programs should be hubs of universities.
Correction, 2/15/11: An earlier version of this article misnamed the professional mentors in a pharmacy program. They are called preceptors.
Breaking News Emails: An Under-Appreciated Art
I have a tumultuous relationship with breaking news e-mails. One day we have a strong relationship that I value. And the next thing I know they get all high-maintenance on me. Sheesh.
So today I unsubscribed from breaking news e-mail alerts from CNN and NPR. I kept the alert from the New York Times for two reasons:
After thinning the herd on the national news, I planned to dump my alerts from either the News & Observer or WRAL. But when I went to do it, I just couldn’t choose. Looking over the past six months of alerts, their news judgment seems to be radically different. It’s almost as if one news organization will not send an alert if the other organization already has. So in order to get a complete range of local news alerts, I need both. But the downside to that arrangement is that probably 50 percent of the local alerts from either provider do I consider important enough to merit an interruption in my inbox.
So now what strikes me is how little time I spend talking with students about “good” news judgment and writing style for e-mail alerts. And how difficult it is to teach a technique that seems to have no consistent application among professionals. This is the perfect example where we in the classroom need to document the editorial processes around writing and distributing breaking news alerts in various newsrooms. In each newsroom, what do the journalists say are the goals of the alerts? Is there internal or external agreement on those goals? And then we in the classroom need to develop quantitative research that can help the professionals know which news judgment and writing styles best meet those goals. And then we in the classroom need to develop experimental editorial products that do a better job meeting the goals — maybe change the way news judgment and style could be tailored to the needs of individual users based on their demographics, location or behavior.
In the end, the common email alert seems to be a great example of a place where academics and industry could work together to build a better product and foster a more information society.
Lessons From ONA ’10: What It Takes, Part 1
At least three national news organizations approached me at last weekend’s Online News Association conference to see whether I could recommend any students with great news judgment and programming skills. That’s what news organizations are desperate to hire today. Why? Well, as former president George W. Bush will tell you some things — like learning how to program — are just hard work.
Lunch with a friend last week helped me put some numbers on just how hard it is. I was meeting with him so that he could show me the server he set up and the computational journalism he had been doing since we last had a chance to catch up. At heart, he is a writer and a reporter, yearning during our conversation for the chance to do more long-form narrative text stories. But in his newsroom, he is the resident programmer/journalist and has asked by his editors to hire more people like him.
Here’s what it took for him to become “tech savvy.”
* In high school, he took one computer programming class. He didn’t study or use computer programming at all in college. He wrote and edited stories at the campus paper. After graduation, he was hired in jobs as a researcher or blogger.
* During the last two years, he taught himself how to code. He set up his own Ubuntu server, with PHP and MySQL. He learned some ActionScript, JavaScript and XML. He uses Excel, Visual Basic and screen-scraper.com to report stories and build interactive editorial Web applications.
* He works 60 to 75 hours per week.
* He spends 90 percent of his time working with and learning about computer coding.
* It took him two years to get to this point of technical proficiency.
* That is a total of 5,500 hours.
He was not born with the IT chromosome. He did not wish himself to state of savvy. He has clearly been blessed with an incredible brain that was nurtured in an environment that valued education and intellectual curiosity. But that didn’t get him his job. He got his job because. He. Worked. Hard.
Let’s point out how difficult it is to get 5,500 hours of computer time under your belt.
* College students spend about 15 hours a week in class. Good ones will spend another 25 hours reading and working outside of class. That’s 480 hours a semester, 560 hours a year. At that rate, taking ONLY coding classes, you’ll get to 5,500 hours in just under 10 years. Which makes you this guy. Nobody wants to be that guy, so it’s time to accept that editorial programmers are committed to life-long learning.
* Let’s say you knock out a few coding classes in school — 500 hours worth — enough to get hired by a big news organization as a developer. That leaves you with just 5,000 hours to go. Working a standard 40-hour week, you’ll burn through those in 125 weeks. That’s about 2.5 years, after various and sundry holidays, illnesses and vacations.
* Or, maybe you were a good liberal arts student and didn’t blow any of your tuition on coding classes. But your smarts and broad-based knowledge land you a job at one of a very few news organizations that commit seriously to career development. Google spurs innovation with its famous “20 percent time,” which allows its developers to spend a day a week working on projects that are not part of their job descriptions. So, your boss lets you play with computers for one day a week. You’ve got 5,500 hours to make up. And by the time you’re celebrating your 35 birthday you’ll probably be at the point where you can start developing your own editorial applications.
What the conversation with my friend made me realize is why it irks me so much when people come to me saying that they can’t perform some computing taks because they are “technically illiterate” or “not a computer person.” My friend isn’t a computer person. I’m not a computer person either. But we try. We hack our ways through incredibly frustrating failures by simply doing this. And so can you. If you want.
The List: Quotes and Notes From TBD.com at ONA ’10
Having a pithy quote or an insightful stat is key to being a good panelist at a conference. TBD.com’s Jim Brady and Erik Wemple have both in spades, so it was good to open on the Online News Association conference with a session on their new Web site. Here in List form, are the best insights from the panel.
1. Jim Brady, on the need for diverse revenue streams for digital news media: “There’s no silver bullet, there’s shrapnel.”
2. Erik Wemple, on the importance of linking to other news sources: “With 12 reporters and 5.3 million people in our market, our editorial vision is smoke and mirrors.” (Note to self: I haven’t seen anyone ask TBDers about how much risk they see in incumbent media orgs putting their news behind pay walls. They must have calculated that either the odds of that happening are pretty low or that the impact on revenue wouldn’t be a company killer.)
3. Wemple, expanding on the editorial vision of the site: “We want to be a place where, if you hear a siren, you go to #tbd and you find out what’s wrong.” (That news sensibility speaks to TBD’s legacy partner, the local news channel formerly known as Newschannel 8. It does, at least at first blush, seem to ignore anything that’s not event-based news.)
3. Brady, on selling local ads: The biggest challenge in local advertising is getting business online. TBD is developing service models, network models and Paper G to help bridge that gap. A quarter to a third of the blogs that TBD aggregates participate in its ad network.
4. TBD aggregates 196 blogs from the Washington area. This includes professional media, amateur media, and corporate, government and non-profit organizations. That one blog for every 27,000 people in TBD’s market. I wonder what is the smallest market size that could sustain an operation like TBD? It seems to me that this indicates a roll for news organizations in medium-sized markets to cultivate local bloggers to reach some minimal threshold that would make aggregation useful. I also wonder what the typical blog-to-person ratio is a typical media market? (Calling all grad students. There’s a good research question for you.)
5. The panel of TBDers recounted the news organization’s coverage of its first big breaking news story. Bloggers in TBD’s network as well as the site’s general audience provided important eyewitness accounts of the scene. This anecdote illustrated two important elements of crowd sourcing: First, that crowds are best at stenographic journalism — they are good at supplying answers to the who, what, when and where question when those answers come from immediate observation of events or documents. That means that crowds are relatively efficient at feeding editors information during breaking news, especially stories that develop across a broad geographic all at once. Second, that if you want to use crowd sourcing when news breaks you have to develop relationships with your audience BEFORE news breaks. Anyone whose ever cultivated a source knows that means a lot of chit-chat that appears to have nothing to do with the news value of the source. Same on social media.
6. Wemple, on the power of fertile failure: “If you have a Web site that doesn’t have something terrible on it, you’re not trying hard enough.”
7. TBD social media producer Mandy Jenkins, on ignoring your critics: “”In the age of social media, that’s something we can’t do anymore.” (More of her thoughts here.)
8. Steve Buttry re-counted his tale of interviewing Jenkins for the job. It was a good reminder that journalism job candidates who display curiosity always move their resumes to the top of the pile. In online media, this means your ability to show that you try to hack devices and services just to see how they might be able to solve a problem other than the one their developers intended them to solve.
9. Jenkins, raising suspicion that she may be the Mike Allen of TBD, said she has 22 Tweetdeck columns, follows about 200 feeds and that “We follow anyone who’s ever given us a tip.” (Note to journalism grad students looking for a academic research question: It would be very interesting to see whether news Twitter accounts with high follow/follower ratios yield significantly different levels of trust or relevance among the audience.)
10. TBD.com’s corporate parent anticipates the site to take about as long as its sibling, Politico, to become profitable. That took about three years. So, a note to the laid-off reporters and editors who’ve called me with dreams of starting your own news site to compete with your former employer — Step 1: Gather up three years of operating costs…
11. Writing brief, smart, newsy lists without an editor… is hard. Perhaps something we could be teaching our students.

