Showing posts with label evaluation. Show all posts
Showing posts with label evaluation. Show all posts

Friday, May 13, 2011

What Does a Healthy Population Look Like?

How do you quantify something as complex and dynamic as a person's health?

First, you define it. What does health mean? Or asked another way, what does it look like to be healthy? The World Health Organization defines health as
"a state of complete physical, mental, and social well-being and not merely the absence of disease or infirmity."
For a long time, I found that answer sufficient. Then I became an evaluator. Now I reflect on this definition, and find that it does surprisingly little to help clarify or make measurable what health means. Replacing the word "health" with "well-being" does not provide much additional guidance and it's only somewhat useful to know that health is not equivalent to the absence, or lack of, a medical diagnosis.

Now, I don't mean to undercut the importance of WHO's game-changing definition in the history of our understanding of wellness and illness. I am saying that measuring what we mean by "health" (as well as many other constructs in the social sciences) takes significant effort. It is a complex task indeed!

A few months ago the Institute of Medicine (IOM) took a stab at defining what health means by releasing its Leading Health Indicators for Healthy People 2020 report. The report prioritizes 12 health indicators and 24 health objectives for the US government's Healthy People initiative, including indicators of access to care, mental health, tobacco use, responsible sexual behavior, and obesity. The indicators were picked from among 43 topics and nearly 600 objectives!

An editorial in the Lancet highlights that for the first time objectives for lesbian, gay, bisexual, and transgender health are addressed, particularly around increasing health insurance coverage and reducing obesity.

These indicators have long been an important way to prioritize and track changes in our nation's health. It provides leverage for advocates of particular issues and vulnerable populations. In addition, it helps allocate funding to address gaps and areas that are most lagging in progress over the course of the decade.

Yet, I can't help but find it ironic that the single best measure of health comes from a simple survey question often asked by the CDC. It has been validated and recognized as credible in multiple studies through the years. To assess health, all that's needed is to ask:

Would you say that in general your health is excellent, very good, good, fair or poor?

Now that's something to think about...

Saturday, October 30, 2010

Evaluating Impact: Storytelling Versus Metrics, Which Matters?

Stories can capture the heart of a person like a number or statistic never can. Even mind-boggling statistics are just that – incapable of being fully processed and affecting us into action. Human experience on the other hand, touches us deeply and creates empathy that we are unable to ignore.

On Thursday, I listened to Jessica Jackley (co-founder of Kiva and founder of Profounder) and Jennifer Aaker (Stanford Business School Professor and author of The Dragonfly Effect) talk about the power of storytelling. It was at a Philanthropy and Civil Society event at Stanford University that was supposed to be on social media, but focused on something much more enlightening: the power of people's stories.

Many people are talking right now about the importance of metrics in measuring nonprofit impact. Metrics quantify activity and changes that are seen as a result of a program, service, or policy. While there is a place for metrics and quantifiable successes, I believe it can’t be the only way we assess change.

While some questions are amenable to a single numerical answer, many are nuanced and require skill in listening, capturing, synthesizing and communicating in creative qualitative ways. The latter begins through asking thoughtful questions and consequently by listening to peoples’ stories.

There are two reasons that we must consider the questions we ask about impact and how we gather information to answer those questions, whether through collecting numerical data or capturing stories.