The rap on research for the arts, museums, and education

June 24, 2011

Can we be ‘academically adrift’ while ‘racing to nowhere’?

The recent, gloomy book about our higher education system, Academically Adrift: Limited Learning on College Campuses, has sparked much debate. So has a documentary about high school students desperate to get into good colleges, Race to Nowhere. Put the two together and it starts to look like young people are stressing out and over-achieving in high school to get into the right universities, then not learning much when they get there. Is that true, and if so, how did we get here?

At first, what struck me about the book and the movie was how differently they see the situation. Academically Adrift, a rigorous sociological study written by Richard Arum of NYU and Josipa Roksa of the University of Virginia, assesses the “value added” by undergraduate education in America — in other words, learning outcomes. The story is not a happy one. Based on results from the Collegiate Learning Assessment (CLA), a standardized national instrument designed to measure critical thinking, the authors find that many of our college students have experienced little in the way of measurable learning during their undergrad years. To be specific, almost half of students (45%) showed no significant improvement on the CLA. Not exactly a passing grade for American higher education.

(Whether the CLA actually measures this accurately is a question unto itself. For the moment, let’s take it at face value and assume it does a decent job of assessing critical thinking, analytical reasoning, problem solving, writing, and other skills we want our colleges to teach.)

Then there’s the Race to Nowhere phenomenon. The film, co-directed by Vicki Abeles and Jessica Congdon, has garnered attention through grassroots distribution: screenings at schools followed by discussions among parents and teachers. That’s how I saw it recently at the school one of my children attends. The film tells the stories of high-schoolers pushed to the brink, working extremely hard, anxious about getting into the best colleges, depressed, and eventually burned out.

These kids are many things, but they are not “academically adrift.” They’re learning plenty. But they’re also paying the price for those achievements in areas like health, happiness, and quality of life. They are driven simultaneously to academic success and emotional collapse. 

Now, these are highly motivated, high-achieving students; obviously they don’t represent the full range of high schoolers in America. But with more prospects applying to a greater number of highly selective colleges each year, those colleges are becoming even more selective, and the race is only heating up. Race to Nowhere is a sobering look at an important and growing part of the higher ed ecosystem.

So the book and the film tell very different stories, and the two seem to be in tension with each other. Take the issue of homework (as they call it in high school) and time spent studying (in college). The authors of Academically Adrift noted in a New York Times op-ed that the average college student spends only 12 to 13 hours per week studying, about half of what she spent in 1960. In contrast, the question in high school circles is how to stem the rising tide of homework and give students their lives back a little. Another recent Times article cited Race to Nowhere as one of the catalysts for new policies by school districts to limit the time that students spend on homework. In the film, and in the discussions sparked by it among parents, it’s clear that many grade school and high school students are spending hours every night on homework.

So is the problem too little studying or too much? How can students be spending more time studying in high school than they do in college? And what’s the relationship between the two? ...

Full Post »
Categories: Accountability, Assessment, College admissions & marketing, Higher ed, Learning, Student research
Comments (1)  ::  Share This


January 19, 2011

In the race to test and assess, let's take the time to get it right

This is my first blog post as a research fellow at Slover Linett. Bill invited me to comment on Academically Adrift: Limited Learning on College Campuses, a book that was published this week and has quickly sparked debate. For those of you who don't know me, I work in assessment at Northwestern University and am the principal investigator of the Teagle Assessment Project and other national studies of student outcomes. But enough about me...

My first-grader took an online standardized math assessment for the first time last month. “It was so easy, Mom,” he told me, “Anne and I raced to see who would get done first.” “I can believe that,” said his teacher when she looked at his score during our parent-teacher conference. He had missed some easy questions in his haste, so the test didn’t even offer him the subsequent hard questions, which the teacher knew he was capable of answering correctly. In the world of high-stakes testing, there were no stakes as far as my son was concerned. And the testing instrument didn’t seem to do a good job of measuring what he knew.

This week, a new book based on undergraduates’ scores on an online standardized assessment is receiving a lot of attention in the higher ed world (see The Chronicle of Higher EducationInside Higher Ed, and the NY Times). The sound-byte is that students aren’t learning very much in college. And everyone is to blame: faculty who don’t take teaching seriously enough, presidents and boards and a tenure system that doesn’t reward teaching, colleges that don’t provide challenging curricula, students who prefer partying over studying. The list goes on.

But I have to stop and ask, how good is our ability to measure what students are learning in college? And how motivated are students to show us what they’ve learned when we ask them to do so using a standardized test? ...

Full Post »
Categories: Accountability, Assessment, Higher ed, Learning, Student research
Comments (1)  ::  Share This


August 01, 2010

Nudging the visitor research field to think more about [fill in the blank]

Sarah and I were in Phoenix these last few days for the Visitor Studies Association conference, where the debates ran well into the night over drinks. At the “marketplace” session on Thursday, we posed a question to our fellow attendees. Here‘s the data we collected…and an invitation to add your own.

Phoenix was hot, both meteorologically and politically. But in the cool confines of the Wyndham, we set up our table (see photos, a first for the firm) next door to our friends from Randi Korn & Associates. I scrawled this question on a flip chart:

“In your humble opinion, what should the visitor studies field be thinking more about?”

As people stopped by, Sarah and I invited them to write short responses on another pad. Here’s what we got. I‘ve re-ordered the responses to group and link the ideas, but left the wording verbatim.

The visitor studies field should be thinking more about…

  • Visitor studies as a tool for organizational change → need to work with CEOs

  • Accessing boards

  • Influence

  • Organizational culture

This was a frequent theme at the conference this year. Museum evaluators and other visitor researchers naturally want their work to make a difference to the institutions they inhabit (or work with as consultants). And they’re thinking big about visitors, impacts, values, and effectiveness — thinking in ways that could really help those organizations. But the fact is that most trustees and museum directors, not to mention many museum and informal learning professionals in other disciplines and departments, are kept at a distance from visitor studies because of institutional hierarchies, silos, and communication dynamics. So the field feels a little stymied, and its members are asking themselves what they should be doing to educate their colleagues and better communicate the value of their work. (Note this year’s conference theme: understanding the public value of visitor studies.) ...

Full Post »
Categories: Assessment, Conferences, Learning, Metrics, Museums, Research issues, Visitor experience
Comments (1)  ::  Share This


December 30, 2009

The accountability movement

I was recently asked by a colleague of mine to guest lecture at a seminar in higher education administration that he teaches. I’ve done this before and always enjoyed it, and I like to think I have something worth sharing after all those years in institutional research (including my recent experience on the consulting side). His students are refreshingly idealistic: they really aspire to have an impact on the way higher education works and how it benefits society.

But they often also have a big impact on me. That was the case in my most recent experience.

During the seminar, we discussed the various accountability efforts that are currently underway in higher ed, such as the College Portrait component of the Voluntary System of Accountability (VSA) effort at land-grant colleges and universities, and the University and College Accountability Network (U-CAN) among independent colleges and universities.

Full Post »
Categories: Assessment, Higher ed, Learning, Student research
Comments (1)  ::  Share This


About Us

We’re a Chicago firm that helps museums, arts organizations, and universities take a fresh look at their audiences and discover new ways to deepen the connection and broaden participation. More »

About this Blog

Asking Audiences explores the fast-changing landscape in which cultural and educational organizations meet their publics. What does relevance look like today? More »



Subscribe via RSS
Subscribe via Email

Blogs we love

Higher Ed
Blog U (Inside Higher Ed)
Chronicle of Higher Education
The College Puzzle (Michael Kirst)
Educated Nation
mStoner (Michael Stoner et al.)

Arts & Culture
Artful Manager (Andrew Taylor)
Createquity (Ian David Moss)
CultureGrrl (Lee Rosenbaum)
Jumper (Diane Ragsdale)
Life’s A Pitch (Amanda Ameer)
NAMP Radio (monthly podcasts)
Real Clear Arts (Judith Dobrzynski)

Museums
Future of Museums (Elizabeth Merritt)
ExhibitFiles
ExhibitTricks (Paul Orselli)
Expose Your Museum (Kathleen Tinworth)
Museum 2.0 (Nina Simon)
Museum 3.0
The Uncataloged Museum (Linda Norris)

Performing Arts
About Last Night (Terry Teachout)
Sandow (Greg Sandow)
Theater Loop