It's no fun eating crow. But the bird I'm eating at the moment doesn't taste so terrible, because I like the people on whose behalf I'm eating it.
IABC hasn't released the official attendee-evaluations for its International Conference, held in New Orleans in June, but it appears those results will contradict my take on them in my conference coverage in the July 9 Ragan Report. I praised IABC's choice of keynotes ...
"... But in those breakout sessions—the ones that make up the meat of a conference—boy, were there some bombs. We’ll check back with IABC to find out what the evaluations say, but … during one hour-and-fifteen minute time slot on Monday, RR ran around the hotel, ducking into five sessions in a desperate attempt to collect useful items for this special issue and story ideas for the future. ... If the session we started in was a morgue, the one we ended in was the cemetery itself."
I went on—and, looking back, in a somewhat gleeful way.
But the numbers are coming in and they look good, according to IABC conference maven Chris Grossgart, who writes in response to my query: "I can tell you this will be our best rated conference. Ever. Our average for all sessions is a 6.1 on a 7 point scale. As a point of comparison, Vancouver's average [2006] was a 5.9. Goal always is 80% plus favorable. 2007 average is 85%."
To make matters worse, IABC—also at my request—sent me the results of a session on which I was a panelist. It ranked 46th out of 70 overall sessions. Of course I'm busy making private excuses about the absence of the panel organizer and moderator—Suzanne Salvo had a client conflict—and about the topic of the panel (photography ethics isn't the most immediately practical topic in the world). But: Damn.
As for my obviously too-harsh coverage of the rest of the sessions, it may be that I didn't go to enough sessions at this conference to judge the program fairly. Maybe all I saw were the bombs. It may also be that I am not interested in the same topics most IABC members are interested in. But then, I wasn't evaluating the sessions for their relevance to me—rather, for their relevance to the communicators in attendance.
And so Chris and Julie Freeman, it appears I did you wrong. I'm sorry about that, and I'll be more careful next time. Look for a similar note in RR after the official results come in.
Comments (10)
Mistakes are what endears you to others. At least I'm banking on that mantra in my own life.
Posted by Eileen | August 7, 2007 3:05 PM
Posted on August 7, 2007 15:05
Being the cynic that I am, did you happen to ask them what percentage of the total attendees completed evaluations, either by session or based on total registrants?
I ask this because I have been in conferences and seminars where I watch BUNCHES of people walk out of the session and leave the pretty pink and blue (not sure why they always seem to be Easter egg colours, but I digress) evaluation forms lying on the tables. While one presumes that anyone who hated the session might take the time to do an evaluation, those who were "eh" might not. And some people are just too lazy or too anxious to get to the next session.
Not that I'm trying to make excuses or anything, I'm just sayin'
Posted by Kristen | August 7, 2007 3:55 PM
Posted on August 7, 2007 15:55
Well, I figger that evaluation-apathy variable would hold true from conference to conference, and this conference apparently got better results than other conferences.
But it gets toward a damned good point.
I have a long, boring lecture about what I see as the incivility of the standard evaluation process:
Inviting speakers to a conference to speak for free and then, while introducing the person, reminding the audience, "Please fill out the speaker-evaluation form on your seat."
In other words, "Please let us know if this dude is good or if he sucks, okay? And don't forget, the whole time he's speaking, to evaluate his PowerPoint slides and his delivery style. You're a consumer first and a learner second!"
I favor sending people an e-mail note immediately AFTER the conference and sending them to a Web site to evaluate the speaker.
It's not a perfect method either, but we do it at the Speechwriters Conference and it garners a pretty decent response rate AND it lets speakers speak and attendees listen for CONTENT without having to evaluate the speaker in real time.
A day later, they still remember the duds, and they still remember the stars and nobody has been subtly humiliated or distracted in the process.
Posted by David Murray | August 7, 2007 4:09 PM
Posted on August 7, 2007 16:09
By all accounts, you, Keith and Donna did a super job at the IABC session - knowledgeable, informative and witty. I read the write-in remarks on the photo ethics session: mia culpa, Mia Culpa, MIA MAXIMA CULPA (Italian Catholic guilt for my fricken fault). I would have cut off my right arm to have been there. FORGIVE.
The Absent One,
Suzanne
Posted by suzanne salvo | August 7, 2007 7:56 PM
Posted on August 7, 2007 19:56
Salvo, love means never having to cut off your right arm.
Posted by David Murray | August 7, 2007 8:36 PM
Posted on August 7, 2007 20:36
Don't be too hard on yourself. Remember, conference evaluations, for the most part, are subjective and can be influenced by a variety of factors, many outside of your control. In some cases you just get an audience that collectively is out of sync with your message or delivery style.
For example, I remember way back when being ranked either the #1 or #2 speaker at an IABC Canada Conference than getting panned a couple of weeks later giving the exact same presentation at a Ragan conference.
Of course I will never forget the IABC International Conference in 1994 when I sponsored Jeff Hallett's 3 hour presentation on the coming impact of computer-mediated communications and what that would mean for how businesses would interact with their customers and markets. At the break, almost 75% of the audience stormed out, loudly complaining that the material was a waste of their time, that it wasn't going to have anything to do with their jobs or the roles they were going to play in their companies in the future, etc.. etc.,
They were dead wrong of course, as history has proven. Surprisingly, however, Jeff scored rather well for his session (not that he really cared) since the 25% forward-thinking IABC members who didn't leave gave him good evaluations.
Posted by Craig Jolley | August 9, 2007 8:46 AM
Posted on August 9, 2007 08:46
Hey Craig, thanks.
I've never been one to over-value quantitative surveys, but in this case they're all we've got. Do I still think some of the sessions I went to at IABC were absurd? Hell yes! Do I think I was my charming and effervescent self at this photo thing? Yes, plus I was enraged and cursing, which also makes for a surprising business conference session. So I felt I pulled my weight.
But my glib panning of other concurrent sessions, vs. the relatively low ratings of my own session pretty much forced me to do this mea culpa, especially to IABC brass, who I sometimes disagree with on some issues, but who works pretty hard, pretty smartly and occasionall pretty courageously to put on an interesting conference.
Posted by David Murray | August 9, 2007 5:03 PM
Posted on August 9, 2007 17:03
Yeesh, in 1994 my then-company had a halfway decent intranet that was growing. And I never saw them as that forward thinking!
Posted by Diane | August 9, 2007 5:29 PM
Posted on August 9, 2007 17:29
Late to this discussion, but I'm disappointed that you apologized for expressing a legitimate opinion based on your experience at the conference (and your years of experience as a conference attendee).
RR's job is to do exactly what you did -- evaluate the conference from the standpoint of what it offers the profession. Even if your viewpoint does not mirror the collective wisdom of the sample of attendees who filled out evaluations, your opinion is valid and grounded.
Never apologize unless you make an actual mistake.
Posted by Robert J Holland, ABC | August 21, 2007 8:16 AM
Posted on August 21, 2007 08:16
Well, Robert, if it's any consolation, being more careful next year won't mean holding back or waiting until the survey results are in.
Posted by David Murray | August 22, 2007 5:40 PM
Posted on August 22, 2007 17:40