Insights
Green check mark burst shape
Premium

The Truth About Session Ratings

These three truths might change your perspective about audience feedback.

7
minute read
Published on
August 5, 2024
The percentage of participants who fill out post-event surveys is often very small.

I still remember one little comment I received on a speaker evaluation.

‍

“All show
 no go.” 

‍

That one negative comment seemed to be permanently lodged in my brain—like an annoying popcorn kernel after movie night. 

‍

Although it was a completely useless comment (without more details or specific information, I can’t really know what he was intending to say), I couldn’t forget it. 

‍

Even now—more than 10 years later—those four words will still sneak back up to the forefront of my mind. Sometimes as I’m crafting a new bit for my speech, I worry it’s too over the top. That stranger’s voice echoes in my mind, and I can’t help but ask myself, “What if I am all show and no go?” 

‍

To be frank, it hurt my confidence. And I’ve had to learn to block this idea and the negative thinking that stemmed from it. 

‍

All because of four little words written on a speaker evaluation sheet. 

‍

The Psychology of Session Ratings 

‍

You probably remember a negative comment or two from your own session ratings. I wouldn’t be surprised if you too can recall word for word a particularly hurtful comment. 

‍

Psychologically, this happens a lot. Even when the majority of the feedback you receive is positive, the negative comments are the ones your mind latches onto. Why? Because negative feedback triggers critical thinking. 

‍

Subconsciously, you categorize it as a threat—which means it reaches the deepest primal area of your brain and awakens your “fight or flight” response. 

‍

But before you decide to completely renovate your speech because of a specific comment from an audience member, consider these three truths about speaker ratings and session evaluations. 

‍

#1 The percentage of participants who fill out surveys is (very) small. 

‍

Almost always, the comments you receive only represent a small fraction of your entire audience.

‍

Not too long ago, I spoke at an event with around 3,000 attendees and received 365 evaluations. That’s only about 10 percent of the audience who bothered to fill out the info. 

‍

And that’s actually pretty common. For conferences and corporate events, a good post-event survey response rate is generally between 10 and 20 percent, depending on the size of the event. 

‍

Most people are tired after a long conference day or simply don’t think filling out a survey is worth their time. That’s why so many events and conferences incentivize event-goers; if there’s a gift card on the line, more people will participate. 

‍

So, when you receive feedback (whether positive or negative) from the session ratings, take it with a grain of salt. It’s likely not truly representative of what the audience thinks. 

‍

#2 There are three types of feedback (and only two are useful).  

The real value in speaker evaluations comes from the comments people write in. And those usually come in three forms: the good, the bad, and the ugly. 

‍

The good are the kind comments you receive. These usually make up the majority of the comments you get. They’re the “Amazing,” “Loved it,” “Best of the day,” and “Entertaining, helpful, and insightful” feedback we speakers love to read. 

‍

And who wouldn’t? These compliments boost your confidence and give you a sense you’re delivering a good speech. 

‍

The bad are the constructive comments. These usually only make up less than two percent of the total comments. Although you might perceive them as negative at first, these comments can provide constructive feedback. 

‍

For example, I got a comment that said: “Too many ‘corporate’ examples cited
 Give us more down-to-earth doables & possibilities.” 

‍

While these types of comments could still sting a little bit, this type of feedback could be helpful. If you notice similar comments over a few different events, you might want to analyze what’s going on and tweak your speech. 

‍

The good comments and the bad comments are both useful when analyzing what works and what might need adjustments in your speech. 

‍

Then comes the ugly. This last type of feedback is useless—these comments are not kind and certainly not constructive either. They don’t provide useful information and it’s best to ignore them and try to forget about them. (Yep, that “all show
 no go” comment falls into this third category.) 

Full Transcript

Read Full Transcript
X Mark icon
Don't
Check mark icon
Do
Black right arrow icon

#3 Session ratings don’t influence event organizer decisions as much as you might think. 

‍

Many speakers think the higher their session ratings are, the more likely they are to be invited back to speak again. 

‍

However, according to the 2024 Speaking Industry Benchmark Report, only 22.65 percent of event organizers rank "positive event or session ratings" as their top priority when searching for the perfect keynote speaker.

X Mark icon
Don't
Check mark icon
Do
Information Source: AAE Speakers | Speakers Industry Benchmark Report

They’re much more interested in finding an engaging speaker (and one who fits their budget) than a speaker with high session ratings. You see, the truth is, most event planners choose keynote speakers based on referrals. 

‍

Referrals Overpower Session Ratings  

‍

Session ratings come in near the bottom of the event organizers’ top priority charts, but that doesn’t surprise us. 

‍

You see, in 2020 keynote speaker Jay Baer and his agent Michelle Joyce partnered with Speak, Inc. to uncover how meeting planners choose their speakers. They surveyed 150 event organizers to discover how they really find and choose speakers. 

‍

Michael Port and I shared their findings in our book The Referable Speaker: 

‍

“No matter how you slice the data, the top three ways that meeting planners select and find their speakers are:

‍

  1. See the speaker elsewhere. 
  2. Word of mouth from other meeting professionals. 
  3. Word of mouth from other people in their organization who are not meeting professionals.”

‍

Yep. That’s the power of referrals. That’s why every speaker would benefit from crafting a referable speech.

X Mark icon
Don't
rely on high session ratings to land you future events.
Check mark icon
Do
measure the quality of your speech by the number of stageside leads you earn (not by post-event surveys).

Positive Audience Feedback ≠ More Keynote Invitations  

‍

Sometimes session ratings can be misleading. They can give you a false sense of success and prevent you from building a truly sustainable speaking business. 

‍

Just ask Andrew Pickering and Pete Gartland. This dynamic speaking duo spent five years speaking for free all over Europe. They delivered fun, fast-paced sessions that gave their audience practical tips and valuable takeaways. 

‍

And their post-event survey rankings always scored highly. 

‍

But they knew something was missing. They wanted the keynote stage, not just breakout sessions. And even though audience feedback was overwhelmingly positive, they still weren't getting those keynote invitations they dreamed of. 

‍

So they decided to dissect their speech and turn it into a brand-new big idea keynote. They didn’t want to just give practical tips, they wanted to change the way people saw the marketing world. 

‍

They worked relentlessly to craft a visionary speech. Hours and hours and hours of rehearsal, testing, research, and ideation went into their new speech, “The 90:10 Rule.”

‍

And when they finally debuted their keynote, it was a hit. Yes, their audience loved it. But instead of just earning positive session ratings, they earned something much more valuable—a referral. 

‍

And not just any referral. Before they even walked off stage, Jay Baer (yep, the same Jay Baer who discovered the power of referrals) tweeted: 

‍

“At the Youpreneur Summit watching [Andrew Pickering and Pete Gartland’s] new talk. Incredible. Think about them for your keynote in 2019. It’s that good.” 

‍

That one event changed everything for them—all because they had successfully crafted a referable speech. 

‍

But don’t ditch the session ratings for good

‍

You have an important message to share, a message worth sharing. As you focus on crafting a referable speech, you’ll be able to earn much more than just positive session ratings. You’ll be able to build a sustainable speaking career.

‍

Now, that’s not to say all session ratings are pointless. Of course not! The feedback you receive from your audience can be invaluable in making adjustments to improve your speech. 

‍

Listening to the “loud few" who do fill out the surveys and share their opinions with you can help you better understand and connect with your audience. Many of the tweaks I’ve made in my speeches stem from repeat comments on speaker evaluations and event surveys. 

‍

But when taking audience feedback into consideration, you must do it logically and rationally—not emotionally. 

‍

To accurately analyze what feedback you should listen to and what feedback you shouldn’t, you must detach yourself from the session ratings. 

‍

They’re not about you. You are not your speech. 

‍

When you remove all emotion from the audience feedback and look at your speech objectively, with the sole purpose of improving it for your audience, you’ll be able to rationally and effectively use feedback. 

‍

So don’t let that minuscule percentage of ugly audience feedback get you down. You have important work to do. You’re changing the world! That’s no easy task. Not everyone will agree with you, and not everyone will like you—no matter how incredible your message is.

‍

Use session ratings as feedback to craft a referable speech, one that earns you referrals and propels your speaking business to new heights.

X Mark icon
Don't
Check mark icon
Do
X Mark icon
Don't
Check mark icon
Do
X Mark icon
Don't
Check mark icon
Do

|

Craft a speech that generates referrals.

GRAD

|

Speech Writing Mastery

Stop worrying about speaker ratings, and start crafting a referable speech that earns you gigs.
Learn more

First Name
First Name
Last Name
Last Name
Email address
Email address
Who referred you?
First & Last Name
Checkmark icon
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.

#3 Session ratings don’t influence event organizer decisions as much as you might think. 

‍

Many speakers think the higher their session ratings are, the more likely they are to be invited back to speak again. 

‍

However, according to the 2024 Speaking Industry Benchmark Report, only 22.65 percent of event organizers rank "positive event or session ratings" as their top priority when searching for the perfect keynote speaker.

X Mark icon
Dont
Check mark icon
Do

They’re much more interested in finding an engaging speaker (and one who fits their budget) than a speaker with high session ratings. You see, the truth is, most event planners choose keynote speakers based on referrals. 

‍

Referrals Overpower Session Ratings  

‍

Session ratings come in near the bottom of the event organizers’ top priority charts, but that doesn’t surprise us. 

‍

You see, in 2020 keynote speaker Jay Baer and his agent Michelle Joyce partnered with Speak, Inc. to uncover how meeting planners choose their speakers. They surveyed 150 event organizers to discover how they really find and choose speakers. 

‍

Michael Port and I shared their findings in our book The Referable Speaker: 

‍

“No matter how you slice the data, the top three ways that meeting planners select and find their speakers are:

‍

  1. See the speaker elsewhere. 
  2. Word of mouth from other meeting professionals. 
  3. Word of mouth from other people in their organization who are not meeting professionals.”

‍

Yep. That’s the power of referrals. That’s why every speaker would benefit from crafting a referable speech.

X Mark icon
Don't
rely on high session ratings to land you future events.
Check mark icon
Do
measure the quality of your speech by the number of stageside leads you earn (not by post-event surveys).
,

Positive Audience Feedback ≠ More Keynote Invitations  

‍

Sometimes session ratings can be misleading. They can give you a false sense of success and prevent you from building a truly sustainable speaking business. 

‍

Just ask Andrew Pickering and Pete Gartland. This dynamic speaking duo spent five years speaking for free all over Europe. They delivered fun, fast-paced sessions that gave their audience practical tips and valuable takeaways. 

‍

And their post-event survey rankings always scored highly. 

‍

But they knew something was missing. They wanted the keynote stage, not just breakout sessions. And even though audience feedback was overwhelmingly positive, they still weren't getting those keynote invitations they dreamed of. 

‍

So they decided to dissect their speech and turn it into a brand-new big idea keynote. They didn’t want to just give practical tips, they wanted to change the way people saw the marketing world. 

‍

They worked relentlessly to craft a visionary speech. Hours and hours and hours of rehearsal, testing, research, and ideation went into their new speech, “The 90:10 Rule.”

‍

And when they finally debuted their keynote, it was a hit. Yes, their audience loved it. But instead of just earning positive session ratings, they earned something much more valuable—a referral. 

‍

And not just any referral. Before they even walked off stage, Jay Baer (yep, the same Jay Baer who discovered the power of referrals) tweeted: 

‍

“At the Youpreneur Summit watching [Andrew Pickering and Pete Gartland’s] new talk. Incredible. Think about them for your keynote in 2019. It’s that good.” 

‍

That one event changed everything for them—all because they had successfully crafted a referable speech. 

‍

But don’t ditch the session ratings for good

‍

You have an important message to share, a message worth sharing. As you focus on crafting a referable speech, you’ll be able to earn much more than just positive session ratings. You’ll be able to build a sustainable speaking career.

‍

Now, that’s not to say all session ratings are pointless. Of course not! The feedback you receive from your audience can be invaluable in making adjustments to improve your speech. 

‍

Listening to the “loud few" who do fill out the surveys and share their opinions with you can help you better understand and connect with your audience. Many of the tweaks I’ve made in my speeches stem from repeat comments on speaker evaluations and event surveys. 

‍

But when taking audience feedback into consideration, you must do it logically and rationally—not emotionally. 

‍

To accurately analyze what feedback you should listen to and what feedback you shouldn’t, you must detach yourself from the session ratings. 

‍

They’re not about you. You are not your speech. 

‍

When you remove all emotion from the audience feedback and look at your speech objectively, with the sole purpose of improving it for your audience, you’ll be able to rationally and effectively use feedback. 

‍

So don’t let that minuscule percentage of ugly audience feedback get you down. You have important work to do. You’re changing the world! That’s no easy task. Not everyone will agree with you, and not everyone will like you—no matter how incredible your message is.

‍

Use session ratings as feedback to craft a referable speech, one that earns you referrals and propels your speaking business to new heights.

X Mark icon
Don't
Check mark icon
Do
X Mark icon
Don't
Check mark icon
Do
Education graduation cap black icon
Learn from
Andrew

HEROIC

Speakers

Learn how to give speeches that transform how people think and perceive the world. We’ll teach you how to write, perform, and get booked.
Learn more
X Mark icon
Dont
Check mark icon
Do
white space
Loading
Someone is typing...
Person icon
No Name
Set
Moderator
(Edited)
4 years ago
This is the actual comment. It's can be long or short. And must contain only text information.
Person profile icon with blue background
No Name
Set
2 years ago
Moderator
(Edited)
This is the actual comment. It's can be long or short. And must contain only text information.
Load More
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
Load More
white space