Quantcast
Subscribe!

 

Enter your email address:

Delivered by FeedBurner

 

E-mail Steve
  • Contact Me

    This form will allow you to send a secure email to Steve
  • Your Name *
  • Your Email *
  • Subject *
  • Message *

free counters

Twitter Feed

Entries in Ratings (6)

Wednesday
Feb152017

I know he has the title, but is he believable?

I'm sure you've seen reports of the numerous large and some high-profile organizations that are altering or outright scrapping traditional, ratings-centric performance management processes to move towards a more nimble, flexible, and frequently centered around coaching and development. More forward-looking as opposed to scoring the past as it were.

While the actual results of these new, 'no more ratings' performance programs have so far been mixed at best, it does seem likely that this trend will continue for a little while longer anyway. And one of the by products of these kinds of programs ironically enough, is the generation of more 'perfomance' data, not less, or at least more than in a traditional annual review process. In these new programs, check-ins, kudos, 'real-time' feedback comments, 1-1 meetings, and even micro bonuses or awards will be happening all year long, will need to be soted, assessed, and made sense of in order for these programs to deliver on their goals - namely improved business and individual performance.

I was thinking about this when reading about how one firm, Bridgewater Associates is taking this idea of high-frequency, real-time, and highly data driven approaches to employee performance and development to an incredibly detailed level. 

You should read the entire piece, but here is a snippet from Business Insider piece that sheds a little color on how the firm uses data points on 100+ traits to rate, evaluate, and assess their staff:

Every employee has a company-issued iPad loaded with proprietary apps. One of them, called "Dots," contains a directory of employees and options to weigh in on various elements of each person's work life, categorized in values, abilities, skills, and track record.

There are more than 100 attributes in total, but the collections of attributes are customized to roles in the company, in the sense that an investor's performance would not be measured according to the same traits that would be used to measure a recruiter's performance.

Employees are free to use Dots whenever they'd like, when they want to praise or criticize a colleague for a particular action.

The numerical value of these Dots is considered along with performance reviews, surveys, tests, and ongoing feedback and averaged into public "baseball card" profiles for every employee. The profiles get their name from the list of attributes and corresponding ratings, the same way a baseball card would list something like a player's batting average accompanied by a brief description of their career.

These are then brought into play in meetings where decisions are being made. Using their iPads, colleagues will vote on certain choices, and in the system of believability-weighted decision making, each vote will have a weight depending on the individual's baseball card and the nature of the question.

"A person's believability is constantly relevant," Prince said. "In a meeting, it is relevant to things like how you self-regulate your own engagement in a discussion, how the person running the meeting manages the discussion, and in actual decisions. At all times a person should be assessing their own believability so that they can function well as part of a team."

There's a lot to unpack there, and I am fairly sure that this kind of pervasive, detailed, transparent, and for many, scary, kind of performance/evaluation scheme would not work at most places and for most people. But I think there are (at least) two key features of this system that any organization should think about in terms of their own performance processes.

The first is that the 'Dots' app has the ability to collect, synthesize, and make sense of the many thousands of data points that are generated each year for every employee. So that these interactions, assessments, and bits of feedback are not wasted, or pass off into the ether shortly after they are created. In this way the firm continues to build valuable intelligence about its people and their capability over time. 

And secondly, this information is taken into account when decisions are being made. So that if you have built up credibility over time on a particular subject, your opinion or vote on issues related to that subject carries proportionally more weight than someone less experienced or believable on that issue, regardless of position or title. This data-driven approach to 'Who should we believe about this?' helps the firm guard against 'loudest voice in the room wins' trap that many organizations fall prey to.

Really interesting stuff and while maybe being a little too extreme (and disciplined) for most organizations, the Bridgewater approach to performance might give you at least a general idea of where we are heading - a place where every employee action, interaction, and decision is logged, rated, and contributes to their overall profile. And where that profile is taken into account when decisions need to be made. 

Good stuff for a Wednesday. Have a great day!

Wednesday
Feb082017

Over, Under, and Properly Rated #4 - Business Travel Edition

NOTE: My current favorite sports talk show is the Russillo and Kanell Show that airs nationally on ESPN radio. On the show, the hosts occasionally do a 'rated' segment where they categorize sports teams, players, and other aspects of sports and pop culture into one of three buckets. 'Overrated' for things they think are generally praised or valued more than they should be. 'Underrated' for the opposite - things that do not get enough attention or accolades. And finally 'Properly' rated, for the things that receive about the correct level of praise or derision.

It is a fun segment, complete with sound effects, and in the spirit of running out of good ideas this week, I am going to steal borrow for this site. So here goes, the fourth installment, of 'Over, Under, and Properly Rated' (SFB edition). I am going with a business travel theme this time, since I have been back on the road some after a January lull and also because I am pretty sure the world does not need another blog about employee engagement or robots coming for our jobs right about now.

So here goes...

Overrated

1. The fun places you will see! - Writing this from a hotel room in rainy, damp, dreary Cleveland. That is not a knock on Cleveland, you could substitute Newark, Pittsburgh, or Dallas and it would be pretty much the same. At least half, if you are lucky, of the places you will travel for business are places you'd never go to otherwise. 

2. Turn down service - Let me see, I had to jump to attention with a startling knock on the door so that someone could fold back the blanket a foot and a half and drop two milk chocolate squares on the night stand? No thanks. 

3. The hotel indoor pool - Unless you are traveling with kids under 10, you will never, ever dip a toe in the indoor pool. Can that room smell any weirder?

4. 'Comfort' Class - You just paid $59 more each way for 1.2 inches additional leg room. And one 'free' Bud Light.

5. Going out for drinks/dinner with the local staff - Usually fun for about an hour. Then the locals are all thinking 'It's Wednesday night, I have things to do at home, when can I get out of here?', and you start thinking, 'I had to get up at 3:45AM to catch my flight here, I am about to crash hard. When can I get out of here?'

Underrated

1. Hotel in-room coffee makers - You might take these for granted. You might even think the quality of the coffee is terrible, (it is). But tell me how much you enjoy that 37th floor city view room in Vegas until you realize that there is no coffee maker in the room and you're facing a 18 minute trek and a 23 minute long wait at the Starbucks in the lobby.

2. The chance that being around all those people in tight spaces like planes will make you very sick - The sickest I have ever been in my life was about seven or so years ago when I picked up the Swine Flu (remember that), after a quick two-day, one-night trip into NYC for business. I was knocked flat for 10 days, every muscle I had (not many) ached, and I don't think I got off of my sofa for more than 8 minutes a day. The illnesses you can pick up on a commuter flight to JFK are legion.

3. The Sky, Admiral's, Captain's or whatever Club you use at the airport - This is the best travel investment that any regular business traveler can make, (yes, I would rate it higher than TSA Pre-check). Just one bad weather night and a 7-hour layover in JFK or LGA will make the $500 or so annual fee worth it right there. And it seems to me that the Airport Clubs are all getting nicer, while almost every other aspect of air travel is getting worse.

4. Business/First class to Asia, (or anywhere else really far) - Another investment I would recommend, (even better if you can get someone else to fund this), is the splurge upgrade to Business/First Class for any flight you may have to take of 12 hours or more. Why? Because if you only take this kind of a flight once in your life, you will always remember it as the best flight you ever had. The last Business Class pod I had on a flight to China was bigger than my first apartment. And the food was much better too.

5. Frequent Flyer Status - Things get a little better with 'Gold' status. Things get better still with 'Platinum' status. But things get much, much better with 'Diamond' status. Which it is why it is so hard to get. And worth every stopover in Detroit instead of flying directly to Chicago that you have to endure. If you are just starting to travel for business, pick one airline and stick with it. Cling to it like grim death if you must. You want status.

Properly Rated

1. Room service - Pros: It's food that someone brings to your room after you make one phone call. And you can eat in your bathrobe and no one cares. Cons: Overpriced, usually mediocre food.

2. Rental cars - Pros: It is someone elses car! Let's do a neutral drop as we pull out of the Courtyard by Marriott! Cons: How do I turn on the headlights? Arghhh! That was the windshield wipers!

3. 'Local' TV/news - Kind of fun to watch a different city's local news shows to get a little bit of the flavor of the place. But tempered by the fact that local car dealers and personal injury attorney advertising is just as annoying on the road as it is at home.

4. The Hotel Gym - Often, you will be so bored and stir crazy in your room that you will work out more when you are on the road which is good. But, it is a hotel gym. You see some strange stuff in there.

5. Eating at Chili's, Applebee's, or any other place you can eat at that is within five minutes of where you live - Sure, you feel like a jerk for eating at a nondescript chain place. But, it probably saves you at least 27 minutes of scrolling through Yelp trying to figure out if 3.5 stars means the same thing in San Antonio as it does in Des Moines.

What do you think? Do I have it right? 

Is this post itself over, under, or properly rated?

Have a great day.

Thursday
Jan052017

Over, Under, and Properly Rated #3

My current favorite sports talk show is the Russillo and Kanell Show that airs nationally on ESPN radio. On the show, the hosts occasionally do a 'rated' segment where they categorize sports teams, players, and other aspects of sports and pop culture into one of three buckets. 'Overrated' for things they think are generally praised or valued more than they should be. 'Underrated' for the opposite - things that do not get enough attention or accolades. And finally 'Properly' rated, for the things that receive about the correct level of praise or derision.

It is a fun segment, complete with sound effects, and in the spirit of having lots of 'real' work to do in this first week of 2017, I am going to steal borrow the idea for this site. So here goes, the first in what may be a series if I remember to do this again, of 'Over, Under, and Properly Rated' (SFB edition). Expect a mix of HR, workplace, Tech, sports, pop culture, and whatever else comes to mind.

Overrated

1. 2017 Predictions - Yes, I am a little biased since Trish McFarlane and I just did an HR Happy Hour Show titled 'There are no new HR predictions', but nonetheless, 99.95% of the 'predictions' pieces you see about HR or work or technology are 87.95% worthless, and more or less a waste of your time. Stop with the predictions and get on with the getting stuff done.

2. Apple - leaving Apple on the overrated list again. Why? I just saw a Kickstarter project for a device to essentially replace all the MacBook ports that Apple decided you didn't need has been a runaway smash. What is happening with Amazon and Alexa reminds us (again), that the hardware is less important than the software and the platform. 

3. Work/Life Integration - As yesterday's post about the new 'No email after 6PM' regulations in France suggest, I think the notion that most people want 'Integration' or 'Fit' between work and not-work may be finally unraveling, at least some. it could be that many, if not most people, don't want to bring their work home, or on vacation, or on Thanksgiving. It could be we want to work hard, (when we are working), and forget about work when we are not working. Just because a few pundits try and tell you that 'Balance' is the wrong term and concept doesn't mean you have to believe it.

4. Company Culture - Important, sure. But not more important than Talent or Strategy. (A repeat from last time as well, I am going to keep beating this drum until, well, for a while longer anyway).

5. The New York Knicks - Just lost their 6th in a row. Moving them from 'Under' to 'Over' rated. Another wasted season seems more and more possible. Time to trade 'Melo. 

 

Underrated

1. Amazon - Fun Fact! Amazon was my #2 underrated the first time I did this post last summer. Why are they on here again, and now at the top spot? Because all the interesting news I heard this week from the big CES show in Vegas has been about Amazon and their Alexa operating system. They are into everything - enterprise cloud services, content, drones, spaceships, and now they are set to dominate AI and conversational interfaces. When was the last time you heard anyone talk about Apple's Siri? 

2. Electronic signatures - Been processing a ton of contracts, agreements, etc. lately and the lack of adoption of electronic signatures has been a major pain in the neck. I have had to print, sign, scan, save, then email I am not sure how many docs in the last month. So tedious. Let's all please move E-sigs up on the list of things to do in 2017.

3. A basketball hoop in the driveway/backyard - Had the chance to play a little backyard hoops over the holidays. Man, I miss having a hoop in the backyard. Goal for 2017 is to get one. And a yard. 

4. Email consolidation - In 2017, I have gone from 3 main 'work' email addresses and calendars down to 2. (I know I should only have one, but cut me a break). I already, three days in, have noticed a huge difference. AND, I cleared out my voice mail (finally). But please, don't leave me a voice mail.

5. The Rose Parade - It's is still fun. It is still a great tradition. It is still what helps you get over your New Year's Eve hangover the next morning. I am there in person next year.

Properly Rated

1. Tech M&A - Yes, it is that time of year when companies start acquiring other companies, doing mergers, or making 'acqui-hires'. These events are almost always met with breathless and excited coverage and commentary from industry pundits and observers. But the thing is, M&A, and Tech M&A in particular, is about a 50/50 proposition, (at best). Maybe slow your roll on how wonderful the next big M&A deal is going to be before the new company business cards are even printed.

2. Tesla - Probably not as influential and important (yet) as the insane amount of coverage they get warrants. They delivered 76,000 cars in 2016. That is 76,000 out of a market of over 17 million vehicles. Keep that in perspective.

3. Ad blocking software - Is it just me, or are more and more 'free' websites failing to load if you have Ad Block software enabled? Ad blocking is now only marginally effective, and thus, 'properly' rated.

4. The 'Process' - The mad scientist plan of former 76ers GM Sam Hinkie to rebuild the team by essentially losing almost every game for three seasons has swung from over, to under, and now has settled I think inot properly rated. But Joel Embiiid himself is probably underrated.

5. Snow at Christmas - Yes, it's pretty. Yes, it makes it 'feel' like Christmas. But by December 26 it is just, for the most part, a nuisance. I am angling for Christmas on a beach somewhere next year.

What do you think? Do I have it right? 

Is this post itself over, under, or properly rated?

Wednesday
Nov302016

When the feedback loops get shorter, the performance process can get ruthless

Quick foray into the world of sports, (Shock!), for a look at what can happen in an organization, and their view of what is unacceptable employee performance, when feedback loops, (or review periods if you like), get shorter and shorter. Kind of like what seems to be happening in many large organizations who are moving away from annual performance reviews/ratings and toward more frequent, regular, lightweight, feedback loops.

The back story is from the University of Oregon, who yesterday terminated their head football coach Mark Helfrich after four years in charge, (and four years as essentially the #2 person in charge), and a impressive 37- 16 win-loss record as the head coach. From the USA Today article titled Mark Helfrich's firing sends chilling message to coaching trade:

(After a loss to arch rival Oregon State), Helfrich met Oregon athletics director Rob Mullens to discuss his future Tuesday night and left the meeting without a job. Internal discussions about the football program began before Saturday’s loss, according to USA TODAY Sports. Since Saturday, Helfrich had been in coaching purgatory, with two feet straddling the line between retention and dismissal.

There is something far bigger than just Helfrich at play at Oregon, which in the past two decades has grown into one of college football’s elite programs. First as the offensive coordinator and then as head coach, Helfrich deserves recognition as a key figure behind the Ducks’ surge.

But this is about more than just Helfrich, and the reach of Tuesday’s decision extends far beyond Oregon.

If you’re a college coach, take note: If Helfrich can be fired after one losing season, two seasons after the finest year in program history, after coaching the program’s only Heisman winner, with an eight-figure buyout — so can anyone else.

A few things to unpack here, especially if you are not a fan of or at least familiar with some big trends in college athletics in general, and football specifically. The sport at its highest levels - think Alabama, Ohio State, Texas, and yes, even Oregon - has become a high-pressure, big-money endeavor for that set of 40 or 50 schools that choose to compete at that level. They invest enormous resources in facilities, recruiting, support staff, and they pay their coaches, especially head coaches, astronomical salaries.

And in exchange for making these massive commitments of the school's resources, the administration expects to recoup that investment in revenue from broadcast and cable TV contracts, ticket sales, donations, and whatever else they can get their hands on. But to maximize those revenue streams, the football team needs to win lots of games, consistently, and every year. And that is where the feedback loop idea comes in.

Let's take this back to the Oregon situation and the recently fired Helfrich. From 2009 - 2012 Helfrich was the Offensive Coordinator (the most important coach aside from the head coach) on teams that went a combined 46 - 7, including reaching the national title game in 2010. In 2013, Helfrich was promoted to Head Coach following the departure of former Head Coach Chip Kelly to the NFL and the Oregon team proceeded to go 11 - 2, 13 - 2, (with another national title game appearance), 9 - 4, before stumbling this year to a disappointing 4 - 8 record.

So in eight years in 'executive' level positions with the Oregon football program Helfrich had what amounts to one bad year, this past year when the team struggled, and had its worst season in some time. In the past, and really the not so recent past, university administrators would look at that kind of record and see what has been, largely, fantastic performance. There may be only 3 or 4 other programs in the country who have won more games in that 8-year span than Oregon. But, and this is a big but, Helfrich's (and Oregon's) worst performance in some time was this past year, and since Oregon's, (and probably lots of other schools as well), window for performance evaluation is compressing, Helfrich was let go.

Seven years, (with three as head coach), of impressive results. One 'not acceptable' year. And you're gone.

No probation, no warning, no 'performance improvement plan'. Just, 'Thanks for your service. Take care.'

Look, I don't feel that bad for Helfrich. He (and every other big time college coach), makes a ton of dough, and sort of gets that all of these jobs are pretty tenuous and often kind of cruel.

But why I think it is important to consider is that a few years ago Helfrich's performance and contribution to the success of the organization would have been assessed with a wider angle lens. He certainly would have in the past been given at least one more season to try and 'right the ship', and return Oregon back to its expected winning standards, (standards he himself had a large part in creating with his coaching).

But as the performance and feedback time horizon for college football coaches has contracted, 'What have you done for me lately?', then Helfrich's 'review' didn't really take into account, nor give him much credit for his efforts over his 8-year tenure at Oregon.

I think this same kind of compression is one of the potential dangers for organizations who are moving towards more frequent, and real-time performance management and coaching kinds of schemes as well. As these windows shrink from what typically was once per year, the opportunity for HR and business leaders to get subjected to recency bias is much more present. If we are all being evaluated much more often, the chances of any given evaluation to be negative are much higher - even for those folks who would average out to be 'good' or 'really good' performers when considered over a longer time horizon.

We all have bad days. Bad weeks even. Maybe a project we didn't really do the best with. But that may be one project out of 27 we wlll work on this year. In the past, one or two bad projects would more or less get lost in the wash of 25 other good ones. But when we move to a process that demands we assess performance pretty much all the time, then those one or two bad projects are going to stick out, be remembered, and probably carry more weight in the aggregate than they should.

Helfrich had one bad year out of eight. In today's world of college football that is enough to get you fired.

I guess the real question is how many bad days are you allowed to have in your job until you get fired too?

Friday
Aug122016

Over, Under, and Properly Rated #2 - Summer Olympics Edition

My current favorite sports talk show is the Russillo and Kanell Show that airs nationally on ESPN radio. On the show, the hosts occasionally do a 'rated' segment where they categorize sports teams, players, and other aspects of sports and pop culture into one of three buckets. 'Overrated' for things they think are generally praised or valued more than they should be. 'Underrated' for the opposite - things that do not get enough attention or accolades. And finally 'Properly' rated, for the things that receive about the correct level of praise or derision.

It is a fun segment, complete with sound effects, and in the spirit of running out of good ideas this week, I am going to steal borrow for this site. So here goes, the second installment, of 'Over, Under, and Properly Rated' (SFB edition). I am going with a Summer Olympics theme this time around, as I have caught just enough of the proceedings, (about 15 minutes a day), to render an authoritative evaluation of the spectacle and competition.

So here goes...

Overrated

1. Opening Ceremony - Too long, too much nonsensical blathering by the commentators, and what essentially amounts to the the most boring parade of people wearing funny hats you've ever seen. Is it fun to see a few recognizable superstars milling about with the rest of the interchangeable rowers and team handball players? Sure. But on the whole, the opening ceremony is terrible. And overrated.  

2. Rowing - If the entire sport consists of the activity you do to train for doing the sport, that adds up to a really uninteresting event. It really is not that far removed from watching a line of people on the treadmill at Planet Fitness. Side note: Ask the rower in your life about the classic movie, Oxford Blues sometime.

3. Zika, deadly, bacteria-laden water, crime - In the run-up to the Rio games, much of the reporting was frightening in nature. Zika virus carrying mosquitoes were rampant, the waters for some of the competitions were horribly polluted and unsafe for the competitors, and if you strayed too far off course, you were likely to be mugged, or worse. Aside for a few, seemingly isolated issues, the games (so far) have been executed well, more or less.

4. Judo - I watched one judo match. It lasted for four minutes, almost nothing happened, neither combatant scored a point, and the match was decided on the equivalent of 'yellow card warnings'. I've been at funerals that had more action and excitement.

5. Golf and Tennis - Probably should not be in the Olympics, or perhaps should take a page from soccer and become Under-23 events, or something like that. The top tennis players and golfers in the word are colossally wealthy, and the source of their wealth has never been nor will ever be winning a medal at the Olympics. When the very best athletes at a sport don't really want to show up at the Olympics to compete in that sport, it is probably time to have a re-evaluation of the entire event.

Underrated

1. Rugby - I caught a fair bit of both the Men's and Women's Rugby (in the Olympics it is the 'Sevens' format), and just about every game was exciting, fast-paced, and blissfully over in about 30 minutes. Rugby Sevens might become the next big thing. After Tikka Masala flavored potato chips that is.

2. Table tennis - Makes the underrated list as the top , 'I bet I could do that if I only had a couple of years to practice' Olympic sport. No, no, you can't. But it is still a really fun watch. Add a few red solo cups of cheap beer to the table and you have America's next great spectator sport. 

3. Archery - Makes the underrated list solely for one reason - the cool as hell bucket hats that most of the archers wear.

4. Javelin - Of all the 'throw this thing as far as you can' sports, the best has to be javelin. The USA would be better at this if the government hadn't banned lawn darts about 20 years ago. Lawn darts was how many an aspiring javelin thrower got their start as a 7 year-old. 

5. Fencing - A lot of yelling, a lot of slashing at people with a sword, and a lot of normal-sized people competing that gives you at least a hint of (false) hope that someday you might be an Olympian too. I am all about the Fencing.

Properly Rated

1. Men's basketball - Pros: Most of the teams have several, or at least a few NBA players, and the overall talent level and competitiveness of the games has improved. Cons: It still is a little dull to watch the USA beat some over matched team by 45 points. 

2. Swimming - Is it great as a USA citizen that we seem to win just about everything? Yes. Is it a little bit falling into Men's Basketball territory in that regard? Yes. And I hate the chlorine-heavy air that always seems to surround any indoor pool. And don't even get me started about what might be in that water.

3. Team Handball - Sort of relatable because it seems like a combination of sorts between soccer and basketball. Sort of not relatable because after about 3 minutes you have no idea what is really going on. The one game I saw pitted Denmark v. Croatia who were wearing similarly colored uniforms and it was impossible to figure out who was who.

4. Weightlifting - Would be on the 'underrated' list if not for the occasional gruesome injury. And it would definitely be on the underrated list if they somehow incorporated some of the classic 'World's Strongest Man' type challenges. It would be awesome if the Beer Keg Throw or the 'See how far you can pull a bus using a rope that you have to hold with your teeth' were Olympic sports.

5. Race Walking - Ridiculous to look at on one hand, but on the other hand weirdly compelling.

What do you think? Do I have it right? 

Is this post itself over, under, or properly rated?

Have a great weekend!