Paired Metrics

https://mattyford.com/blog/2014/6/11/paired-metrics
https://www.youtube.com/watch?v=6fQHLK1aIBs
http://startupclass.samaltman.com/courses/lec14/

One important concept is pairing indicators. Which is, if you measure one thing and only one thing, the company tends not to optimize to that. And often at the expense of something that is important. Cost is example of payments and financial services is risk. It's really easy to give the risk team the objective and say, we want to lower our fraud rate. It sounds great. Until they start treating every user in this audience as a suspect because they want to lower the fraud rate. So they require each of you to call them up on the phone and give them more supplemental information and fax in things. Then you have the lowest fraud rate in the world, you also have the lowest level of customer satisfaction score. What you want to measure at the same rate as your fraud rate, is your false positive rate. That forces the team to actually innovate. Similarly, you can give recruiters metrics around hiring. And guess what? You will have a lot of people come in for interviews. But if you are not tracking the quality of interviewers, you may be very unhappy about the quality of people you are hiring and giving interviews to. So you always want to create the opposite and measure both. And the people responsible for that team need to be measured on both.


Comments