Depending on how many Playbooks you have, this might be an easy task or not. It also really depends on what types of playbooks you have and you want to assess. What I would recommend is to first organize your playbooks into the different categories: opportunities, risks, lifecycle.
Lifecycle Playbooks
Lifecycle playbooks are things that occur during a customer’s lifecycle at a particular point in time. For example, post-sales, they might start off with an onboarding or kickoff playbook. And post-onboarding, there might be a QBR playbook that fires every 3 months.
What I have typically seen customers do is assess wether these playbooks are firing at the right time and whether or not they are being completed. To evaluate these types of playbooks, I would recommend 3 reports:
- All customers and their start date
- All completed or incomplete lifecycle playbooks
- All Timeline Activities
What you will want to analyze is the timeline of activities across your key accounts. For example, if you expect to have a BR with high touch customers every quarter, then there should be an associated CTA. I have used Excel formulas and pivot tables in the past to do this analysis.
Risk Playbooks
These types of playbooks, as Heather mentioned, are for issues like loss of a champion, reduction in usage, no logins in a number of days, customer was just purchased by another company, etc. These are for risks that will impact adoption, retention, and potentially expansions.
As Heather mentioned above, you will need to architect a system to track the CTA, the CSM’s action taken, and the expected impact on the metrics. For usage, this a bit simpler. You can compare what usage looked like before and after the CSM action was taken to assess whether it was effective.
For items like loss of a sponsor, you will likely need to get a bit more crafty. I typically compare usage and you can compare renewal and expansions over time. If there was no change in usage and no impact to renewals or expansions opps, than the playbook was likely successful.
Opportunity Playbooks
Opportunity playbooks are often used to track expansions (CSQLs) and adoption promotion activities. For example, your customer might have a new division of employees who want to use the software. There may not be an upsell because they don’t need any new licenses, but nonetheless, this is an opportunity that you will want to track in your Cockpit.
To assess how effective this playbooks are, you will likely need to follow each process and compare data along the way. For example, if you want to assess CSQLs playbooks, you can pull reports of all the CTAs and associated expansion opportunities to see how many converted, the time it took to convert them, and how effective these campaigns were. For this analysis, it is very similar to analyzing a sales pipeline and understanding the time it takes to complete an sale and your conversion rates at each stage.
Hope this helps provide a bit of a framework to get started on this initiative. Its a bit of work to get started but once you have a framework up and running, it will be much easier to analyze this in the future.