Skip to content
PodSubs
ShowsPeopleGuestsJobsNewsEvents
More
BlogPodCred
Menu
ShowsPeopleGuestsJobsNewsEventsBlogPodCredNetworksSign in
Join nowSign in
  • Shows
  • People
  • Jobs
  • News
  • More
    • Guests
    • Events
    • Blog
    • PodCred
    • Networks
    Join nowSign in

MSL Talk

From Interactions to Impact: How Medical Affairs Can Prove Its Value

Aug 12, 202532 minVideo
ShareXLinkedInFacebookWhatsAppEmail

In this episode, Tom Caravela is joined by Lusine Kodagolian to discuss how to measure the value of medical affairs. They explore the SMART framework, emphasizing its application in measuring scientific ROI and share of scientific voice. The discussion highlights the balance of various metrics and how to build a business case for SMART metrics, especially for smaller or early-stage companies. The conversation covers insights versus impact measurement and the implementation of new strategies. Consistency, trends, and feedback in metric analysis are underscored as essential elements. The episode concludes with actionable steps for integrating these strategies in medical affairs.

Audio and video play straight from the show's own hosting. PodSubs stores and serves no media.

Transcript

From the show.

0:01Hey, guys. Welcome to the podcast. I am very excited to have another, value discussion. I know that this is such an important topic for MSLs and for medical affairs. And I have Lucine with me. Lucine, welcome to the podcast. Are you excited? Very. Thank you so much for having me. I'm gonna let you let's guys. So the title of this episode is from interactions to impact, how medical affairs can

0:32prove its value. But, Lucine, why don't you do an introduction first so that you could tell everybody who you are, and then we can we can just kinda jump right into it. Okay. Thank you again, Tom. I am really excited to be here. I'm the founder of Cypherio, an AI enabled platform that helps medical affairs teams measure their true impact. My entire background is actually in measurement and communications and analytics. I've spent decades helping corporate communications teams at some very large

1:05organizations measure the impact of their work. And by very large, I that includes the Pentagon. I've actually spent a few years helping Pentagon measure their impact of communications, and it's actually an interesting story because it led to, as you can imagine, several very interesting projects and several very interesting rumors. When we moved to California, my daughter's friends were convinced that I'm a Russian spy.

1:39I didn't exactly deny it, but I found out about it from one of the parents at a drop off. So maybe quite interesting. Funny. You I could see that. I mean, you look the part. You sound the part. You get the whole thing down. I'm going with that. I'm gonna say I had a Russian spy on the podcast. Well, I'm I'm Armenian, so I don't even know where that came from. But somehow, somewhere, they they must have made that connection. Yep. But in all seriousness, I've spent much of my career helping teams move beyond vanity metrics and to measure their real impact, and that's what we're bringing to medical affairs and

2:17hoping to discuss here at this podcast. Well, the the one thing that I I think the reason I'm excited about this conversation, the way it's gonna be a little bit different is we are gonna talk about impact. We're gonna talk about metrics numb not metrics, but analytics and numbers and not, you know, measurement, not just concept. So but before we get into that, I do have a quick announcement. I wanna remind everybody to register for Fierce Pharma Week. It's coming up very quickly, September, and that's in Philadelphia at the Convention

2:51Center. This used to be Mass East. It's called Fierce Pharma week now. It's a much larger event because while it still has medical affairs, it also has PR and communications, business development and licensing, and pharma marketing. So there's there's different functional areas, which is kinda cool because it's a bigger event so you get to meet a lot of different people, but medical affairs is still its own its own thing. So for more information, go to Fierce Pharma Week.

3:22Just Google it. When you register, use the code MSLTALK, no spaces, to get 25% off. And I look forward to seeing you out there because I'm gonna definitely be there. So, definitely register. So, Lucine, let's get into this. Why do you believe medical affairs, has historically struggled to quantify its value, obviously, compared to commercial teams? Right.

3:53So, this is a problem that hits, several different depart departments, and I just mentioned corporate communications a minute ago. But the essential question is, how do you measure the value of roles that don't bring in revenue? As we know, from just our experience of working with medical affairs teams, medical affairs was not originally built for ROI tracking. It kind of evolved from that support function focused on scientific integrity.

4:25The impact of medical affairs, the way we see it, is often long term and indirect, which makes it very difficult to measure using traditional business metrics. Commercial teams have long had the infrastructure and this data driven mindset. Medical affairs have also operated with a different purpose, the commercial than commercial. Right? We, with medical affairs, we focus on advancing the scientific narrative, the scientific

4:57integrity, whereas commercial teams are built all around revenue and quotas and measurable outcomes. So to give an example, medical affairs can spend many, many hours. The teams can spend many hours meeting with KOLs, and, eventually, the result may, be the inclusion in guidelines, but that may take a couple of years. That's not exactly something that shows up on a pretty dashboard. Whereas commercial teams can very clearly say, we're in this campaign, and we saw this many

5:33and we saw an increase in prescriptions or, you know, this percentage change. So it's it's a little it's much more clear cut and easier to measure than what we see for medical affairs. The what's tricky about the work of medical affairs also, it's it's very subtle. You're helping shape the scientific conversation, the scientific narrative, supporting evidence generation. But, again, as I mentioned earlier, that's not something that you can easily capture in a

6:03dashboard. Yeah. Well and it's just I mean, it's it's so easy for commercial. There's like you said, there's just so many ways to track it. So how do you it's so hard to track it in the medical affairs world. It's it's not as as easily cut and dry because you can't just look at sales and say, okay. Well, we did this, and then that influenced the number of sales that we had. And there's the return on our investment and our time. So let's talk about when we talk about, some of the ways that MSLs are being tracked, like

6:42metrics, for example, would you say there's any unintended consequences of relying too heavily on what we see is a lot of activity based metrics, like number of interactions. Can we talk about that? Yeah. Absolutely. And on the surface, that looks great. Right? You capture how many meetings you had, how frequently you meet with your KOLs in your territory or HCPs in your territory. So, it's a great metric, again, on paper and on dashboards.

7:14But in essence, when you are only measuring these activity metrics, you are incentivizing volume. So instead of doing better, you are focusing on just doing more. And this can lead to this false sense of efficiency that, oh, we've had this many meetings, so we're doing great. But what if those meetings did not have the impact, the intended impact that you're trying to achieve? For example, let's say an MSL meet met with 50 HCPs in a month or a 100 HCPs, and that's what

7:51we see more often than not. But, again, what does that mean? Did these meetings lead to any meaningful change? Did the HCPs walk away with something that you can actually follow-up with and see whether it had the impact you intended? Where did they understand the key messages, the key data points that you were sharing? You don't know. Did you meet with the right people? Essentially, you're busy, but you're not necessarily sure if you're effective or not.

8:24The activity metrics also have a tendency to create this illusion of productivity. You show high numbers to leadership. They feel like the goals are accomplished. But in reality, as I said, it just creates its full sense of effectiveness and accomplishment when in reality, you may not have accomplished that. Now with that being said, there are certain territories that are it depends. Right? If you're in a smaller territory and you're earlier in the product life cycle, it makes

8:54more sense to focus on the number of meetings because you may not have access to top KOLs or top institutions. And so, therefore, the the frequency of meeting, the frequency of these touch points, the length of those meetings matters because you're trying to introduce a new concept. You're building awareness around the disease. And so the more meetings you have, the more beneficial it is for your team. So at the end of the day, I would say the balance is determined by your strategy.

9:26If you tie your metrics to your strategy, then the decision of whether you're focusing on quantitative or qualitative or what the right combination of the two is, it becomes a lot more obvious. Well, let's I wanna talk about like, let's let's get into that piece of it because I know when you and I spoke Mhmm. Originally, you had mentioned the SMART framework. So you have this SMART framework. Mhmm. Can you break that down for me?

9:56Like, so how can medical affairs apply the components of what your SMART framework is, and how can that help them meet their goals? Yeah. Absolutely. So the SMART framework is what the corporate communications teams adopted a while ago, I would say about fifteen years ago. And I don't mean all of the teams, but the ones that wanted to show real impact. Because, initially, all these teams were similar to medical affairs. We're measuring media impressions, numb the number of whips website clicks, number of

10:30visitors, how many press releases they issued. And while that looked great on paper, again, were all vanity metrics that didn't really show if they were accomplishing the intended purpose and if they were having the right impact. So they adopted what they call the smart framework, measurement framework. And the biggest advantage of this smart framework is that it forces you to be very clear and to break down the goal systematically.

11:01Essentially, if we walk through it, s stands for specific. And what that means is we need to be very specific about what we're trying to measure, what is the goal. I recently actually wrote a post about how this increased KOL awareness has become a go to metric for medical affairs teams, but it's not really a good goal. It's not a good good metric because it's just too broad to be measured. Instead of looking at, these KOL awareness metrics, you can be looking at things like

11:35message comprehension. So how many KOLs walked away with the key messages that you try to communicate to them, scoring how well they understand your scientific value proposition. You can look at behavioral indicator indicators. So how many KOLs or what percentage of KOLs in your target network is proactively reaching out to get more information or, how frequently they initiate contact versus you trying to set up meetings and follow-up with them.

12:07The impact measurement could be another good metric, which is basically understanding the scientific share of voice, the network effect. So there are a lot of metrics that you can choose from that are not just focused on awareness and that can give you a lot more clarity. M stands for measurable. So once you have the goal, you kind of have to ask yourself, how would we know that we are making progress on this goal? And in order to be able to do that, you need to have a baseline. So establish your baseline and then decide, what would tell you that you're making progress

12:43on this specific goal. A, achievable. For a nonpromotional function, this is extremely important. Obviously, you want to be compliant, and you also want to be realistic and appropriate. So can we truly achieve this goal, or are we being either too easy on ourselves or, you know, we're aiming too high and we'll never achieve that? R is relevant, so tying the goal to a critical business outcome.

13:16For example, is this message critical for differentiating in a crowded space? Does it directly support an upcoming launch? And if that metric doesn't or those metrics don't, then it's great to have them. They may look interesting, but they really don't accomplish anything. And then finally, the most important one, they need to be time bound. A lot of times, we kind of say, increase awareness of this, increase awareness of that, but there is no timeline attached to that. So you need to know if you're trying to do this within six months, within a year, within three

13:49months, whatever that goal is. So at the end of the day, it's it like I said earlier, it forces you to be a lot more clear and to look at observable behavior from HCPs as opposed to just tossing out some information and hoping it sticks. Got you. Okay. So let me unpack that for a second. So SMART framework is specific, measurable, achievable, relevant, and time bound. Okay.

14:20Right? We got that right? Yes. You got it. For those of you taking notes, just wanna make sure. And then so I wanna talk about and I'm gonna throw some buzzwords out because I took notes when we talked. But I want you to talk about the concept of scientific ROI Mhmm. And how share of scientific voice, which is a term I learned from you, provides, a more meaningful metric, than maybe some of the traditional MSL activity metrics.

14:56Right. Yeah. Scientific share of voice generally, share of voice has been a popular metric across all teams for as long as I have been in this field. But the scientific share of voice essentially asks a fundamental question of, are we advancing the scientific conversation in a way that reflects our strategy and highlights what makes our science different? The important thing when you're looking at this metric of scientific share of voice is is it is

15:31a lot less about teams medical affairs teams talking and a lot more about them listening and looking at whether their data shows up in critically important sources. So that could be peer reviewed journals, independent presentations in congresses. So you're you're trying to see if it's not just your team that's communicating the message, but it's else it's actually the field that is discussing it, citing it, or engaging with it.

16:03And scientific share of voice is one of the best ways to do that. So instead of, you know, counting how many meetings did we have, how many times did we met meet with this HCP, you are actually asking the question of, is our signs showing up in the places that matter? Mhmm. So to give you an example, let's say you're working on a novel approach in leukemia. If your target mechanism or the, you know, mechanism of action process, whatever it is

16:34that's critically important, starts shows starts showing up in these peer reviewed journals or presentations or, you know, wherever your HCP is appearing, then you know that your data is and and you know that your data is contributing to that growth. Now that's really impact, and that's something that you can share and take to your leadership. So then can you talk about how to track this Yeah. Concept? Yeah.

17:04It's, I think it a lot of people feel that it's very intimidating, but it doesn't have to be. It it really the easiest way the easiest place to start is within your own organization. Mhmm. You can talk with your competitive intelligence teams or publication planning teams. They may have things in place already. You can also work with external vendors. Obviously, they do this kind of bibliometric analysis if you have a budget for it.

17:38And then finally, the simplest way to do it is this manual review of literature that you can use PubMed for as a starting point. Let's say you do it every quarter. You set up your keywords. You set up your key messages. Ideally, you tag them to your brand, your competitor brands. And then you will inevitably start seeing over time how your share of voice is tracking compared to that of your competitors. So several ways to do it, and none of them are very difficult.

18:11Yeah. I was expecting a more complicated answer. Like, it was gonna be some like, but it doesn't sound like that. It sounds like there's tools and there's there's the ability to do this fairly simply. Yeah. It's it's all about, what kind of an appetite you have for it and what your budget is. But you really there are several ways to approach it just like you said. It really kinda pick your poison. Yeah. Just do something. Let's talk about the idea of message alignment ROI, which sounds very powerful to me.

18:49How do you evaluate whether KOLs are truly internalizing and relaying that scientific your scientific messages. We talk about that concept? Yeah. Absolutely. And message alignment, again, is another metric that is widely used with teams that are, as I mentioned earlier in the podcast, not revenue focused. Mhmm. In general, this entire smart framework really focuses on listening rather than talking.

19:24Mhmm. And for message alignment, you really want to it goes into whether the KOLs are taking your scientific narrative and actually relaying them. So after your scientific engagements, whether it's an ad board or a meeting at a congress or a one on one meeting, you really want to be able to measure and look at whether the KOLs are repeating your messages in their own words, in their own channels.

19:56It could be the conference slides. It could be their articles. It could be even their social media posts, which is becoming increasingly more important. Mhmm. If they're a guest on a if they're a guest on a podcast, that could show up there. So, you know, various channels to see if your messages are showing up. Now, historically, this has been one of the most difficult things to measure because it was very labor intensive. Mhmm. You had to have people kind of look set up keywords and then manually compare those

20:30keywords to the content and see what percentage is showing up. But AI has really transformed it, made it very, very, possible and feasible, and you can do it at scale. If it is well trained, to recognize your keywords and your key messages, it actually does an incredible job of capturing kind of how well these are resonating. So you can also do it through message audits if you don't have access to these tools,

21:02analyzing, again, whether KOLs are referencing, you you set up keywords, you set up alerts. And if you're they're not, then that's a feedback loop. You go back to the drawing board, and you kind of try to understand, okay. What is it that didn't resonate? Where do I need to bring more clarity? Am I meeting with the right person or people? So all of those are critical to understanding whether the messages are resonating with your target audience or not. Got you. Okay.

21:33So let's let's bring this back. What would you say is the the proper balance between your, the smart outcome based metrics and traditional activity metrics? Is is like, should one outweigh the other? I wouldn't necessarily say that one has to outweigh the other. If it is tied to your strategy, then it will it should create a balance between the two because

22:04I definitely don't want to dismiss the importance of activity metrics. Right? They give you this operational insight, help with resource planning, managing the team comp capacity, compliance reporting, which is incredibly important. So you still need to know how many engagements you're having and with whom and how frequently. But the outcome based metrics give you strategic insight and answer those critically

22:34important questions of are we advancing our scientific narrative? Are we differentiating ourselves among our competitors? I mean, I can give you an example. If I told you the team met with a 100 KOLs, then that would sound impressive, but I don't know if it's necessarily if it tells you anything other than they met with a 100 HCPs. But if I told you 50% or 10% or 3% of those KOLs or HCPs walked away with a clear

23:06understanding of our message, of our critical data points, and more importantly, they are able to share it with their own network, I think that's where you can really tell the difference and, you know, the combination of the two can be very powerful. Right. So let's let's so as I feel like as we're talking to medical affairs leaders that may be looking at some of these ideas and concepts to implement, What how can they create a and build

23:41a compelling business case for implementing smart measurements to gain leadership buy in for adopting this sort of system. Yeah. And and, again, it's a common problem. Right? Because it's not easy to if you again, you don't have that fancy dashboard that you can just walk in and show to your leadership. So the best way to do it is start speaking the leadership language.

24:12And as we know, regardless of the function, the leadership folk is what they care about the most are risk mitigation, efficiency, and strategic impact. So if you show how these smart metrics help the medical affairs teams have impact, then it's easier to get the leadership buy in. The the easiest way to do it is start simple. I always say don't don't try to boil the ocean.

24:43It's really not critical. What you want to do is pick one goal, pick one message, pick one, important area, and just start with that. And then if you build the smart framework around that one key area, and you see results, then take that to your leadership and kind of explain how that worked, where that worked, if that didn't work, why it didn't work, and then build from there. I think a lot of teams and and this is probably, something that needs to be addressed

25:16by leadership teams is that they should give their teams the ability to experiment, to fail even at times because you really can't learn if you're not failing. Mhmm. So having that leadership support is equally important. It's not just the team. It's not just on the teams to do this right. It's also on the leadership to encourage it and help kind of elevate this medical affairs function from a support function to a strategic partner. Right.

25:46So what about like, what advice would you give medical affairs professionals at smaller companies or companies that are, like, earlier stage? Maybe they don't have a lot of data. Yeah. It would probably be a similar advice. Start simple. K. You absolutely do not need a big budget, the fanciest platform, the most advanced AI capability to start measuring. Start with a basic Excel spreadsheet, PubMed alerts.

26:19Maybe throw in some chat GPT if you must. But, really, again, pick one priority message, one scientific narrative that's really important for that early stage product, and then start tracking where and how it shows up, if it shows up, whether it's in literature, KOL discussions, social media posts. And if it's not, how did you get there, develop that framework? You can also use the the surveys, which we know even smaller companies have the post engagement

26:49surveys. So include a question. What are the key two key takeaways that you took from this meeting? And then see if your, messages are showing up. I think smaller companies have the advantage of being, agile. They're not bogged down by the big pharma bureaucracy. So I would say use that nimbleness to your advantage and build from there. And how does all this differ from like, what are the what about companies that are out there and just like, well, we do insights gathering, and we just track everything through insights

27:22and just like, do you run into that a lot? Is that something that is a common notion amongst medical affairs teams? Oh, yeah. Oh, absolutely. Every team thinks they have great insights. But then when you try to actually measure impact using those insights, it's very difficult. And I think a yeah. They're not there because insights is such a broad term that again, a lot of people, teams think that activity means insight, but it doesn't.

27:56Insight needs to deliver information that can be used for further analysis. If you just say, I met with this person, and I shared this information with them, that can be used. There there's nothing in there that can lead to, an actionable I mean, it's an overused term, but, it needs to be actionable. You need to be able to do something with that insight. Yeah. So yeah. A lot of teams have a lot of insights, but very little that they can work with to impact the

28:27strategy. Yeah. So let's just say alright. So the folks that are listening right now, let's say someone says, alright. I'm in. You got me. Lucine, you you you used your your Russian spy tactics and convinced me that I need to change my metrics? Like, where do they start? What's one piece one thing that they can do this week that can point them in this direction? Yeah. I would say pick one scientific message and ask yourself, how will we know if this message is

29:02being understood and adopted by the people that we're trying to reach? So that's the easiest way to start. How will we know that we're making progress? Then use the smart framework that we talked about a little earlier in the podcast to break down that understanding, the indicators, the key indicators along the way that will tell you whether this message is being understood and, more importantly, disseminated by your key HCPs

29:33or your KOLs. Even just honestly, even just starting that conversation changes the mar mindset. It is less about building a perfect framework and following everything to the tee and more about getting into the habit of thinking strategically. I used to tell this to my you mentioned the Russian spy, but I used to tell my Pentagon clients that the data doesn't need to be perfect.

30:04The data doesn't need to be super clean. If you do this consistently and over time, you will see trends. I promise you that. There is just no way that trends are not going to appear. So start somewhere, keep it consistent, do it over time, and then learn from it. Because it's a critical feedback loop whether you're successful or not. It's something that forces you to dig deeper and truly understand whether you're making an impact.

30:34And if you are not, then what you need to do to have that kind of an impact. Yep. That's that's that's, like, great life advice too. Start somewhere, be consistent. If you could do those two things, you'll be successful at least in some capacity. Well, Lucine, thank you for for sharing this interesting this is like a new take on this conversation. So I appreciate you sharing these insights with us. Thank you so much time Tom. Sorry.

31:04It it was great. I really enjoyed speaking with you. And, yeah, it's my favorite subject. So Yeah. No. You could see you're passionate about it. Awesome. Yeah. Well, thank you. And, guys, thank you all for listening. Thank you for your support of this show. If you got value in this, please share it with others, And don't forget to, engage on LinkedIn. So if you see the announcements out there and you wanna make a comment or or message me on something, I always love to hear from you guys. See you next time, guys. Thanks. Thank you, Tom.

Open the transcript file

Hosts and Guests

Nobody is credited on this episode yet.

Credit the people on this episode

Be the first to rate this episode

More episodes

All episodes
  1. The Wrong Voices: How Bad Mentors Can Ruin Your Career

    Nov 17, 202628 minVideo

    What qualifies someone to influence your future? Tom Caravela explains why career guidance should be filtered through relevant experience, current knowledge, credibility, and objectivity. He examines the risks of...

    Listen to the audio

    Credit the people on this episode

  2. Hidden Secret to Career Happiness and Longevity

    Nov 3, 202635 minVideo

    What turns an industry contact into a long-term ally? In this episode, Tom Caravela and Ed Doherty look beyond transactional networking to the genuine friendships that can shape a career in medical affairs. They discuss...

    Listen to the audio

    Credit the people on this episode

  3. How to AI-Proof Your Career: The 4 Pillars of Career Success

    Oct 20, 202623 minVideo

    Becoming undeniable is Tom Caravela’s answer to building career security in the age of AI. He breaks down four pillars you can control: skills, experience, relationships, and brand. Tom explains how continuous learning...

    Listen to the audio

    Credit the people on this episode

  4. How Medical Affairs Influences Decisions that Matter

    Oct 13, 202638 minVideo

    What happens after an MSL submits an insight? In this episode, Tom Caravela and Cameron Tew examine how field observations create value only when organizations decide what to do next. They discuss shared definitions,...

    Listen to the audio

    Credit the people on this episode

  5. Stop Being Your Own Worst Enemy

    Sep 29, 202619 minVideo

    In this episode, Tom Caravela discusses common mindset traps that can hold Medical Science Liaisons and aspiring MSLs back. He covers how to move past worst-case thinking, overanalysis, concern about others’ opinions,...

    Listen to the audio

    Credit the people on this episode