Every marketing team wants attribution. But weirdly, it's often not that satisfying when they actually get it. I led many multi-touch attribution projects as a consultant, and we got really good at implementing tools, creating taxonomies, and making sure that data was clean. But I found that when you actually showed these reports to a C-level executive, it was usually kind of underwhelming. The data didn't always pass the common sense test. Today's guest thinks there's a better way - Marketing Mix Modelling. It's basically the application of mathematical techniques to model relationships between different variables. However, technology now enables it to happen faster and more cost-effectively than ever before. Thanks to Our Sponsor Many thanks to the sponsor of this episode - Knak. If you don't know them (you should), Knak is an amazing email and landing page builder that integrates directly with your marketing automation platform. You set the brand guidelines and then give your users a building experience that’s slick, modern and beautiful. When they’re done, everything goes to your MAP at the push of a button. What's more, it supports global teams, approval workflows, and it’s got your integrations. Click the link below to get a special offer just for my listeners. Try Knak About Today's Guest Mark Stouse is CEO of ProofAnalytics.AI. With over 26 years of experience in marketing communications and strategy, he has a passion for transforming GTM performance with data-driven insights and agile decision making. Prior to founding Proof, Mark was CMO at Honeywell Aerospace, CCO at BMC Software, and a marketing leader at Hewlett Packard Enterprise. https://www.linkedin.com/in/markstouse/ Key Topics [00:00] - Introduction [01:15] - Clarifying the acronym “MMM” [02:39] - Mark’s background and how he founded Proof Analytics [07:57] - Limitations of multi-touch attribution (“MTA”) [14:16] - How MMM avoids the shortcomings of MTA [16:42] - The Fischer Price definition of MMM [19:56] - Demand vs. brand investments and their impact [24:09] - A/B vs. multivariate regression [25:21] - MMM is aggregate modelling, no reliance on PII [27:12] - Simple explanation of multi-variate regression [30:29] - Incorporating third-party data sources [31:48] - Historical ROI vs. forecasted ROI [32:52] - Is MMM just for enterprise? [34:51] - Marketing as a non-linear multiplier [38:02] - Getting started with MMM [41:18] - Updating models to include new data sources [42:07] - Competition in the marketing analytics space [44:41] - B2C marketing is more advanced in usage of multi-variate regression Resource Links Proof Analytics - Official Site Econometrics // Lecture 1: Introduction Learn More Visit the RevOps FM Substack for our weekly newsletter: Newsletter
Audio and video play straight from the show's own hosting. PodSubs stores and serves no media.
Transcript
From the show. Tap a time to play from there.
Justin Norris: Every marketing team wants attribution. But the weird thing is that it's often not that satisfying when they actually get it. I did a lot of multi-touch attribution projects as a consultant, and we got really good at implementing these tools, technically creating taxonomies, making sure that data was clean. But I found that when you actually show these reports to a c-level executive, it can be kind of underwhelming. They don't always pass the common sense test. People want to pick on details, and maybe that's because the idea of dividing up an
opportunity like a pizza between different touch points isn't actually the way. Maybe that's not going to give us the answers we need, but where does that leave us? Because we still need to know what's working in marketing, and today's guest thinks there's a better way, and he's founded a company to make marketing mix modeling or MMM available to B2B marketers and he's gonna tell us all about it. So I'm super excited to welcome Mark Stouse, CEO of proof analytics to the show. Thanks a lot for being here, mark Mark Stouse: Hey, thank you so much.
Justin Norris: Mark, maybe one clarifying question. I've seen MMM, spelled out as media mix modeling and marketing mix modeling, which is the right way from your point of view? Mark Stouse: actually. It really represents the evolution of it over the last say, 40 to 45 years. Back when Procter and Gamble first brought out what was then called econometric, I. Analysis it was advertising. that's what it was really all about, hence the media mix modeling reference. As, time moved on channels proliferated, it became still very much within
kind of B2C a reference point. It became marketing mix modeling. Today it is really go to market mix modeling because it includes not just marketing data and channels and investments and all that kinda stuff, but. Sales and customer success and product data outside data externalities, you know, the economy, your competitor actions, really is today much
broader canvas as it should be. Right? That's the long and the short of why people say that MMM means media mix modeling or marketing mix modeling. And actually both of 'em are kind of A little bit passe today Justin Norris: Maybe let's take a step back before that and talk about what was your professional experience leading up to founding proof analytics and what brought you to this direction? I. Mark Stouse: So I was actually pretty much a classic marketer and communicator.
I've worked across all of the different subsets of marketing at one time or another, and I've been a large company, CMO, . About a little less than 20 years ago I was at HP and we were all kind of in the middle of an existential crisis because the then CEO of hp, mark Hurd was a very Operations focused and a very customer focused CEO. And he wanted to know why there wasn't more evidence of what marketing was
actually delivering to the company. It was actually incredibly unpleasant. And about the only good thing that I can say about that whole experience that I had and that other peers of mine had was that it was, was highly motivating to change. I kind of got to a point where I said to myself, look, I either have to do something to fix this or I just need to like go do something else, 'cause it's not just about budget issues and all that kinda stuff.
It's about credibility, am I actually doing here? So in my particular case for whatever reason, herd gave me a project. To actually see what could be done to resolve this. And I didn't know Jack at that time about analytics. I was not even a math enthusiast, and and so I, I remember I went home that next Friday I went through all the stuff in my garage.
. And found a couple of old math textbooks from university and started to read them in ways that I never read them when I was in school. ' cause I was actively seeking an answer and all of a sudden I got to this and it was all about multi-variable regression. Which is absolutely the cornerstone of causal analytics ? It is the cornerstone of the scientific method of inquiry. It has so much credibility that, it'd be hard to have more credibility
than multi-variable regression has. Not because it is perfect, but it is absolutely the best that we have. And today, is actually the bedrock of causal ai. So I started working on this project for Herd, and he liked it a lot. And I guess my prize was he set up a mentoring session. With the CFO of hp, Bob Leman.
The whole idea was, I want you guys to talk you from your end and he from his end and see if we can't get to a meeting of the mines between marketing and finance. This whole experience it just changed me. And before he passed away, I had the opportunity to talk to Mark again and thank him for it, right. Because it was, not fun at all, but he did me the hugest favor. So I started climbing the analytics ladder, right?
The stairway to heaven, so to speak. Right? By the time I was CMO at Honeywell aerospace, pre any kind of automation for analytics, right? meant we had to hire a ton of people in order to get the latency on the recalculation down, the scalability up the cost be damned at this point, right? 'cause it was so important. And get the understandability of the outputs to the point where the business goes, yeah, I not only get it and believe it, but I can make a
better decision today than I could make before as a result of this. And then you kind of say, there's not very many companies that are willing to invest seven, eight, $9 million a year just in marketing analytics particularly in B2B. That point you start to realize that, that automation was gonna be absolutely indispensable. To solving the underlying root problems, if Data science has has a number of major problems in the business context, but they can kind of be summed
up by the fact that it's too slow. So by the time they get you the insights, everything has moved on, you've already had to make the decision. The information is not comprehensible many times by normal people. it's not scalable. So you end up with three or four mega models that get updated once, maybe twice a year. And so not agile, right? But big opportunity to appropriately automate and bring ai into that
whole thing and really elevate all of this to a new level of accessibility and meaningfulness. And so that's why we built proof. Justin Norris: And so I want to contrast MMM and regression based analytics that you're describing with. What most B2B marketers are probably familiar with, which is multi-touch attribution, that's what pretty much everybody does today. What is the problem with this form of attribution from your point of view? Or is there a problem? Is it still okay? Can they be complimentary?
Mark Stouse: as long as it's accurate data, there's absolutely nothing wrong with having a really good understanding of the customer journey, patterns in the customer journey, things like that, right? And indeed, a lot of our customers will include customer journey data in regression models. It's valuable. The problem is that it is not fit for purpose for what it's being sold to do. We can just start with the idea of bias.
There's a lot of bias in that data. There's a lot of bias in the weightings of that data. So marketing teams set their own weightings in advance. It is antithetical to the mathematical principles, to say that you can use MTA data to optimize anything. Particularly spend Justin Norris: I just want to unpack that to understand why Mark Stouse: mTA data is an effect. You're measuring an effect.
not capturing. The cause of that. And more specifically, the time lagged cause. So how are you going to optimize the money that you spent the past at this point, based on what you think you're seeing from effects in the present when you have no idea what the time lag is? Right? So there is this assumption, that the time lag is near zero, but that's just so not the case. Mm-hmm.
I B2B, the time lags can be extensive. What do I mean by extensive? Two, three quarters. we get into brand investments, it's double that, exactly are you optimizing and how do you know which part of your budget back in time you needed to optimize based on this effect in the present? Right? Justin Norris: If we take an MTA scenario, just to make it like a little bit more clear, let's say we have an opportunity and we have three people in the buying committee that are part of that opportunity.
And between those three people, there were sacred brown numbers, 30 different touch points that they had with different marketing initiatives. And those could be like, they downloaded eBooks, they attended webinars, they clicked on ads. And so the, traditional way is like, we're gonna take those 30 touchpoints and we're gonna take that opportunity. Let's say it's a 3 million opportunity, and we're just gonna divvy it up. And the way that we divvy it up could vary. We may pick some touch points, is being more influential or not influential? And I totally agree with you there, that it's kind of like arbitrary that they give you different models that you can choose from and it's like, pick
the one you want, like on what basis? Mark Stouse: I don't think that marketers understand how transparently untrue the premise of MTA is to everyone else but them. Justin Norris: I wanna get to the reality of the situation because this is the, the industry that we're in. Mark Stouse: The reason why it went through adoption is that most. Marketers don't have enough knowledge of math to be able to recognize
when something doesn't work. And number two, it was presented to them as a way of mining data that they already were generating in their stacks. So it was easy in quotes, right. To do this. And I've been around it long enough and talked to enough marketers about it, everybody was shocked when they went into their first meeting with MTA data, Thinking that they were just gonna be greeted as conquerors
and victors and to your earlier point at the top of the show, right. It was anything but that. it was very innervating for a lot of marketers. You can actually do it in Excel if you only have to do it on a very limited basis. But if B2B would just adopt B2C analytics and also I would just add market research priorities they would see a very rapid transformation of their credibility and
their precision and everything else. And. can always modify it as needed, but the core principle is ready to go and has been a very long time. Justin Norris: So if I recap your perspective as I understand it, touch points, the customer journey data, what the person did and when that can be interesting, that can be valuable. The notion of then doling out credit to those touch points for revenue outcomes, not mathematically, statistically defensible. Mark Stouse: would just add this, right?
MTA at the end of the day is about pattern matching. It's about identifying large scale, repeating patterns in the customer journey. And then the assumption is that if a bunch of people are doing the same thing over and over again, it must be causal. That is a complete fallacy, the same math is used for example, and in fact, pattern matching too is used to study climate change. Some are causal, some are absolutely not causal.
They happen all the time, but they don't mean anything. You can't just assume that because, a thousand people do it. Okay. One of your channels, one of your feedback loops, you know, it just keeps happening that ipso facto means that it's causal. Justin Norris: I've always had this unease as well where you a great example from earlier in my career, we had a self-serve SaaS app, what would be called product led today. And everybody that signed up for that app got a welcome email.
So from that point of view, if you're looking at touchpoints, like the welcome email is very influential. It's very important but, but everybody got it. So just because people got it and some people opened it doesn't mean you could necessarily infer that that was driving the outcome in a particular way, . So everything we've been discussing is kinda like the current state. Let's contrast it now with MMM and why does it not have these different shortcomings that we've described? Mark Stouse: Number one, let's start with the shortcomings that it does have, right?
It is very dependent, as is every analytic of any kind. Very dependent on data quality, There's that old saying about gigo, right? Garbage in, garbage out. Everyone is going to be victimized by gigo equally. Beyond that though. It has a lot of major advantages. It is a lean data mathematical process. So you do not have to have big data or even a lot of lean data order
to run these models accurately. And that is actually a huge factor. One of the things that CDOs chief digital officers or data officers are grappling with right now on private LLMs is that they big data stocks. They don't have enough training data and they don't have enough operational data to run private LLMs. Everyone's been so understandably fascinated with what they can do with public LLMs that they haven't really thought it through in terms
of the limitations on private stuff. Right? regression does not have this problem. If you say, oh, I don't have enough data to run regression analytics. not even remotely able to do any kind of ai. And I think that a lot of c-suites now Are starting to say, your creation and maintenance of a high quality data pool that's relevant to your function is a core competency. And if you tell us that you don't have the right data, you don't trust your
data that's on you, The other thing is you have to have some basic capability on the human side of the equation. So with proof, for example, we have simplified the whole thing, dramatically. Automated it significantly in the right places. you don't need a full-blown data scientist to run it. You need a competent data analyst and you really don't even need that person full time. That's probably a half FTE, right?
Justin Norris: Could we give a Fisher Price version definition of what MMM is like, just so people can conceptualize it in their minds. Mark Stouse: we live in a multi-variable world there's tons of potential causes everything that you control and everything that you don't control. That's kind of a really super easy way to bucket it. And these all have interactions with each other across time and space that produce particular outcomes.
Causally speaking this is a probabilistic calculation. So outside of certain physical laws like gravity, There is no deterministic outcome that's possible to determine, right? You'd have to know everything that there is to know about what contributes to a particular outcome to get to a deterministic answer. That's just not the way that operates, particularly when you're talking about human behavior. So this is the same math that's being used routinely to study climate
change, to study epidemiology. To study economics, it captures time lag. So in the end, the report will tell you historically the stack rank of everything that you control and don't control, that's in the model. It's relative effect on this outcome. It will then forecast all that into the future so that you can then make different choices. And because of automation, we've sped that up to the point
where you can run multi-variable regression exactly like GPS. say that you're recalculating the model every week, new data comes in and is presented to the model automatically, it automatically recalculates. And you see how the present now is comparing with the forecast that you have for the same period. if there's a growing delta, right? You see, hey, okay, I need to make some changes. Stick with the GPS analogy.
need to reroute. Or man, this is great. It's just totally tracking. And it will tell you how long, longer it's going to take for you to reach your objective, your goal, your destination. So there's a countdown. Regression is a huge part of the actual GPS that's on your phone, you use every day. And if you stop and think about it for a second, most business questions, and indeed a lot of life questions are navigation questions. Where am I?
Where do I want to go? What's the best way to get there? I have enough time and resources to achieve my destination? Am I gonna run outta gas before I get there? I gonna run out of time before I get there? Am if I have to be there at nine o'clock for a meeting? And the GPS says, you're not getting there until 11. gonna have to make some choices, that's part of it. also captures all the headwinds and tailwinds that may be speeding you up or slowing you down.
So in many ways, it it gives you the answer to your questions. Justin Norris: Take a practical example along the lines of one of those questions, let's say a company spends a hundred thousand dollars a month on display ads as an act of faith because those can be notoriously difficult to track. They're not always resulting in a click, but they could have impressions that could have an impact. So they're spending that a hundred K month over month, and the CFO challenges the CMO and says, why. Are we spending this 100 K every month?
What's it doing? And that's the question the CMOs trying to answer. How would MMM, like what does it compare that spend versus a particular outcome? And try to show a causal relationship between them. Mark Stouse: yeah. Multiple variables, right? So it's highly context oriented. All of these models are. Seek to capture as much of a known context as possible. what a lot of marketing teams figure out using exactly that scenario,
is they've been trying to justify that display ad budget in terms of demand gen, in terms of, performance marketing, And that is just not the way that that typically plays at all. That is a brand reputation investment. know, you kind of think about marketing expense as being essentially two big chunks, right? Branded demand brand is easily two to three times time lagged in its effect.
Than demand is. It also sticks around a lot longer. The effects of brand investment doesn't deteriorate very quickly unless there is a major scandal of some sort, something like that, that all of a sudden breaches the trust wall. But absent that right, it hangs around The halflife is quite extended, whereas the Halflife on demand investment is highly perishable. Lasts maybe a couple months and then it's gone, so the snows melt
a lot faster with demand than brand. You have to then say to finance, never discussed time lag with you before specifically, but we all know. That marketing takes time to have an effect. That simple statement is insufficient because if we don't know the time lag, we will never know. The ROI, so we now have the ability to say that this investment over
here doesn't really drive demand, doesn't really pay off on this side. There isn't a quick return a demand perspective, but from a brand perspective, this is how it is improving average deal size and average deal velocity. Those are the two big ones that we see again and again on brand investment. It is grease on the wheel of the deal. That's what brand reputation really is, right? It makes people buy more than they otherwise would and buy
faster than they otherwise would. that That is key in B2B because it's a higher cost, higher risk by decision to begin with. And then today, if we layer in all the risk factors that people are worried about it's even more important,? I mean, If you really want to understand how trusted you are by your customer base, look at your average deal velocity. If you really want to understand how confident people are in your product's
ability to generate massive amounts of value for them, look at their average deal size, particularly year one, right? Certainly year two, your, a lot of people, just as a matter principle today, are buying small in year one and testing it out. If you see a major uptick in year two and deal size, that is a major vote of confidence in you. you don't, you need to really find out why that is.
'cause I guarantee there's a reason. Justin Norris: Looking at our example, let's say the dataset that you had, the company had always been running those display ads. Do you need a period where those display ads are not there in order to demonstrate the impact of having them or not? Or is there a way, even though they've always been there, to somehow demonstrate the impact that they're having? Mark Stouse: I think that the answer to that question is very much contextual. if we were talking about a correlation analysis, meaning this ad buy right
against revenue, Then yeah, you would definitely need some interruptions to be able to essentially create a Justin Norris: Oh, control, that's the word I was looking for too. Yep. Mark Stouse: If you're talking about multi-variable though, where a lot of things are changing all the time around it, it's not necessary that's actually one of the things that's really, really cool about MVR multi-variable regression is that because you're bringing in so many different variables and because everything changes, particularly the stuff that you don't control you're gonna
see exactly what you're talking about. You're gonna see implicit AB test. Evolving across time. Justin Norris: We're talking about limitations. And one of the things we're talking about was being an aggregate versus tracking individual users. Mark Stouse: Yeah, so one of the things that's really important to say about multivariable regression slash go to market, mixed modeling, et cetera, right? Is that it is looking at all the causal relationships in aggregate.
So it's not possible to say that all these things cause this one identified person to take the steps that they took. That's not what go to market mix modeling is all about. It's about looking at a population wide trend that's causal for a lot of people one of the things that companies really appreciate though about this is that. There's no PII in proof or in, a regression model.
So you don't have the security concerns that you would have in MTA or any of the other touch based approaches, which are trying to tie. Broad investments, programmatic investments to impact on a particular human being or particular company. And to do that, you have to pierce the veil on identity. And that's a problem. Justin Norris: So it's looking at the big picture. So cookies, not an issue, GDPR, not an issue.
It's really comparing bulk data sets and the Mark Stouse: In fact, the only GDPR thing that we ever have to encounter is the login information for users of proof. So we keep that secured, But in terms of the data that's in the computations, it's a non factor. It's just non issue. Justin Norris: Is there a way to explain that multi-variate regression to someone who maybe they've got high school math, first year university
math, 'cause maybe that's a challenge. As you said, marketers, some of them are more quantitatively oriented. Not all of them are. And they're gonna need to trust, this data, so they'll need to be able to make sense of how it's produced. You know, If it's just a kind of computer and it spits out an answer like, yep, do X or do Y. Mark Stouse: They're already effectively thinking in this way because they're spreading out their investments across all kinds of different channels, So they're acknowledging the multi-variable world in which they live. What they are not necessarily acknowledging is the fact that it's not
a list of one-to-one correlations, My investment in display ads versus revenue, my investment in social versus revenue, my investment here versus revenue. That's not it. It's a tapestry that weaves back and forth with different time lags associated with hmm. Literally the only way capture that is with multi-variable regression or econometrics or, marketing mix modeling, go to market mix modeling, right there, it's all the same thing,
Justin Norris: the fir, the first thing that you mentioned Is what we're conditioned to look for. Like we were conditioned to say like, I invested a dollar here and it produced two, like these definitive statements. I think if I'm interpreting you correctly, you're saying reality is not that straightforward most of the time. Mark Stouse: The final output can be that straightforward. Okay? But the causality elements on it, are going to vary with the wind, so a great example of this is uh, Johnson Controls, right? So even before Covid really became a story, uh, their analytics started to
say in terms of forecasting, right? for reasons we don't understand. All these different channel investments that we have historically made are showing that they're not gonna be as effective in six months as they are now. A lot of these were physical events. , this was not due to marketing data in these models. This was all about external data was already up these early signals, they decided, you know what? We are gonna fly by instrument.
We're not going to fly by what we can see. And so they started removing investments early a lot of these things and they were able to claw back quite a bit of money. And then all of a sudden, real life proved the analytics accurate. And so they were very happy about that. And then finance came later and said, Hey, so sorry, we're gonna have to cut you. 30 or 40%. I can't remember exactly what it was, but it large. And they said, let us show you something.
Right? And they modeled the effects of those kinds of cuts over the next three years, and it was so detrimental to the business that finance took a lot less and went elsewhere to get whatever they needed, right? So this is an example, not only of how a marketing team used it to avoid waste, but also to avoid cuts that would be ultimately bad for the business, Justin Norris: and the sort of external data you just described, those are things
that's not specific to any one business. It's common to the macro environment that many businesses are working in. Like if I come to you, do I need to bring that external data on my own? Or do you have sort of global external data that you can match up with my business specific data and include in the model? Mark Stouse: So we are not a data provider, but we can and do all the time help people locate data sets that are usually free.
That kind of stuff is usually free, either from the government or major financial institutions or universities, things like that. So that's not a problem. And it's great. Usually just fantastic data. I mean, It's been totally scrubbed, so that's not a big deal at all. In fact, we live in the golden age of data availability. Even if it's not free, someone is measuring it. Purely speculatively in the belief that somebody is gonna wanna buy it.
And so today with a credit card, you can subscribe to all kinds of data sources, cost effectively. Particularly given how important it is to maximizing the investment. The other thing that I would just point out is ROI is really important, but you only know RROI. Looking backwards, right? ROI is a historical assessment. What is really important is forecasted, ROI, and then the
comparison between it and actuals. So again, this is very much like public companies issue guidance and then they issue regular updates against that guidance. That is exactly what the C-suites of many companies are, demanding today, right? It's like an investment uh, to start a new company. The first question the investor's gonna ask is, what do you expect this to do in year 1, 2, 3, 4, 5? And what's the basis for that projection?
If you're just extrapolating from hope and best wishes and all that kind of stuff, that's not much of an argument. But if you're doing regression based analysis, that starts to mean something. Justin Norris: And listening to the examples that you described, it does feel like a very enterprise oriented solution. If I work at a company, 400 people, 50 million a RR, is this something that can work for us, or do I need to be of a certain size threshold for it to be useful?
Mark Stouse: No, actually it totally scales. The reasons for investing in it are going to be different in a small, medium, or enterprise type business. But it totally scales. And the cost is totally approachable, even for mom and pop, right? So the reasons for doing it as a small, and let's say the lower half of the medium sized business. Are mainly because if you make a bad investment in whatever, It has a almost immediately negative effect on cashflow.
Too much risk, so they are modeling to avoid that. We do have some small customers and that's their main reason for doing it. If you are an enterprise and you're spending, I don't know, $200 million a year on marketing, right? you spend it wrong, what the CFO is most concerned about is things like opportunity cost, right? That's the comparison that's going on in their mind all the time, particularly today, is what are all the different ways that I can spend this dollar and what
are the most effective, or what's most likely to give me the biggest impact? That's the competition. That is the Game of Thrones, particularly right now in budget season. budget season right now is sort of year round now, right? Because everything is so pressed. So if you are a marketing leader, you are in competition to show that money spent with you is a better return. Than if they spend it in it or HR or whatever, right
you also need to really understand this, you marketing by definition, is a non-linear multiplier of areas of business performance that are linear, one of which is sales. So in simple language, your leverage, you are bringing huge amounts of leverage to sales performance that sales cannot create for itself, right? not a ding on sales, it's just the nature of the reality of the situation, what
do I mean by linear and non-Linear, okay. It means that if I were to go to my CRO and double goal for. For 2024, the first conversation that they're gonna want to have with me is about essentially doubling their Salesforce, right? Because the relationship between revenue coming in and the cost of that revenue in the form of sales team is it's known it's a linear function.
And that's because it's the collective performance of a lot of individual performances. Okay? So a bell curve your sales team's performance is gonna be on a bell curve. It's just fundamentally linear. The whole reason why modern marketing was created in 1890, whatever, to bring non-linear leverage to that whole equation, even in B2C. So what does that mean? It means that because of the way marketing is, were to have the
same conversation with the CMOA, we're doubling the revenue goal. Might have to increase marketing spend by 25%, maybe 20%, there's already a ton of leverage built into it. And if you want an easy understanding of ROI for marketing, it is the extent of that multiplier, so we'll talk about it this way. You are basically saying that marketing's mission is to help sales more product to more people.
That's revenue faster. That's cash flow from revenue more profitably. That's margin impact than sales could do by itself. That's the key phrase. The extent to which that is true is the ROI to the business. So does that actually look like in real life? Well, and a lot of really, really great B2B marketing go-to market kinds of operations. ratio is somewhere between 10 and 20 x.
So that means that if you take marketing away entirely, which I think would be a. Something that not even the most draconian CFO would ever contemplate, but let's just say it is the ultimate AB test. So we're gonna completely shut down marketing. You're gonna see a massive fall off. It may take a year, but you're gonna see a massive fall off in sales productivity that is going to reveal the extent of the marketing multiplier. It's like literally guarantee able because sales create the leverage for itself.
It's just not the way it works. Justin Norris: If a company is getting started with this solution what would the process be like? What data sources would we need to bring? How much time does it take to build the model, that sort of thing. Mark Stouse: the very first step is, and this is part of the onboarding for us, is that we sit down with the customer and we say, look, what are your top questions that you most want to know The answer to this is a mixed audience, usually of marketers and business leaders.
And doesn't matter what your job is. Nobody has any problem rattling off their list of questions. Those questions then generate what's called a model framework, could easily analogize that to a recipe card., So this is gonna be a punch list of data types that you're going to need to be able to supply to the model to compute the answer. then it's gonna outline the model itself, algorithmically speaking. When you actually make the dish from that recipe, that is the model.
Usually the way this actually works is it's very fast. It's usually a matter of weeks, like less than a month, that kind of timeframe where. The analyst and the business user. Could be a marketer, could be finance guy, could be whatever. Are collaborating in the tool on a minimum viable model. And at some point business user says, that answers my question. We need to put this model in production.
You hit the big red button, it goes into production. After that, it's pretty autonomous. There's kind of some DevOps type work, you you know, you have to maintain the model and all that kind of stuff, right? But for the most part, it is doing its thing on an automated basis and you're getting whatever cadence is right for your business. Daily, weekly, monthly, you're getting an update on demand. Justin Norris: the. . Analyst that you just described, is that someone that you're supplying
from your team or is this kind of a bring your own process? Mark Stouse: we We have a large partner ecosystem that, we can recommend from. We also occasionally can do it ourselves on a managed service basis that is actually increasingly popular as teams get thinned out and they know that they need this capability, but they don't have the bandwidth or the expertise to manage it internally. And so that's actually extremely popular these days and very cost effective.
the key thing is that there's lot of. You could easily spend 2020 5K upfront in time, not in licenses. Okay. But in time to get everything set up but once you've done that, right, again, the models, unless you need more models, right? The models are doing their thing, right? You don't have ongoing major, investment, know, every month gotta redo the whole thing from the ground up. That's, exactly the kind of thing that proof was built to eliminate,
Justin Norris: if you add a new, you add a new channel, do you have to update the model? Or the model can be flexible enough to just say like, oh, you're doing LinkedIn advertising now. That's fine. We can just incorporate that as we go. Mark Stouse: you could do it either way, right? I think be the best practice is that you clone the model that you have and then you add the new data streams to it that you're maintaining the integrity of the original model for comparison. And yet you are updating it that way, right?
And then at some point you're gonna dispense with the oldest version of the model altogether, So it's not like you just see a massive proliferation of models across time. But you do need to do this in an orderly way so that everybody doesn't lose reference points. Justin Norris: you mentioned competitors and I've seen competitors popping up in the market, even . A multi-touch attribution vendor that's adding MMM to their mix. What's your outlook on how easily other vendors could recreate these capabilities?
Do you feel that you have a fairly strong competitive moat around the offering you've built, or will other people be able to jump into this environment and offer similar things fairly easily? Mark Stouse: So it's really important to say this, the competitive advantage that anybody has is not in the math. So if people propose that they have some kind of Super Cal Flagal algorithm, you need to be very careful about that. ' cause the odds also are that it's not transparent, it's a black box.
And also. If it is transparent, you probably don't have the ability to evaluate it. In our particular case, the IP that really matters is in how we automate it, how we scale it, how we make it consumable and approachable and understandable and how we do it at a particular price point. And I think that this is the other thing that is highly relevant today, not just in this area, but across SaaS, is that prices are coming down.
Uh, We're gonna see a fundamental change in SaaS pricing. The days of, you know, every year having a pricing increase are over. It's just done. We are very well fixed competitively speaking. Do have a, I think, a really solid moat. So there are a lot of competitors today that have some great products, but these are products that were conceived of and written by and for data scientists.
and, And a lot of 'em are gorgeous by the way. Like, graphically, they're gorgeous, but if you expose them to a normal business user, a marketer, sales leader, whatever gonna stare at that screen and go, I have not a clue in the world what that means. Like how do I make a better decision based on that? You've just now thrown a lot of friction into it. It's taking more time. You've gotta spend a lot of time translating the data science outputs
into something that is usable. And we don't do that, we built it with the end user in mind violating any. Data science principles. That's our big advantage. Think one of the biggest things I can say about this, just to sum up, is that there's a reason why large B2C marketing teams, CPG uh, hotel and hospitality, retail, whatever, right? They control all four pss of marketing and they have, at worst, a defacto authority
over and responsibility over the p and l. Of their product with their marketing. There's a reason for that, they are using econometrics slash Go-to market mix modeling slash MMM, using that to optimize and to understand causality and to optimize based on that causality. And they're also investing a ton of money in market research, which a lot of that ends up in the models, right? So if B2B marketers want to have the same attributes their B2C brothers and
sisters, gonna have to do what B2C does. This is one of those situations where it's like gravity, You can disagree all you want to with gravity, and if you throw yourself off a building, it's not gonna end well, the same thing is true here. This is a mathematical principle at work. It's mathematical law of gravity with quotation marks around it. And so everything that I've said today, I've, and I really try really super hard to do.
This is not my opinion. I'm just representing a level of fact that people can either accept or reject, but it doesn't change the truth of it. Justin Norris: We will include a link to your website so people can uh, check it out, learn more, look at your resources. And I'm excited to see where this goes. Mark, thank you so much for chatting with me today. Mark Stouse: You're welcome. Thank you.
Every time you explain your business to an AI from scratch, you’re repeating work. The opportunity with context engineering is to make your company’s expertise, processes, and past learning available whenever an agent...
Justin and Lily reflect on their parallel journeys diving deep into AI throughout 2025. They discuss why most AI content misses the mark for operators and system builders working within corporate constraints, share...
SEO used to be the ultimate growth lever - offering massive “free” traffic to marketers who could outsmart the algorithm. But in 2025, it's a different game. In this episode, I’m joined by Gaetano DiNardi - an SEO...
AI agents are everywhere in conversation right now - but what actually makes them work? It’s not just slapping a large language model into a workflow and calling it a day. Under the hood, real agentic systems operate...
Not many people make it to VP of Marketing Operations - Kimi Corrigan has done it twice. In this episode, she shares her journey from marketing coordinator to leading marketing ops at companies like Duo Security, Cisco,...