Ep 67: Certifications vs Real-World Experience, Analytics Evolution, and the Rise of Deep AI Traffic
Watch the YouTube video version above or listen to the podcast below!
Episode Summary
In this episode of Enterprising Minds, you can listen or watch as Dave Dougherty and Alex Pokorny unpack a career reality most marketers learn the hard way: certifications can get you started, but lived experience is what keeps you accurate when the data gets messy. Alex frames it as “an inch-deep puddle” versus the “ocean” of real-world complexity, especially in analytics roles where the skill ladder keeps changing.
They trace how the toolset (and the expectations) have evolved—from early days of basic website tracking in Google Analytics to the mental model shift that came with Google Tag Manager, and then into BI and visualization platforms where storytelling becomes the differentiator. The key shift: analytics are backward-looking, so your value is less “pulling reports” and more translating imperfect signals into decisions leaders can act on.
From there, the conversation widens: privacy changes shrink what you can reliably measure, and “deep” AI-driven traffic (for example, users emerging from ChatGPT directly onto high-intent pages) breaks traditional funnel assumptions. The takeaway is practical: if your KPIs still assume clean attribution and stable click-through rates, you are measuring the past, not the market you are in now.
Action checklist (use this this week):
Identify which metrics are “reported reality” vs. “actual reality” (sampling, consent, and blockers).
Move beyond dashboards: build an executive narrative that explains constraints and implications.
Treat AI referral traffic as its own journey, not a broken funnel.
Choose 1–2 channels your team genuinely enjoys and can sustain, then outlast competitors.
Ep 67: Certifications vs Real-World Experience, Analytics Evolution, and the Rise of Deep AI Traffic Podcast and Video Transcript
Episode access: listen | watch
Dave Dougherty: Hello, and welcome to the latest episode of Enterprising Minds. Alex and Dave are here today.
Certifications vs. Real-World Experience
Dave: Alex, you had an interesting thought on certifications versus real-world experience. If there is time, I think we will talk about the new sales structure over LinkedIn and where that is falling short for how some of these new AI SaaS things are happening.
So, Alex, why don’t you cue us up with your experiences in certifications?
Alex Pokorny: Yeah. I had a rather enlightening conversation where I teased out a difference that I do not think I have ever seen stated online. It got into the different stages of analytics, web analytics, and the changes in tools, systems, and skills as an individual advances in that career set.
It came down to this: the first person I was talking to had some certifications, which was excellent in one particular area. That is great. But they were not even aware of all these different changes and things that would advance them up that career ladder.
As we talked, I realized there is very little that gives you awareness—or even visibility—that things are going to change as you enter this career. If you want to advance, you will have to learn new skills: considerably different and, in some cases, radically different skills to succeed.
The more generic thought is about certifications in general. They are great at giving you an inch-deep, puddle-level awareness. But if you think that is the entire world versus the ocean around you, you are missing a lot. And learning how to survive in that ocean requires different skills.
I have taken a lot of certifications, and I am not downgrading them at any point. They are a great way to get a wide base of information very quickly and build that beginner-level understanding.
But there is so much more that happens with years of experience in those careers and on those platforms, systems, job types—whatever it might be—that gives you a deeper respect for the breadth of skills you actually rely on to succeed.
I would be happy to recap the changes in analytics that I have seen in some of those skill sets. But first, what is your take on where certifications fit versus real-world experience?
Dave: For me, certifications are great when you are starting out or trying to wrap your head around an idea.
When AI first came out, I thought, “I do not even know how to think about this.” But I knew I should explore it, and I wanted to be ahead of as many people as I could.
So I went to Google Cloud and other platforms that I associate with heavy coding and web development—things that are not my world. I still did the trainings because I needed to understand how they work.
And for me, I am a high-context kind of person. I want to know: How does this work? How can we work with it? What are the limitations we are going to have to work against?
That approach worked wonderfully because it reduced the anxiety of “AI is going to replace us all,” which was the first fear. It became, “No—this is how it will probably play out, and this is how it can slot in.”
But there are limitations. And as I tried each new platform, it became clear: AI can be very good at tasks, but when you get into multi-step, high-strategy thinking, it is not there yet.
Could it be? Absolutely. But as of this recording, no—it is not there yet.
The Evolution of Analytics Tools
Dave: Even thinking specifically about analytics: 10 to 15 years ago, starting with Google Analytics on a basic website, one of the hardest things was figuring out how to track a button click properly—because Google Tag Manager did not exist yet.
Then Tag Manager came out, and I remember having my brain melted because it was a completely different way of thinking. I had to suffer through it and rebuild how I worked, step-by-step, to get to, “Okay, this is possible. This is how this works.”
Coming from being a guitarist and a writer, and then suddenly: “Place your code here.” What? Come again?
And then further down the road, you get into Power BI, Looker Studio, Tableau—visualization tools. For me, that is Tag Manager on steroids because you have to get all the data to work together, and you have to visualize it correctly.
But the key thing is the storytelling aspect.
Analytics tell you what happened. But a lot of people forget analytics are not forward-looking—they are backward-looking. They can tell you what happened, not what is likely to happen.
You can look at, “Our previous campaign did a 40% click-through rate.” Great. But who knows what will happen now? It is a new campaign and a new time. Maybe your audience got food poisoning at an industry event, and nobody is on their devices. You do not know.
You cannot use analytics as a crutch. The power is storytelling—moving things forward that way.
Alex: Yeah, getting into it, that is part of the skillset changes. The stages of advancement I have seen start with early-level reporting.
That is almost like technical confidence—getting into a tool more than other people, or spending the time and attention to learn it. You can pull default reports. Great. You are the person who pulls the reports.
Dave: Right.
Alex: That can extend into investigation work. Someone sees weird data or asks, “Why did that happen?” Then you start diving deeper, finding related things, building custom reports. Now you are moving up.
But there is a big step change from the person who pulls reports to the person who can make a presentation that is stripped down to core elements—an executive-summary version—and can make a compelling argument that creates change in the organization.
That is a very different person, and a very different impact, than the person who just pulls reports.
Then you get into dashboarding: custom dashboards in Power BI, Looker Studio, Excel, PowerPoint—whatever you use, manually or automatically.
A big piece of that is interviewing—knowing the data, and knowing the limitations of those systems. Speaking of your point about certifications with AI, a big piece is knowing limitations because web analytics always has missing data. It is never 100%. It is always sampling or missing something for some reason—cookies not loading, technical issues, all kinds of things.
It always looks like 100%, but it is 100% of the reported visits. It is not 100% of your visits. It is 100% of the ones that made it through the system after exceptions.
That is a misleading aspect. Knowing that—and knowing how to craft the story and the visuals—is a different skill set.
Now you are talking about design, soft skills, and technical skills. You are templating a report, choosing the metrics, choosing how to filter and segment, deciding the order so the report tells a story.
You might start with impressions—an “ego” number—then move into something actionable that matters. Understanding what makes the report worth the investment is beyond “I can log in,” or “I can pull a report.” It is way beyond that.
And then the tools change, too. You shift from Google Analytics to Looker Studio, or Adobe Analytics versus Power BI equivalents. You are switching systems while also leveling up the skills.
The Impact of Privacy Laws on Data Collection
Dave: Another thing that comes to mind is understanding the market we are in. When you and I were pulling dashboards in our first agency jobs, it was a free-for-all on data. There was no conversation about privacy. You visited my site, and I could see your click.
Now, with privacy laws and everything else, the percentage of people who allow us to track with cookies is what—30%? That is what we see.
So now we are talking samples of samples for decision-making. At what point do you pause and say, “Are we making decisions on something too thin?”
Alex: And also, is that audience the same? Do people who allow cookies behave the same as people who do not? We are making a big assumption that everybody is the same, and that does not make sense.
Dave: That brings up an interesting question. I have not looked into this since—AI bots can click on stuff. Would a visit from an AI bot show up as traffic from a source that has allowed cookies or not?
Alex: Would you even see it? They have referral tags—most have a prebuilt referral tag. If you look in Google Analytics, you will see UTMs or referral patterns that show AI sources.
You can pull a referral report and see the traffic. But you have to distinguish between AI bots and AI-sent visitors. Bots would not accept cookies because they cannot download cookies. That is bot traffic.
AI-sent visitors—humans clicking from AI results—would show up as referral traffic.
Dave: Interesting. Almost all my conversations have been on the server side.
Alex: Right. If you are talking straight to the bot, that will not show up in analytics. It would show up in server logs—bot requested this, bot accessed that.
And there is a misnomer, too: how ChatGPT pulls information. It does not have a giant index like Google. It is not searching a saved copy of the internet like a big database or catalog. It is doing live searches.
You can sometimes see the queries it goes out and uses: “best CMS for enterprise,” and then a bunch of variations. It is still searching the internet like we are.
But whether it shows up—no, it will not show up as a bot. It will show up once you start clicking on those links.
Dave: These are nitty-gritty details that make for bad radio, but they are genuinely interesting.
Alex: You spoke about limitations with AI. It is the same thing here: surface numbers look like magic, and they never are. The question is why they are not.
You need experts who know the exceptions. What data am I missing? What part of the story am I not seeing?
It takes experience to know weird reasons. We used to talk about people who did not allow JavaScript to load—cookies were being loaded through that—so they were not in analytics. We lost traffic. Maybe 5%, who knows?
And if you are in Germany or the UK, numbers can be rough because people click “no” all the time. Browsers can auto-block tracking—some parts of Firefox, and privacy browsers like DuckDuckGo deny cookies automatically.
You do not see that traffic at all. But they are on your site, interacting, shopping, buying, filling out forms. They are still customers. They just have a privacy mindset, or a system that denies tracking on their behalf.
AI Traffic and Marketing Strategies
Alex: There are studies about AI traffic and how it is weird traffic—sometimes called deep traffic.
Imagine you are in ChatGPT figuring out the best CMS for your enterprise. You run through options, ask questions, get information, and then you decide, “That is the one.” You click, and you land straight on the sales page and immediately contact the company.
From an analytics perspective, that is strange. Someone popped out of nowhere, consumed zero on-site content, and now wants to buy. You are thinking, “What happened to my funnel? Where is my blog post?”
Dave: I am building a presentation around this right now. And, yes, everyone should subscribe to the Pathways newsletter because I am going to draft some of these thoughts there.
My thesis is that we are in a messy transition between performance-based marketing and brand marketing. Everything old is new again.
People ask, “How do I do influencer marketing? How do I do social media? Do I have to hire people?”
Start with what you are already doing. Are you going to trade shows? Great. Give someone an iPhone and a battery pack and send them around the conference center. Do live recording. Capture behind-the-scenes setup. Make it visible that you are there—not just standing at a booth hoping someone walks up.
The flip side is this: we have generations of marketers who grew up believing they can track everything. Their decision-making has been de-risked: “I can recommend this and be 80% correct.” Bonuses and career progression have been dependent on estimating campaign performance.
Now, with deep traffic, it is not that different from the 1980s before the internet. The phone rings and someone says, “Hi, I am interested.” You respond, “Cool, tell me about yourself.”
We have done this before. The problem is: you need confidence. You need to accept risk. Things might blow up. That is a different mindset—and a different leadership style—than what has been elevated over the last 20 years.
Alex: I had this conversation with my team yesterday. A lot of mass-market advertising and marketing we relied on in the past is not going to work the same way. The numbers are not there.
There is a click-through rate study from Will Reynolds and his agency. For paid or organic, when an AI overview shows up—or even when it does not—click-through rates from a year ago to today are either half or a quarter of what they used to be.
I will say it again: doing SEO or paid search a year ago versus today, you can expect half to a quarter of the traffic you used to get.
It does not matter whether an AI overview shows up or not. Fewer people are clicking.
So if you were all-in on, “I have a tiny budget, I will throw another $5K toward paid search,” or “We will bump up SEO,” you are operating in a different world.
Budgets get slashed, and suddenly it is “SEO time.” “We do not have any money—blog post.”
Dave: We should have been doing that from the start. Thank you. I know.
Long-Term Strategy vs. Short-Term Results
Dave: That is funny because—
Alex: We say, “We need short-term results, so let’s apply a long-term strategy.” Okay—what? No. That means you are reaping the results of a long-term strategy you have already been doing. It is not the same thing.
To your point, you are not talking about spending much money on advertising. You are talking about people taking out their cell phones and recording themselves at a show they are already attending.
Dave: And the money you would spend is to promote content you already created.
Alex: Exactly.
Dave: It is boosting posts, and YouTube promotion.
Expanding Digital Footprint
Dave: You are trying to expand the reach of content you already created.
Alex: And that gets to the concept of a digital footprint. You are in multiple channels, and social media needs to be treated like other channels: organic traffic from SEO, organic traffic from social, and so on.
You have paid traffic from paid search, and paid traffic from social media. Those need to be tied together instead of siloed.
Because the numbers across the board are not good. Creating enough traffic for a funnel—or a customer journey—to create sales requires more effort in more places.
That is a shift in thinking. It used to be easy: last year’s budget plus 10%. More of the same. Maybe a little experiment on TikTok, but mostly pushing into Google.
I also think about the TV show Mad Men and how performance marketers reacted to it. They were being faced with a show that had nothing to do with their career.
It is not cocktails and giant campaign ideas. It is keyword lists based on volume numbers.
Dave: Yeah.
Alex: That is not even close to the same mindset.
Dave: You are the nerds who were not invited to the cocktail party.
Alex: Exactly. You are the person still at the office when everyone else left.
Dave: But the more interesting thing—for me, thinking at a macro, organizational level—
Adapting KPIs and Marketing Metrics
Dave: How quickly are organizations going to adapt their KPIs? And how are marketers going to be measured?
If leadership still believes we can track via clicks, click-through rates, and form submissions, it is going to be lean years for people with high variable comp.
On one hand, I am excited because I like creating content. I like PR and events. Great. Let’s do it.
I know that is horrible for people who do not want to travel, or do not want to be around thousands of people.
Alex: There is also the moat concept we have talked about.
I was on a demo call with a vendor recently. They said, “We can have one person refresh blog posts at scale.” Not new blog creation—refreshes.
At scale, one person can spend an hour and refresh 50 blog posts, and it updates to your CMS.
That means the moat of “creating content and interesting blog posts” is gone.
Programmatic also did damage to paid search and display. Maybe not everywhere, but in some markets it hurt.
The big change is: you cannot assume the hard thing for you is hard for everyone else. Creating content is no longer that barrier.
So you need to find the new thing that is tough for competitors to do, that you can do—or that you are willing to do.
Throwing out a bunch of blog posts is no longer it.
Dave: I am on the fence.
Alex: Doing it smart might still matter. But I feel there is going to be something new—a newer medium with a moat—that makes it more difficult for everyone to do in giant volume.
That gives you a chance to do it better than someone else.
Dave: This podcast has been a bright spot in each week for me. Okay—mushy moment over.
Alex: You deal with your emotions so well, Dave.
Dave: Yeah, exactly. I am sorry. I am sorry.
The Evolution of Content Creation
Dave: As someone who started with blogging and building modes that way, I fully recognize that a lot of the content I built my career on is gone. The “what is,” “who is,” “how is” blog posts—those are table stakes now.
Doing this podcast has been interesting because I am not creating blog posts off the podcast transcripts. I am literally copying and pasting the transcripts onto the website.
Even with that, in Google Search Console, we are ranking for some interesting keywords that I would imagine are hard to rank for now.
Are we converting anything? No. We are not selling anything. We are coming together, having a conversation, and having fun.
But the gains I have seen are the soft skills—intangibles you cannot track.
In my day job, people see content on LinkedIn featuring us talking about topics. Now they come to me to discuss things, which is great because internal politicking used to feel like smacking my face against brick walls.
This has led to opportunities: guest speaking, events—intangibles that build long-term.
It is also credibility: “I have had a podcast with friends for three years. We showed up and did it for three years.”
Alex: After 10 episodes, we were in the top 90th percentile or something like that. Most podcasts do not make it to 10 episodes.
After a year, I think we hit the 95th or 98th percentile. Only a small percentage last a year.
Sticking with something is a moat, too.
And I should correct something: creating content is not completely diluted. Consistently doing it—and actually doing it—is a difference versus competitors.
If it is a point of differentiation, it is a moat. If it is not a point of differentiation, then it is not.
The ability to create content is easier now—the resource requirement has lessened.
Dave: Right.
Dave: I had an interesting experience this week with a coworker that reminded me: other people’s experience of your content is not yours.
I was outlining a presentation I have to deliver next week, and a colleague walked by and said, “You are always doing cool stuff. I see what you post on LinkedIn.”
That was interesting to me because I do what I like to do, but I do not think it is all that cool—because I am the one doing it.
Alex: You know how the sausage is made.
Dave: Exactly. And what is that quote—Groucho Marx? “I do not want to be part of a club that would have me as a member.”
Alex: Groucho Marx, yes.
Dave: I feel that.
It is a good reminder. Because we do not have the analytics—this is me thinking out loud—so let people do their own thinking, too.
Finding Your Unique Marketing Approach
Dave: If I am creating content on topics I want to be known for—and I have fun talking about, thinking about, researching—that helps me show up and keep doing it.
Over time, you get influence, thought leadership, and all the things people think they can get through quick wins and silver bullets.
For me, motivation is the process. I enjoy it, I want to keep doing it, so I do it.
And as people find that content—podcasting, YouTube, social media—if they come to the website, that matters.
I have done enough in-person informational interviews lately, and every single person says, “Yeah, I did a little internet stalking before I met you. You seem legit.”
It is not just, “My professor told me to talk to you.” It becomes, “My professor told me to talk to you—and wow, you actually know things.”
It is “all of the above”—back to the marketing mix—just at the personal level, not only the organizational level.
Alex: That might be part of the key to finding the new thing: find what you are comfortable with, what you enjoy, what gives you excitement, and push harder into that—more than others.
Personalities differ. If you enjoy making vlogs, you will do it better, you will do more of them, and you will stick with it longer than a competitor who read a listicle that said, “Number seven: create more vlogs.”
They do one poorly because it is their first one, they are learning, and then they stop. That is a difference.
Having someone in your organization who loves event marketing matters. Some people love it, some people hate it, and many are indifferent. Same with social media, and every other format.
Dave: I like traveling. I like going to events—as long as I do not have to stand in the booth waiting. If I can walk around, talk to people, and duck out for coffee when I want to, that is enjoyable.
Giving presentations on stage—I like that.
I know it puts me in a weird category. “Do you want to do three days in Chicago?” Yes. “How about Atlanta?” Sure. “How about Kentucky?” Yeah, let’s do it. Louisville is all right.
Alex: Find something you enjoy and stick with it.
Dave: Make a difference that way.
Alex: Point of differentiation is big. Doing all channels is not possible. Doing a couple well is possible.
Identifying the opportunities takes skill and expertise. Doing it well and sticking with it takes personality. Those become points of differentiation.
Dave: Okay.
Challenge: Identify Your Preferred Channels
Dave: Here is your challenge, everybody—if you have made it this far, thank you.
Your challenge for the next two weeks: map out what you actually enjoy doing, and which channels you actually like engaging with. Then make a plan around that.
As always, subscribe and share. Even three years in, it helps us grow and get more people into the conversation.
If you have episode ideas, comments, feedback, or personal experiences with these topics, reach out. We would love to hear from you.
