How to Tell If Your Digital Ad Agency Knows What It’s Doing

Most businesses pick a digital ad agency the same way: a polished deck, a few case studies, a confident pitch, done. Three months later leads are inconsistent, the reporting doesn’t quite line up, and every time you ask why performance dipped, you get an answer that dances around the actual issue.

Nobody’s lying to you here. It’s just that the way most people vet an agency doesn’t hold up. You ask about experience, they show you their best numbers, and the conversation moves away from helping you really understand who you’ll be partnering with.

So, here are the top questions you can ask an ad agency before making any decisions.

Ask Them to Explain Your Current Numbers Before Pitching Anything

A good agency looks at your existing data and tells you exactly what’s going on and why before they pitch a single change.

They should be able to tell you: which campaigns are bleeding budget, which keywords bring clicks that never convert, where the actual structural problems are hiding. And, most importantly, why you’re seeing what you’re seeing. “Your cost per click is high” isn’t an insight, it’s basic data-reading skills.

If they skip straight past explaining the why and jump to which new tactics they’d employ, notice it. Selling is easier than analyzing, and most agencies default to selling because they’re not as confident in the analysis.

An agency that jumps to solutions without diagnosing anything first doesn’t know your account, it just knows how to pitch.

Ask How They Define a Conversion

This question exposes more than it should.

A lot of agencies optimize for clicks, form fills, call volume, or activity that simply doesn’t become real business outcomes. If a “strong month” means a spike in inbound calls but nobody can tell you how many turned into booked jobs or actual revenue, they’re chasing a number that has nothing to do with your bottom line.

A real answer ties campaign performance back to the business, booked jobs, revenue per lead, cost per acquisition. They should also explain how conversion tracking connects the ad click to a real business outcome. If they can’t walk you through that connection for your specific account, chances are your campaigns are optimized for something that looks good in a slide and does nothing for you in practice.

The Industry Experience Trap

Agencies with genuine expertise in your category will highlight their experience, industry clients, and proven campaigns for businesses like yours.

Category knowledge matters. But there’s a version of it that functions as a substitution. They know what the industry looks like in general, so they project that onto your business and call it a strategy.

Ask whether their category knowledge translates into a diagnosis specific to your situation. Not what companies in your space generally need. What your market looks like right now. What your competitors are actually spending. Where the specific gaps are.

If every answer stays at the category level and never reaches your business, you’re looking at template thinking dressed up as expertise. That’s one of the subtler signs your agency doesn’t know what they’re doing, because it can sound credible until you push on specifics.

The Digital Ad Agency Vetting Checklist You Should Actually Use

Generic vetting advice says things like “ask about their process” or “evaluate their communication style.” That’s not a digital ad agency vetting checklist. That’s filler. Here are five more questions you can ask to vet your agency:

1. What are you seeing in our data and why? An agency that jumps to solutions without diagnosing anything first doesn’t know your account, it just knows how to pitch.
2. How would you measure conversions for our business? A real answer ties campaign performance back to the business, booked jobs, revenue per lead, cost per acquisition.
3. What are competitors doing in our market that we aren’t? If every answer stays at the category level and never relates back to the business, you’re looking at template thinking dressed up as expertise.
4. Can you show me a campaign you restructured and explain exactly why you made each change? Generic before-and-after results tell you nothing. The reasoning behind each decision does.
5. Who specifically will manage my account, and what is their experience level? Agencies sell senior talent and assign junior staff. Get a name. Ask to speak with that person before signing anything.
6. How do you handle a month where performance drops? Walk me through your actual response. You want to hear a process: diagnosis, hypothesis, test, adjustment. A vague or defensive answer is a signal.
7. What does your reporting look like, and what decisions do you make from it? Reporting should drive action. If they describe a dashboard full of metrics without explaining what changes based on those numbers, the reporting is cosmetic.
8. Have you worked with my direct competitors? If yes, ask how they manage that conflict. “We keep accounts separate” is a policy statement, not an answer. Push harder.

Why Knowing How to Evaluate a Marketing Agency Matters More Now

Ad costs are up across nearly every category. The margin for inefficiency is smaller than it was two years ago. An agency running misaligned campaigns while reporting on surface metrics is a much more expensive problem than it used to be.

The standard for how to evaluate a marketing agency has to be higher. Not because agencies are worse, but because a poor fit compounds faster now. Every month of misdirected optimization is a budget that doesn’t come back.

What New Path Digital Can Answer

Every question in this piece is one New Path Digital can answer specifically, with data, for your business. We don’t work with your direct competitors. We don’t run template campaigns. When performance shifts, we show our work.

If you want to put us through the checklist above, we’ll welcome it. Schedule a call today.

FAQs

Q1: What’s the most important question to ask when vetting a digital ad agency?

Ans: Ask what’s actually wrong with your current campaigns before they pitch you anything. If solutions come before the diagnosis, that’s your answer right there.

Q2: How do I know if my agency is tracking the wrong metrics?

Ans: Ask them to define a “conversion.” Clicks and call volume aren’t it. You want booked jobs and revenue, not activity that looks good on a slide.

Q3: Is industry experience really that important?

Ans: Only if they can prove it applies to you. Ask what they’ve actually learned running accounts like yours, and how that changes your strategy specifically.

Q4: How often should I challenge my agency?

Ans: Monthly, at least. What changed, why, and what happened after. Vague answers mean nobody’s really watching your account.

Q5: What should a good agency vetting checklist include?

Ans: Skip the case studies. Ask who’s managing your account, how they track conversions, how they report, what happens when things drop, and whether they are working with your competitors too.