Hlib Storchak · 2026-07-24 · ~11 min readQuick answer
Before signing with an outbound or appointment-setting agency, get clear, written answers on: their sourcing methodology, ICP fit and references in your vertical, the pricing model and contract length with an exit clause, who actually staffs your account, what counts as a "qualified meeting," and what you keep if you leave. If any of those answers stay vague after you ask twice, that is the checklist working, not you being difficult.
Why most agency evaluations fail before the contract stage
I'm Hlib Storchak. I build and run outbound systems for B2B founders and sales teams, and I've booked 2000+ meetings for B2B clients doing it. Most of that work happens in-house or fractionally, but a fair number of the accounts I take on used to run through an agency first. The pattern I see over and over is not that the agency was a scam. It's that the buyer never asked the twelve questions below, signed on vibes and a good sales call, and only found out what they'd actually bought three months in.
I should say plainly that I run outbound for clients myself, which makes me a competitor to every agency you might be evaluating. That's exactly why this checklist is not "how to pick the best agency," it's "how to find out, before you pay anyone, whether the specific agency in front of you is being straight with you." The questions work the same whether you end up hiring an agency, a fractional operator, or nobody at all.
The 12-point checklist at a glance
Here are all twelve, before the detail. Print this, bring it to the sales call, and don't let a single one slide to "we'll cover that in onboarding."
- Can they explain their lead-sourcing methodology in plain language?
- Do they have a named client, or reference, in your vertical and company size?
- Will they show you a real sample campaign, not a template?
- Is the pricing model retainer, pay-per-meeting, or pay-per-opportunity, and is it in writing?
- What is the contract length, and is there an exit clause before month 12?
- Are there setup, data, or per-inbox fees not included in the headline price?
- Can they produce three references you can call within 48 hours?
- Do they share sending domains, list sources, and infrastructure in writing?
- Who runs your account day to day, and how many other accounts does that person carry?
- Is the team you'd work with offshore, onshore, or blended, and does that match what you were sold?
- How do they handle GDPR or CCPA consent, opt-outs, and data retention?
- What exactly counts as a "qualified meeting" in the contract, in writing?
Points 1 to 3: positioning, ICP fit, and methodology
An agency that can't explain, in one or two plain sentences, where their leads come from and why those people match your ICP is either reselling a generic list or hasn't thought hard about your account yet. Either way, that is worth knowing before you pay a setup fee. Ask for a named client or reference in your specific industry and company size, not a general case study pulled from their homepage. A generalist agency without a reference anywhere near your vertical isn't automatically wrong for you, but it does mean you are the pilot, and you should price the engagement, and your expectations, accordingly.
Ask to see a real sample sequence or call script, not a polished template built for the sales deck. If they hesitate or send you something generic, that usually means one of two things: the work you're being shown isn't actually theirs, or it is theirs and it isn't very good. Neither is disqualifying on its own, but both are worth pushing on before you sign.
Points 4 to 6: pricing model, contract length, and hidden fees
Get the pricing model in writing before the sales call ends: retainer, pay-per-meeting, or pay-per-opportunity. Each shifts risk differently, and I break down how to compare them below. Separately, ask for the contract length and whether there's an exit clause before month 12. Expect 3 to 6 months as a normal minimum for outbound appointment setting. A 12-month lock-in with no performance clause is a sign the agency wants revenue certainty before they've proven anything to you, not the other way around.
Also ask what isn't in the headline price. Setup fees, data or list costs, CRM integration, and per-inbox charges for sending infrastructure are all common and all fine, as long as they're disclosed upfront rather than appearing on the first invoice.
Tip. Don't accept a specific guaranteed lead count in writing. Outbound is noisy enough that anyone promising a fixed number of qualified meetings a month is either quietly lowering the qualification bar to hit the number, or selling you a scraped list dressed up as targeting.
Points 7 and 8: proof you can actually check
Ask for three references you can call within 48 hours, ideally founders or VPs of sales who actually ran the campaign, not a name pulled from a testimonials page. If an agency can't produce that quickly, that tells you something about how many happy clients they actually have on hand. When you get someone on the phone, ask what they'd do differently if they signed again. That question gets you further than "would you recommend them."
Second, ask them to put their sending domains, list sources, and infrastructure setup in writing. Vague answers here ("we use a mix of proprietary and licensed data") are common marketing language, but you should be able to get a straight answer on whether domains are dedicated to you or shared across their client base, since that affects your deliverability risk long after the contract ends.
Points 9 and 10: who is actually doing the work
Ask who runs your account day to day and how many other accounts that person manages. A senior partner on the sales call is rarely who ends up writing your emails or making your calls. Ask directly whether the delivery team is offshore, onshore, or blended, and whether that matches what was implied during the pitch. This is not a quality judgment either way. It's a mismatch problem: a buyer expecting a fully onshore SDR team who ends up with an offshore-only delivery team, or the reverse, tends to end up unhappy regardless of the actual work quality, simply because the expectation was never set correctly at the start.
The most common frustration I hear secondhand from teams who've been through an agency and didn't ask this upfront is a mismatch between who was on the sales call and who actually shows up to run the account once the contract is signed.
Points 11 and 12: compliance and what counts as a meeting
Ask how they handle GDPR or CCPA consent, opt-outs, and data retention, especially if any of your target accounts sit in the EU or UK. Any agency handling prospect data on your behalf should be able to explain this in specific terms, not just point to a privacy policy page.
Last, and this is the one that causes the most post-signing arguments: get the exact definition of a "qualified meeting" written into the contract. A vague definition is how a "meetings booked" report ends up padded with no-shows, wrong titles, or people who were never going to buy. Define it now: title or seniority level, company size band, and whether a no-show counts against the number, all in writing before the first invoice.
Retainer vs pay-per-meeting vs pay-per-opportunity
None of these models is inherently better, they just shift risk and cost differently, and real 2026 pricing surveys give a useful range to sanity-check any quote against. LeadRiver's 2026 benchmark puts pay-per-meeting pricing anywhere from $100 to $1,500 per qualified meeting depending on qualification depth, from roughly $150 to $300 for a basic meeting up to $550 to $1,700 for enterprise financial services or legal tech, and retainers landing between $3,000 and $10,000 a month for mid-market programs, with enterprise multi-region programs running $15,000 or more. Tomba's 2026 pricing guide puts the same two shapes at a similar range, roughly $50 to $350-plus per booked meeting and $1,500 to $8,000-plus a month for a retainer. Treat both as a sanity check on a quote, not a number to hold any agency to, since your vertical, deal size, and qualification bar all move the real figure.
| Model | How it works | Who carries the risk | 2026 range (industry surveys) |
|---|---|---|---|
| Retainer | Fixed monthly fee for a defined amount of activity | You: you pay whether output is high or low that month | ~$3,000 to $10,000+/month |
| Pay-per-meeting | A fee per qualified meeting booked, sometimes with a small base | The agency: they only get paid when a meeting lands | ~$100 to $1,500 per meeting |
| Pay-per-opportunity | A higher fee, paid only once a meeting converts to a real sales opportunity | The agency, more heavily: price is set higher to price the risk back in | Typically priced as a multiple of the pay-per-meeting rate |
A cost-per-meeting model you can run yourself
The real comparison is never the headline number, it's cost per qualified meeting once ramp time and no-shows are priced in. Here's a worked example, with every input labeled as an assumption you should swap for your own numbers. Assume a retainer agency quotes $6,000 a month and delivers 10 qualified meetings: that's $600 per meeting. Assume a pay-per-meeting agency quotes $400 per meeting flat: at that same volume of 10, that's $4,000, cheaper than the retainer. Run the same two models at 20 meetings a month and the retainer drops to $300 per meeting while the flat rate stays at $400, so the retainer wins once volume climbs. Where the crossover actually sits depends entirely on your real quotes and your real expected volume, but the exercise, plugging your own numbers into both formulas before you sign, is the part that matters. Don't accept "our average client books X a month" without asking what volume that average is drawn from.
The red flags that should end the conversation immediately
A few signals are close to disqualifying on their own, regardless of how good the rest of the pitch sounds.
- They won't explain their lead-sourcing methodology in plain terms, even after you ask twice.
- They promise a specific, guaranteed lead or meeting count in writing.
- They push a 12-month contract with no exit clause and no performance guarantee.
- They have no references, no reviews, and no verifiable social proof anywhere.
- They refuse to say what you keep, lists, sequences, copy, if you leave.
A useful gut check. The mistake I see most often when I take over an account that came from an agency isn't that the agency was incompetent. It's that nobody on the client side could explain why the previous campaign's targeting or messaging was built the way it was. A vendor who can't explain their own logic back to you in plain language is worth noticing before you sign, not three months after.
What to check in the first 90 days after you sign
Vetting doesn't stop at the contract. This is the setup I run for clients who ask me to audit an agency relationship that's already underway: check the actual sending domains and reply data against what was promised in the pitch, confirm the person doing the work matches who was on the sales call, and get a real answer on what counts as a qualified meeting versus what's showing up on the weekly report. If any of those three drift from what was agreed, that's the moment to raise it, not at renewal.
If Salesforge, Mailforge, or a similar dedicated infrastructure setup comes up as part of the conversation, that's what I default to for clients who want to own their own domains and mailboxes rather than sending through an agency's shared pool, purely as a personal preference from running it that way, not a verdict on any agency's own stack.
Key takeaways
- Get the pricing model, contract length, and any hidden fees in writing before the sales call ends, not during onboarding.
- Ask for three references you can call within 48 hours. If they can't produce them quickly, that tells you something.
- 2026 industry pricing surveys put pay-per-meeting at roughly $100 to $1,500 per meeting and retainers at $3,000 to $10,000+ a month, useful as a sanity check, not a number to hold any agency to.
- Run your own expected volume through the cost-per-meeting formula for both retainer and pay-per-meeting before deciding. The cheaper model flips depending on volume.
- Get the definition of a "qualified meeting" written into the contract. This single line prevents most post-signing disputes.
- Ask what you keep if you leave. Lists, sequences, and playbooks that live only on a vendor's server are a liability, not an asset.
FAQ
What is the most important question to ask an outbound agency before signing?
Get the exact definition of a "qualified meeting" in writing. It sounds minor next to pricing or contract length, but a vague definition is the single most common cause of disputes three months into an agency relationship.
How long should an outbound agency contract be?
Expect 3 to 6 months as a normal minimum for outbound appointment setting. Push back on anything close to 12 months unless there's a clear performance clause or exit option before then.
Should I choose a retainer or pay-per-meeting pricing model?
It depends on your expected volume. At lower monthly meeting counts, pay-per-meeting often works out cheaper since you aren't paying for idle capacity. At higher volume, a flat retainer's cost per meeting drops and usually wins. Run your own volume estimate through both formulas before deciding.
Is it a red flag if an agency guarantees a specific number of leads per month?
Yes. Outbound is too variable for anyone to responsibly guarantee a fixed qualified-meeting count. A guarantee like that usually means the qualification bar quietly drops to hit the number, or the "leads" are a scraped list rather than real targeting.
What should I own after an agency engagement ends?
Ask this before you sign, not after. At minimum, you should keep your prospect lists, sequence copy, and any playbook or targeting logic built during the engagement. If the answer is that it all stays with the agency, you're renting results rather than building an asset you keep.