M.A.I. Consulting
GuidePractitioner7 October 20265 min read

Leading an AI-enabled team: teach checking first, judge decisions, measure more

Managers get better AI work by teaching verification before features, learning the core terms, making judgment visible, reviewing decisions as well as output, and measuring time recovered.

Your team has the tool, and you now have to decide what good AI-assisted work looks like, how to review it and how to know whether it is working. The usual answers (feature training, reviewing the finished page, counting output) reward the wrong things.

This guide covers the management habits that build judgment: what to teach first, the vocabulary you need, how to spread expertise, how to review work, what goal to set and what to measure. It follows the guide on making adoption stick on real work, which covers sessions, exercises and follow-up.

Teach checking before features

One team rolled out a new tool with a full curriculum: use cases, a prompt library, a wiki and a chat channel. Six weeks later adoption was still uneven. The gap was not knowledge of the tool. Almost nobody had been taught the habit that made every other skill usable: checking the output before trusting it. Teaching people to use a tool without teaching them to check it only teaches them to trust it faster.

Verification outranks the rest of the curriculum for three reasons:

It gets skipped because a slide about being careful looks like a footnote beside a flashy capability. The capability slide gets people to try the tool. The verification habit decides whether trying goes well.

Learn a handful of words well

A manager at a project review heard her team debate using "a model," "an agent" or "the AI" for a client problem and could not tell whether these were three tools or one described three ways. She was not behind on AI. She was behind on the handful of words her team used daily.

A manager who knows six words well asks better questions than one who knows sixty shallowly. Shallow vocabulary is worse than none, because it yields confident decisions on a wrong mental model. Someone who says "use an agent" without knowing it acts autonomously may approve far more independent authority than intended.

Make your thinking visible

An experienced analyst was often asked how she decided which parts of a report to trust and which to rewrite. She found it hard to answer until she began narrating while she worked: "I'm checking this number against the source table because it's the kind of thing the tool tends to get wrong." Within a week, two junior colleagues were making the same checks unprompted.

Narrating beats explaining afterwards. It captures the reasoning live, including the false starts. It shows what to check, not only what to do: watching someone accept an output teaches nothing, while hearing "I'd normally trust this, except the source data here is old" teaches the skill. And it costs nothing to start. It feels slower and more exposed at first, but the uncertainty is the part worth hearing.

Judge the decisions, not just the output

A manager gave one report a strong review and sent back another that read equally well. The difference was in the process. One person had checked the AI's numbers against the source and caught two errors. The other had accepted the draft as written.

When you review AI-assisted work, look for:

Grading only the finished page teaches that a clean result is what is rewarded, and so that checking is optional. A polished draft proves someone can prompt well, not that they checked anything.

Aim at orchestration, not speed

A manager pushed her team to use AI to finish tasks faster, and adoption stayed flat for months. It moved when the question changed from "how do I do this faster?" to "which parts should I hand off, which need my judgment, and how do I sequence them?"

Asking only how to go faster caps the gain at what the old process could be sped up to.

Measure time recovered

A director tracking adoption saw modest output gains until she asked people what had changed. The answer was fewer nights finishing a report at home. The dashboard never showed it. Time recovered, reduced dread and sustainability do not appear in output counts, and a team running on borrowed evenings looks productive until people leave. Ask your team directly, and include time back in the case for adoption.

What to do next

Series · Leading AI adoption · part 3 of 4
Keep reading
04 ยท Fluency Support

How do we stop this decaying in six months?

If this is the question on your desk, a thirty-minute call tells you whether the service fits, or that you do not need us yet.