Lab  /  Experiment

Pulse

A voice-led organizational diagnostic experiment.

StatusLive, invite-only alphaInterview25 questions, about 40 minutesTypeExperiment

The experiment

Kill the questionnaire.

Pulse takes a proven organizational diagnostic that sat locked inside a DOS program for more than two decades and replaces its questionnaire with a condensed voice interview. Instead of filling in a long form, a leader talks for about 40 minutes with an agent that asks 25 questions and probes for context when an answer needs it. The conversation is then scored two ways: by a language model reading what was said, and by the original method's deterministic engine.

It started as a weekend hackathon that my dear friend Mo Sersouri organized: first, my friend Stephan cracked the old code, and I designed what the new experience could feel like over a weekend. A lot has happened since, and it is now live at getyourpulse.io as an invite-only alpha. We ran the interviews ourselves, then tested with a small control group of external participants. The diagnoses held up.

The thesis, in one line: kill the questionnaire, drive insights, and perhaps remove the need for the consultant altogether. The original idea was to democratize access to this kind of assessment for any mid-size firm, without the cost of a heavy engagement. And most importantly:

A condensed voice interview, scored on top of a deterministic engine, can surface what people do not write down: what they avoid, how they hesitate, what they reveal without meaning to.

Where it started

A method tested hundreds of times.

The method is decades old and was tested hundreds of times before I ever touched it. It began when the managing partner of one of the world's largest accounting firms commissioned an expert system to diagnose the non-financial side of a company: strategy, structure, culture, leadership. An organizational development firm spent more than ten years building and validating it. The questionnaires and their output were tested in more than 100 offices, with over 1,000 clients, in five countries.

Todd Wheeler, the consultant behind Management Insight, carried that method forward. His process was simple to describe and hard to scale: send each respondent a long questionnaire drawn from a bank of 164 questions (deep enough to run a level 1, 2 or 3 assessment as the engagement needed), run the answers through the scoring program, then apply his own judgment to decide what the report should say and how to deliver it. The framework places an organization on an 8-stage lifecycle, from Launch to Stall, names the growth engine and the major crisis that come with its stage, and reads its culture, strategy, structure, leadership style and risk.

The scoring logic, though, had been locked for more than two decades inside an old DOS program: proprietary script files, compressed archives, the same logic running since the late 1980s.

Then came the hackathon. Mo called it Days of Future Past, with the line “same genius, no floppy disk required.” Over one weekend, my friend Stephan did the archaeology that unlocked the original DOS software: opening the legacy files, decoding the scoring scripts and getting the program to run again under emulation. He passed it to me, and I took the other half: designing what this experience might feel like for a respondent today, and then building it from scratch. By Sunday we had a voice agent asking questions that felt really premium (and cost accordingly on ElevenLabs), a model scoring the answers against the recovered framework, and a report on screen. Pulse grew out of that weekend. Todd was floored, and thought we should run with it.

The thesis

Kill the questionnaire, and more.

A questionnaire captures what people are willing to tick. A conversation captures how they think. So instead of porting the form to a screen, we replaced it.

We settled on 25 questions, each with its own follow-up probe, designed to draw out long-form, natural, instinctive answers. Together they cover the ground the original questionnaire covered, condensed into an interview of about 40 minutes. The agent asks, listens, and probes for more context only when an answer is thin. A shorter 8-question version (about 10 minutes) exists for two reasons: to make testing easy, and to power the free tier.

That raised three questions this experiment set out to answer:

  1. Can a 40-minute interview run at scale, cost-effectively? The consultant's time was the bottleneck. With a voice agent, the question becomes unit economics.
  2. Is 40 minutes the right target? It is already a big compression of the original process. But a voice agent changes the trade-off between depth with one person and breadth across a team.
  3. Do voice, speech and emotion calibration, scored on top of a deterministic engine, surface insights that stay invisible on paper? This is the core thesis.

Modernizing the method

Keep the constructs, rewrite the words.

We kept the constructs and rewrote the words. The governing rule was actualized for today, truth intact: the stages, cultures and dimensions stay; anything that only made sense in a 1987 office goes.

I went through the original question bank item by item. Of 164 original items, 118 were refreshed into natural spoken language, 27 were dropped, and 12 were merged. Questions about secretaries and filing drawers had nothing left to diagnose; physical records management became questions about data and digital infrastructure. We added 35 new items for things the original could not see: AI adoption, remote and distributed work, psychological safety, purpose, and platform business models. The original 11 culture types gained three modern ones: Mission-Driven, Platform/Network and Community-Led.

Basic facts like headcount, age and revenue are no longer asked as checkboxes. They are inferred from how people describe their company in the opening minute.

What exists today

A working product with three audiences.

Pulse is a working product with three audiences, each with its own surface.

Behind the interview is a full back end, not a demo. A consultant or an organization gets its own workspace, set up through a short onboarding that forks by audience. In it they create engagements, build a roster of respondents with personal links or QR codes, and watch each person move from not started to in progress to scored. Individual reports land as they finish. Once enough people have spoken, a group report compares them: where the team agrees, where it diverges, a playbook for each divergence, and an agenda for the readout meeting. Reports export to PDF. Accounts are invite-only, with referral invites and usage caps. Underneath sit an asynchronous scoring pipeline that can safely re-run any interview, and an operator console for accounts, costs and failures.

One design rule shapes every report: each claim cites the respondent's own words, shown inline as quotes, so anyone reading can audit a finding in seconds.

The alpha is invite-only. Accounts are minted by hand, each with a small assessment cap and a few referral invites, and every new account is seeded with a fictional sample engagement so the product makes sense before anyone records a word.

WhoWhat they doWhat they get
RespondentOpens a link on their phone, answers a short intake, then talks with the agent: 8 questions (Lite) or 25 (Full)A report: developmental stage on a curve, culture (present, secondary and actively discouraged), leadership and strategy dimensions, clinical observations, a critical risk, a critical recommendation, and the stage’s growth engine and likely crisis
ConsultantCreates an engagement, sends per-respondent links or QR codes, watches who has startedA group report built around divergence: where the team does not see the same organization, a playbook per flag, and a readout agenda
Operator (me)Runs the alpha: invites, caps, costs, failures, re-scoresA console that works on IDs, counts and error strings, never on transcript content

Architecture

Every interview is scored twice, then rolled up for the team.

The voice layer swaps behind a single flag. Everything after the transcript runs in the Pulse app on Vercel, with Supabase Postgres as the system of record and Claude doing both the scoring and the mapping onto the original questionnaire.

How Pulse worksFrom a respondent on a phone to a team readout.

1 · Voice interviewOn their phone; 25 questions (or 8). Self-hosted voice ready2 · IntakeSigned webhook, instant reply; scoring runs in the backgroundPass 1 · LanguageClaude reads the wordsPass 2 · Original scoring1987 weights score it3 · Individual reportAgreement raises confidence; divergence is a signal4 · Group reportDivergence flags, a playbook per flag, a readout agendaConsultant or organization workspaceEngagementsRosters, links and QR codesProgress per respondentIndividual and group reportsPDF exportOperator console: accounts, usage, costs, failures, re-runs. IDs only, never content.linksreportreport

Scroll sideways to see the whole diagram.

Every interview is scored twice

Question 1

Can a 40-minute interview run at scale, cost-effectively?

Yes on paper, about 5 to 6 times cheaper than the managed route, and essentially ready to switch on. The surprise was where the cost sits. The AI scoring is nearly free. The voice minutes are not.

Scoring costs cents. Across 23 logged production scoring runs, one individual report averaged about 4,000 input and 2,150 output tokens, roughly $0.04 at list pricing. The deterministic second pass adds about $0.04. A group report for a whole team costs about $0.07.

Voice costs dollars. On a managed voice-agent platform, a 40-minute interview runs about $0.11 to $0.16 per minute all-in, or $4.40 to $6.40 per interview. Worse, the plans sell concurrency through monthly minute buckets. Consulting demand is the opposite shape: an idle month, then 2,000 minutes in one week when an engagement launches.

Self-hosting cuts a 40-minute interview to about $0.75 to $1.00All-in cost per 40-minute interview, low to high estimate, by voice platform. The square marks the midpoint.

$0$2$4$6$8Self-hosted (chosen): $0.75 to $1.00 per interview, midpoint $0.88Self-hosted (chosen)$0.75 to $1.00Gemini Live: $0.80 to $3.20 per interview, midpoint $2.00Gemini Live$0.80 to $3.20Pipecat Cloud: $2.40 to $4.00 per interview, midpoint $3.20Pipecat Cloud$2.40 to $4.00LiveKit Cloud: $2.40 to $4.00 per interview, midpoint $3.20LiveKit Cloud$2.40 to $4.00OpenAI Realtime: $2.40 to $4.40 per interview, midpoint $3.40OpenAI Realtime$2.40 to $4.40ElevenLabs Agents (today): $4.40 to $6.40 per interview, midpoint $5.40ElevenLabs Agents (today)$4.40 to $6.40Vapi: $4.40 to $8.00 per interview, midpoint $6.20Vapi$4.40 to $8.00Retell AI: $6.00 to $7.00 per interview, midpoint $6.50Retell AI$6.00 to $7.00

Source: Pulse ADR 002, vendor pricing pages plus computed estimates, July 2026.

What we chose. Mo, a dear friend and project collaborator who is as passionate about voice as I am, started building an open-source voice pipeline (Pipecat orchestration, LiveKit transport) precisely so we could move off the managed platform, and potentially as shared infrastructure for all of our voice agent experiments. I forked it and run it on a server I already operate. I compared it against seven alternatives. Speech-to-text is a rounding error. The interviewing model's cost drops about 5 times with prompt caching, from roughly $1.10 to $0.20 per interview. Computed total: about $0.75 to $1.00 per 40-minute interview, or $40 to $70 for an engagement month of 50 interviews instead of $220 to $320.

Where it stands. The pipeline is built, deployed, secured and smoke-tested, and the app switches to it with a single flag. The managed platform stays wired in permanently as the fallback. What is left is the step I am slowest at: choosing the voice. The interviewer's voice is part of the product, and I am picky. Once a voice wins the audition, the $0.75 figure stops being a model and becomes a measurement.

The cheapest minute is the one never spoken. Moving intake questions out of the conversation and cutting the greeting from about 50 words to 15 saved time on every single session.

Question 2

Is 40 minutes the right target?

Forty minutes is already the big win: it replaces a long questionnaire plus a consultant's analysis. The open question is whether it should be the default, or whether short interviews with many people sometimes tell you more. The short version was built for testing and the free tier, but the data it produced is instructive.

Some preliminary findings:

  • Short only works if every question earns its place. An audit found the 8-question version was scoring five leadership dimensions without asking a single leadership question. Swapping a revenue warm-up for an accountability question fixed the gap without adding time.
  • The valuable finding is disagreement, and disagreement needs breadth. A CEO who sees an organization in confident growth while the head of engineering describes coordination breaking down is the insight a client pays for. One deep interview cannot produce it. Ten short ones can.

There is a real tension here, though. The deterministic engine needs depth: a long interview yields about 120 answerable items for it, a short one about 30, too few to run it at all. So the working answer is a mix rather than a replacement: short interviews across the whole team for divergence, the long form for the one or two people whose read anchors the diagnosis, and eventually adaptive questioning that goes deeper only where answers conflict.

Real voice interviewsMedian length when completedDesigned length
Lite (8 questions)5.1 minAbout 10 min
Full (25 questions)18.3 min (longest 43.8)About 40 min

Question 3, the core thesis

Voice and emotion on top of deterministic scoring.

The language layer is built and working. Calibrating the voice itself is the next layer.

Pass one: score the language, not the claims

The rule is “score what the language demonstrates, not what the respondent claims to believe.” So the first pass reads far more than the content of an answer: the words chosen, contractions, hesitations, fillers and self-corrections, silences, “I” versus “we,” past tense on a growth story, passive voice around failure, and which topics get volunteered or avoided. Every finding has to quote the respondent's own words, so any conclusion can be checked in seconds.

This is where a form goes blind. In our test group, one founder said plainly that they owned every decision, then went silent twice when asked about a hard decision and a recent failure. The report scored decisiveness as claimed but contradicted, and flagged that nobody else could actually decide. On the questionnaire, that founder would simply have ticked “strongly agree.”

Reports also sort the evidence into what the respondent already named, what is a blind spot (signal present but never acknowledged), and what is not on the radar at all. The blind spots are usually the most useful part.

Pass two: check it against the original scoring

Then the same conversation is scored against the original method. A model maps what was said onto the original questionnaire items, and the recovered weighted-sum engine scores those answers deterministically. When the two passes agree, confidence goes up. When they diverge, the divergence itself is shown as a signal.

Did it work?

We ran the interviews ourselves first, with anyone willing to test on their own business, then with a small control group of external participants. The diagnoses held up: people recognized their organizations. Across our evaluation set, every report carries 7 to 8 cited evidence items, and after several rounds of prompt changes all 5 evaluation cases kept the same primary stage and culture.

One honest caveat. When we replayed the original program's own two reference cases through the recovered engine, the verdicts did not fully reproduce. The likely causes are descriptor questions we do not score yet, industry-specific weight files we have not decoded, and a profile-matching step rather than a simple sum. Until that is resolved, the deterministic panel is labelled directional in every report, and the mismatch is pinned as a known-failing test so any fix announces itself.

Next: calibrating the voice itself

Today, hesitation is captured as it shows up in the transcript: pauses, fillers, broken sentences. What we do not measure yet is the sound: tone, pitch, pace, energy. Owning the voice pipeline (Question 1) is what opens that up, because the audio and the timing of every turn pass through our own server. The plan, in order:

  1. Timing first. Response latency, pause length and speech rate per turn. Cheap and model-free.
  2. Calibrate to the person, not a universal scale. Use the warm-up questions as each respondent's baseline, then flag deviations on the sensitive probes: power, failure, accountability.
  3. Attach how it was said to what was said. Every quoted citation gains its delivery: said confidently, or said after a long pause.
  4. Voice as evidence, never as verdict. The deterministic engine stays the baseline. The voice layer raises or lowers confidence and flags contradictions. It never scores anyone on its own.
  5. Prove it helps. Blind review: do people prefer the reports with the voice layer, and do the flagged contradictions hold up in follow-up?

Guardrails come first: explicit consent to analyse delivery, no raw audio kept by default, no inference of protected traits, and no “lie detector” framing. The goal is calibration, not judgment.

Decisions so far

Each one traded something away.

Three decisions have formal architecture records; the rest are standing rules in the codebase. Each one traded something away.

DecisionWhyWhat it cost
Score every transcript twice: language model plus the 1987 deterministic engineOne pass is a black box; two passes make agreement and disagreement visibleA second model call per report, and an engine that turned out not to match its own ground truth
Every finding must quote the respondent’s wordsMakes every diagnosis auditable in seconds and keeps the model honestLonger outputs; one group report overflowed its token limit mid-answer before the cap was raised
Pin the scoring model; any change re-runs a 5-case validationDifferent model versions score differently, and two pinned versions were retired by the provider within monthsSlower to adopt new models
Webhooks return instantly; scoring runs in the background, can be safely re-run, and a sweeper catches stuck sessionsA 40-minute interview must never be lost to a timeoutMore states to reason about (paused, abandoned, failed, scored)
The methodology lives in the database, not in codeQuestions, cultures and modules can evolve without a deployThe voice agent’s prompt must be kept in sync by hand, a known weak point
Short interview is the default on every public entry pointThe long form was too long for cold trafficThe deterministic engine cannot run on short interviews
Group reports lead with divergence, not consensus“You do not see the same organization” is the finding worth paying forNeeds several respondents per engagement before it says anything
ADR 001: invite-only accounts via hand-delivered sign-in linksLet real testers work in isolated workspaces without building email infrastructure firstManual invites; does not scale past an alpha
ADR 002: self-host the voice pipeline; keep the managed platform as permanent fallback5 to 6 times lower cost per interview and access to the raw audioA second system to operate; the switch now waits only on choosing the voice
The operator console works by reference, never by contentAs the operator, I should not be able to read other tenants’ confidential diagnosticsSupport and debugging have to work from IDs, timings and error strings alone

What's planned next

Smallest proving step first.

Ordered by what unblocks what.

  1. Voice cutover. Choose the voice (the hard part, for me), run one end-to-end short interview on the self-hosted pipeline, switch short interviews, observe, then switch long ones. Unblocks a measured cost per interview and access to the audio.
  2. Make the reports palatable. Today they are dense and clinical: accurate, well cited, and a lot to take in. The next version leads with a plain-language summary, explains each section in a sentence before the detail, and trades raw 0 to 10 numbers for intensity words like high, moderate and low, the way the original consultant reports did. Independent of everything else, and it matters most to the people who read them.
  3. Re-derive the deterministic engine. Decode the original program's own weight files, score the descriptor questions we skip today, and handle industry variants, until the original reference cases reproduce. Unblocks a baseline worth calibrating against.
  4. Calibrate the voice, once 1 and 3 land: timing signals, then per-person baselines, then delivery attached to citations, then a blind review with consultants (see Question 3).

What I don't know yet

The biggest open questions are not technical.

  • Is this a business at all? Who pays (consultants, leadership teams, HR), for what, and how often?
  • Where are diagnostics and leadership development heading now that AI is everywhere? If every leader has an AI coach in their pocket, does a point-in-time diagnostic still matter, or does it become something continuous?
  • Can it deliver value immediately? A diagnosis is only worth what it changes. The real prize is actionable insight a team can use the week it arrives, not a report that gets filed.
  • Does it extend to employee happiness? It is a crowded survey space. Speaking from experience, a Qualtrics-style survey surfaces key themes, but I am convinced so much is left on the table: the why behind a score, and everything people will not type into a box. A short voice conversation with every employee might reach it.
  • How it holds up at volume. Our own interviews and a small external control group worked. Hundreds of organizations across industries, all willing to speak openly to an agent about power and failure, is a different test.
  • Whether calibrating the voice adds insight or just noise. If the blind review says it does not help, that is a finding too.
  • How far a framework born in the 1980s stretches for organizations with remote teams and AI in the workflow. The modernized questions and culture types are a start, not the final answer.

What I am confident about is narrower: a voice agent can hold a structured diagnostic conversation, the scoring costs cents, every claim can be traced to the words that produced it, and the most valuable output is where a leadership team disagrees with itself.

This has been a fascinating experiment. If you have thoughts on the method, the business, or where this space is going, I would love to hear them.

Talk to me

Thoughts on the method, the business, or where this space is going? I would love to hear them.

cassandra@instinctai.io

Instinct AI LLC, Tulum, Mexico