Skip to content

Metrics — North Star: AI Enablement (WAEP)

Audience: Jordan + leadership.

North Star definition

WAEP = Weekly AI-Enabled Practitioners. Count of distinct Seer practitioners who used any engine capability for client work during a calendar week.

Who counts

  • Seer practitioner: any person employed by Seer or practicing on Seer client work, identified by company email or division roster.

  • Distinct: count each practitioner at most once per week.

What counts as use

  • Skill workflow run: practitioner executed a named skill workflow that contributed to client work (install, run, or output used in client deliverable).

  • MCP data pull: practitioner triggered an MCP query used to prepare or support client work that week.

  • App lookup: practitioner used one of the docs-site Vite apps (skill map, dependency graph, or registry) to find or reference content used in client work.

  • Manual confirmation: if telemetry is unavailable, documented confirmation from division lead or Slack feedback noting practitioner used site or skill that week.

Week boundary

  • Week runs Monday 00:00 to Sunday 23:59 UTC. Reporting uses week containing the Monday at 00:00 UTC start.

Leading indicators (L1)

Discover — weekly unique site visitors to docs/apps.

  • What: number of unique practitioner sessions that reached docs home or apps landing page.

  • Target: growth trend toward launch cohort; initial benchmark collected first 4 weeks.

Activate — quickstart → install-command clicks.

  • What: fraction of quickstart page views that click the install command or "Get started" CTA.

  • Expectation: 5%–15% conversion range for early rollout; track absolute clicks and conversion.

Return — repeat reference-page visitors.

  • What: practitioners who visit the same reference page more than once in a 14-day window.

  • Why: indicates return utility and embedded usage.

Guardrails

Docs-Freshness gate

  • Do not count a use toward WAEP when the practitioner cites "could not find" or "docs outdated" as the primary blocker in the same session. Flag such sessions for Docs-Freshness review.

Craft bar

  • Exclude sessions where the captured activity is automation noise (bot crawls, bulk scrapes) or internal testing. Use signal deduplication and author corroboration.

Measured today vs not yet

Metric Measured today? Notes
WAEP (Weekly AI-Enabled Practitioners) No No centralized skill telemetry yet; current estimate from Slack feedback sweep + division-lead pulse.
Discover (unique docs/apps visitors) Yes Web analytics available.
Activate (quickstart→install clicks) Yes Click events tracked on quickstart pages.
Return (repeat reference visitors) Yes Repeat sessions calculable from analytics.

Notes on measurement

  • Current WAEP is estimated. Priority: instrument skill runtime and MCP triggers to move WAEP from estimate to direct telemetry.

  • Until telemetry, use weekly Slack sweep + division-lead pulse to approximate practitioner counts. Document margin-of-error assumptions in every report.