PostHog Metric
Product Analytics
A/B test performance evaluates the outcomes of PostHog experiments by comparing engagement, conversion, and retention metrics across control and treatment variants. It determines whether feature changes produce statistically significant improvements and quantifies their impact on downstream business metrics.
Full guide: definition, formula, and benchmarksA/B Test Performance
A/B test performance evaluates the outcomes of PostHog experiments by comparing engagement, conversion, and retention metrics across control and treatment variants. It determines whether feature changes produce statistically significant improvements and quantifies their impact on downstream business metrics.
Why a/b test performance matters for PostHog users
PostHog's experimentation framework measures whether a variant wins on its target metric. But a variant that lifts signup conversion by 5% may simultaneously increase churn by 3%. Understanding the full impact requires connecting experiment results to your complete metric tree.
Mapping A/B test results into your metric tree reveals the cascading effects of each experiment across engagement, retention, and revenue. This ensures product decisions are based on holistic business impact, not isolated metric improvements.
Understand and act on a/b test performance with KPI Tree
KPI Tree connects experiment data from your warehouse and maps variant performance across your full metric tree - not just the target metric. Track both primary and secondary outcomes.
Assign RACI ownership to your experimentation lead. Set alerts for statistically significant results and track how experiment decisions affect downstream metrics over time.
Get started with your PostHog data
Pull metrics from PostHog directly through the Model Context Protocol.
Connect your existing warehouse where PostHog data already lands.
Our professional services team can build you turn-key AI foundations in a matter of weeks. Data warehouse on Snowflake/BigQuery, ELT with Fivetran, all modelled in dbt with a semantic layer.
Related PostHog metrics
Feature Flag Impact Analysis
Product AnalyticsMetric Definition
Feature flag impact analysis evaluates how PostHog feature flags and gradual rollouts affect engagement, conversion, retention, and revenue metrics. It measures the business impact of enabling or disabling features for specific user segments, providing evidence for rollout decisions.
Conversion Rate
Product AnalyticsMetric Definition
Conversion Rate = (Users Completing Action / Total Users in Cohort) x 100
Conversion rate in PostHog measures the percentage of users who complete a defined conversion action - such as signing up, activating a feature, upgrading to a paid plan, or completing a key workflow. It quantifies how effectively your product converts users at each stage of the journey.
User Retention Rate
Product AnalyticsMetric Definition
Retention Rate = (Users Active in Period / Users Active in Previous Period) x 100
User retention rate measures the percentage of users who return to your product within a defined period after their first use, based on PostHog event data. It is the inverse of churn and the primary indicator of whether your product delivers sustained value over time.
Feature Adoption Rate
Product AnalyticsMetric Definition
Feature Adoption Rate = (Users Who Used Feature / Total Eligible Users) x 100
Feature adoption rate measures the percentage of eligible users who have used a specific feature within a defined period after its release or their first login. It quantifies how effectively your product introduces users to new and existing capabilities.
Funnel Conversion Analysis
Product AnalyticsMetric Definition
Funnel conversion analysis tracks user progression through defined multi-step journeys in PostHog - from initial action through intermediate steps to final conversion. It measures the conversion rate at each step and identifies where the largest opportunities for improvement exist.
Explore a/b test performance across integrations
All PostHog metrics
Empower your team to understand and act on PostHog data
Map what drives your metrics, measure progress at any grain, prove what works statistically, and deliver personalised action plans to every team member.