We've exceeded our experimentation targets this quarter with 9 experiments launched (target: 6-8).
The "Deselected by default product selection" Law vertical experiment delivered exceptional results with a 112.5% increase in submissions and
11.4% growth in premium revenue for the variation.
Experiments Launched
9
Target: 6-8
Active Weeks
83%
Target: 70%
Key Experiment Wins
CLEAR WIN
Law Vertical Product Selection
▲ 112.5% submission rate
▲ 88.9% increase in binds
▲ 11.4% premium revenue
CLEAR WIN
Website Field UX Improvements
▲ 11% signup started to completed conversions
▲ 5.2% in # of application where website info is provided
Experiment Distribution
Experiment Velocity
2
Fast-track (<1 week to launch)
3
Standard (1-2 weeks to launch)
4
Complex (2-4 weeks to launch)
Distribution of Outcomes
Promising/Mixed
1
Target: 2-3
Learning Experiences
2
Target: 4-5
Q1 2025 Experiments
| Experiment |
Status |
Outcome/Notes |
| Currently Live |
|
Email placement
|
LIVE |
AB test still running |
|
Security Scorecard credit impact
|
LIVE |
AB test still running |
|
Deselected product selection page - Tech vertical
|
LIVE |
AB test still running |
|
Coverage page blog layout
|
LIVE |
AB test still running |
| Successful Experiments |
|
Website field UX
|
SUCCESS |
Rolled out to all users |
|
Deselected product selection page - Law vertical
|
SUCCESS |
Rolled out to all users |
| Inconclusive Experiments |
|
Get a Quote Nav CTA MVT
|
INCONCLUSIVE |
No significant impact observed |
|
Homepage hero industry dropdown
|
INCONCLUSIVE |
Due to bug. Rolled out for a before and after analysis - currently live |
| Failed Experiments |
|
Startup Page headers MVT
|
FAILED |
Continuing to AB test in collaboration with Product Marketing Management to rapidly test different value propositions through industry landing page headers |
Next Quarter Focus
1
Enhance quote-to-bind conversion in the technology vertical through strategic initiatives that includes retargeting of users hesitant to complete online binding by evangelizing our brokerage services to qualified customers, and addressing knowledge barriers to increase end-to-end digital conversions.
2
Finalize ongoing Q1 initiatives including Tech vertical toggle, email placement optimization, and Zip code validation tests that aim to continue optimizing to middle of the funnel micro-conversions
3
Balance our experimentation portfolio by introducing 2-3 retention-focused tests targeting existing customer engagement and satisfaction through self-service
4
Establish a structured framework for customer expansion experiments to identify upsell and cross-sell optimization opportunities