Director, CRO & Analytics

About the role

The Director of CRO leads ehouse's conversion optimization practice as a data analyst and behavioral scientist first, translating quantitative signals into revenue-driving changes across client Shopify experiences. This role owns the analytics backbone of experimentation, statistical modeling, segmentation, and reporting and converts that data into testing hypotheses, prioritized roadmaps, and measurable outcomes for DTC and omnichannel brands.

The ideal candidate treats every optimization decision as a data question: what the funnel and cohort data show, whether a result is statistically significant, and what segment-level analysis recommends next. Deep, hands-on fluency in analytics platforms (GA4, Shopify, BigQuery, SQL) and experimentation statistics is core to this role, not a nice-to-have.

What You'll Do

Client Strategy & Leadership

• Lead strategic CRO engagements for DTC ecommerce brands, including discovery, ongoing retainers, and ad hoc consulting initiatives, grounded in each client's analytics data from day one
• Serve as the client's data-driven strategy partner across site experience, merchandising, acquisition and retention, analytics, UX, and digital product roadmaps
• Partner with clients to develop and execute data-driven strategies aligned with both short- and long-term business objectives, backed by funnel and cohort analysis

CRO, UX & Experimentation

• Identify conversion optimization opportunities across the full customer funnel, from landing pages and PDPs to checkout and post-purchase experiences, using quantitative funnel and behavioral analysis
• Develop data-backed hypotheses and testing roadmaps with UX, Design, and Development, prioritized by statistical confidence and revenue impact
• Design, execute, and analyze A/B and multivariate tests, applying appropriate statistical methods (sample size, significance, power) to translate results into prioritized recommendations
• Monitor test and site performance continuously, flagging data anomalies and iterating on quantitative findings

AI-Driven Experience Optimization & Personalization

• Lead the evolution of CRO from traditional A/B testing to AI-enabled experimentation and real-time personalization, grounded in behavioral and transactional data
• Embed AI across the experimentation lifecycle, from data-driven insight generation to test design, to increase test velocity
• Drive measurable conversion impact by using AI to optimize testing strategy, execution, and performance analysis

Analytics, Insights & Reporting

• Own monthly analytics reporting for every client: build, QA, and deliver a monthly performance report covering traffic, conversion, revenue, channel mix, and test results, with prioritized recommendations.
• Own analytics implementation and data integrity: GA4 and Google Tag Manager configuration, Shopify Customer Events and pixels, consent mode, bot and spam filtering, and regular reconciliation of analytics data against Shopify orders.
• Own analytics implementation and data integrity: GA4 and Google Tag Manager configuration, Shopify Customer Events and pixels, consent mode, bot and spam filtering, and regular reconciliation of analytics data against Shopify orders.
• Executive dashboards: Build automated, granular performance dashboards in BI tools (Looker) that visualize conversion trends, test impact, and revenue attribution for client leadership
• Quantitative analysis: Own funnel analysis, cohort analysis, and segmentation to identify where and why conversion breaks down
• Statistical modeling: Apply statistical modeling and hypothesis testing to validate experiment results and forecast expected impact
• Financial and growth modeling: Lead ROI forecasting, revenue growth modeling, and CLV analysis to quantify the business case for recommendations
• Mixed-methods research: Combine quantitative data analysis with qualitative inputs, user testing, surveys, interviews, persona development, journey mapping, and competitive/heuristic audits to build the full picture
• Synthesize complex, multi-source data into clear, data-backed narratives and recommendations that let clients make informed decisions quickly
• Serve as final QA on all analytics and CRO deliverables before they reach clients, oversee CRO contractors and vendors, and maintain the central CRO task board in Asana.

Cross-Functional Collaboration

• Collaborate closely with UX, Design and Technical Delivery teams to ensure continuity from strategy through execution across:
• • New site builds and migrations
  • Redesigns and feature launches
  • Ongoing site optimization and maintenance
• Contribute to internal best practices, frameworks, and thought leadership related to CRO, UX, and eCommerce strategy.

What You Bring

Required:

• Bachelor’s degree in Marketing, Business, Analytics, UX,, or a related field (Master’s degree a plus or equivalent professional experience)
• Proven experience leading CRO initiatives as a data-first practice, mentoring team members, guiding cross-functional teams, and owning client strategy from discovery through execution
• Advanced proficiency in eCommerce analytics, with the ability to translate raw data into clear insights and prioritized, revenue-ranked actions
• Hands-on experience with statistical modeling for web experiments, including hypothesis testing, sample size and significance calculations, and segmentation
• The ability to translate data into clear insights and prioritized actions.
• Hands-on experience with A/B testing and experimentation tools such as Intelligems, VWO, Optimizely, Shoplift, Visually, or similar
• Advanced, hands-on proficiency with Google Analytics (GA4), including custom reporting, funnel and segmentation analysis
• Experience building a prioritized, resourced testing roadmap grounded in quantitative impact estimates
• Shopify platform experience
• Experience partnering with UX, Design, and Development teams to bring insights and experiments to life.
• Experience conducting UX analysis, usability testing, and heuristics evaluations.
• Excellent communication and presentation skills — comfortable presenting data and statistical findings to both client stakeholders and internal teams
• Highly organized, detail-oriented, and able to manage multiple client engagements in a fast-paced environment

Preferred:

• Prior agency experience supporting multiple brands and workstreams
• Experience with Klaviyo or other email/retention platforms, and how retention data informs CRO
• Cross-channel media literacy (paid social/search) to speak to how traffic quality and acquisition data affect test reliability
• Working proficiency with BigQuery and SQL for independent, ad hoc data analysis