Contractors’ Warehouse —
Senior Manager- Experimentation

Position Purpose:

We are seeking a visionary Senior Manager of Experimentation to lead and expand our experimentation practice and platform. This leader will collaborate with cross-functional teams, including Product, Engineering, Decision Science, and UX, to shape a comprehensive experimentation vision and execute strategies that enable trustworthy and impactful experiments throughout the product lifecycle. The ideal candidate will have a strong foundation in statistics, causal inference, and data modeling and will champion best practices in testing, personalization, and data visualization to drive business and product success. They will also work on the following:

• Define and Drive Experimentation Vision: Partner with Product, Decision Science, UX, and Engineering teams to establish a comprehensive experimentation strategy and roadmap that aligns with business goals.
• Build and Lead a High-Performing Team: Recruit, mentor, and manage a team of experimentation professionals with diverse skill sets, fostering a culture of analytical rigor and execution excellence.
• Experimentation Platform Ownership: Manage the experimentation platform roadmap, ensuring it supports stakeholder needs and advances the organization’s experimentation capabilities.
• Integrate Experimentation into Product Development: Develop an end-to-end experimentation process that is seamlessly integrated into the product and engineering lifecycle.
• Data-Driven Strategy: Translate experimental insights into actionable strategies that drive product innovation and empower decision-making.
• Metrics and Ecosystem Mastery: Deeply understand the product ecosystem, defining and analyzing metrics that evaluate performance and success.
• Executive Communication: Present insights, strategies, and research findings to executive leadership and key stakeholders, ensuring transparency and alignment across all levels.
• Thought Leadership: Share research and insights on advanced statistical methods, experimentation methodologies, user behavior, and metrics development to inspire organizational learning and innovation.

Key Responsibilities:

• 10% – Business Collaboration – Leverage extensive business knowledge into solution approach; Effectively develop trust and collaboration with internal customers and cross-functional teams; Partner with Other Orgs to understand potential for new tools and ways to maintain technical agility for advanced analytics.
• 10% – Communicating Results – Present analytics outcomes to enterprise leadership. Advocate for the team and their work.
• 40% – People Management & Team Leadership – Provide leadership, mentorship and coaching to Data Engineers (individual contributors) and evaluate performance, execution, and contribution; Attract, retain and develop top talent to build an effective and high performing team; Support team in development of business knowledge and technical skills with clear plans and regular assessment of progress; Ensure appropriate processes and job-specific requirements are properly documented; Develop onboarding and training plan for both technical and soft skills that will ensure high level of capabilities within the team; Manage resources effectively to align with strategic initiatives and business needs; Foster collaboration with team members to develop a supportive and engaged team; Support team in the design and development of algorithms and models to use against large datasets to create business insights; Drive team’s results and celebrate accomplishments.
• 15% – Project Management & Team Support – Prioritize and assign projects by striking a balance between a variety of factors, like funding, return on investment, innovative or challenging work, among others; Manage programs for the team to ensure consistency of execution, balance of resources and quality solutions; Collaborate with program managers and business partners to align on objectives and expectations and ensure project teams deliver against them; Serve as escalation point for any issues or difficulties with specific projects; Provide executive updates to leaders at all levels of the organization on program effectiveness, team accomplishments, summary of findings and recommended solution, and explain internal and external impacts.
• 25% – Strategy & Business Development – Leverage extensive business knowledge and relationships to seek out new business opportunities to leverage and advocate for team’s skills; Effectively develop trust and collaboration with internal customers and cross-functional teams; Ensure alignment with IT support model, collaboration, tools and governance to enable the team to be most effective in executing their roles; Collaborate with other data team managers across the organization to establish high level strategy and optimize talent management.

Direct Manager/Direct Reports:

• This position reports to the Director or Above
• This position has 4-5 direct reports

Travel Requirements:

• Typically requires overnight travel 5% to 20% of the time.

Physical Requirements:

• Most of the time is spent sitting in a comfortable position and there is frequent opportunity to move about. On rare occasions, there may be a need to move or lift light articles.

Working Conditions:

• Located in a comfortable indoor area. Any unpleasant conditions would be infrequent and not objectionable.

Minimum Qualifications:

• Must be 18 years of age or older.
• Must be legally permitted to work in the United States.
• Demonstrated expertise utilizing data analysis to identify key insights that help solve business problems.
• Experience managing and growing team members in a professional setting.
• Demonstrated experience with translating high level strategy to tactical execution.

Preferred Qualifications:

• 5+ years of hands-on leadership in experimentation within an eCommerce, social network, direct-to-consumer, media entertainment, or similar technology-driven company.
• Proven history of leading and elevating high-performing teams for 5+ years.
• Deep knowledge of statistical and analytical concepts, causal inference, and data modeling.
• Experience driving data-informed product decisions and influencing cross-functional stakeholders.
• Proven ability to develop and execute comprehensive strategies while balancing both platform development and organizational practice.
• Exceptional ability to communicate complex concepts effectively to both technical and non-technical audiences, including executives.
• Passion for fostering a culture of experimentation, analytical rigor, and continuous learning.
• Advanced degree in a related field (e.g., Statistics, Data Science, Computer Science, Business, or Economics) is a plus.
• Experience with experimentation tools and platforms, as well as data visualization and personalization strategies.

Minimum Education:

• The knowledge, skills and abilities typically acquired through the completion of a bachelor's degree program or equivalent degree in a field of study related to the job.

Preferred Education:

• The knowledge, skills and abilities typically acquired through the completion of a master's degree program or equivalent degree in a field of study related to the job.

Minimum Years of Work Experience:

• 7

Preferred Years of Work Experience:

• 8

Minimum Leadership Experience:

• No previous leadership experience

Preferred Leadership Experience:

• 1+ year of previous leadership experience

Certifications:

• None

Competencies:

• Decision Quality
• Collaborates
• Drives Engagement
• Ensures Accountability
• Plans and Aligns
• Communicates Effectively
• Customer Focus
• Develops Talent
• Drives Results