A/B Testing Lead

Marketing & Creative
in Boston
, MA
Reference: 19-03810


This role requires expert knowledge and professional application of data analytics and advanced optimization methodologies, including prior experience working with the Adobe Experience Cloud (Adobe Analytics, Adobe Target). This role will collaborate with cross-functional teams and leadership to lead an optimization program that instills best practices and drives continuous improvements to establish a best in class program. This role is responsible for optimization and the underlying analytics, supporting the full project lifecycle from ideation through launch, including, defining processes, metrics, ways to optimize/scale up, and leading complex technical projects for the analytics and optimization team. In addition, this role will support the team in an optimization capacity as needed and requires experience in optimization site and digital media.


  • Develop and enhance multi-year optimization roadmap
  • Lead optimization team
  • Deliver timely, effective, easily understood, concise program deliverables including program roadmaps, governance plans and presentations, project calendars, cross-project dependencies, risks analyses and mitigation, key performance indicator (KPI), stakeholder coordination and status communication via multiple mediums
  • Drive multiple project teams to successful outcomes, balancing the work of internal teams with the expectations of multiple external stakeholders
  • Develop optimization measurement framework
  • Own and manage program delivery plans, schedule, scope
  • Partner to analyze and estimate feasibility, costs and time for analytics team projects and milestones
  • Facilitate the development of program strategy, governance and communications
  • Develop full program plans including milestones, deliverables, resourcing, dependencies, development, escalation and communication
  • Perform deep dive analysis where applicable in support of the analytics and optimization team
  • Develop strategic approach to manage workload efficiently analyzing and optimizing workflows and processes
  • Maintain ongoing transparent communication with stakeholders as it relates to program status and risks
  • Identify dependencies across project/product teams while facilitating and building consensus to ensure minimal risk to program delivery
  • Manage vendor relationships and contractual agreements in the context of project/program delivery
  • Build partnerships across organizational, departmental, and geographical boundaries with the ability to manage vendors
  • Present data to partner teams, executives and other business leaders across the organization to drive analytics and optimization initiatives
  • Mentor team members in building and testing programs and reporting to ensure and demonstrate quality and drive knowledge sharing


  • Bachelor’s degree in a quantitative discipline (statistics, economics, mathematics, marketing analytics)


  • 5+ years of experience in digital marketing analytics field
  • Proficient in Adobe Analytics, Adobe Target
  • Understanding of online measurement and analytics, with the ability to provide meaningful and actionable insights and analysis
  • Professional application of statistical confidence, statistical power, confidence internals and how to apply them for digital optimization
  • Strong analytical background demonstrating an ability to understand business problems, analyze trends, draw conclusions and make actionable recommendations to apply analytics to automate workflow
  • Demonstrated ability to lead and develop people
  • Proven history to manage vendors
  • Experience managing a budget