A/B Testing & Optimization Course — XP² Learning Center https://www.dynamicyield.com/course/testing-and-optimization/ Wed, 09 Oct 2024 21:23:13 +0000 en-US hourly 1 There are no failed A/B tests: How to ensure every experiment yields meaningful results https://www.dynamicyield.com/lesson/no-failed-ab-tests/ Thu, 20 Aug 2020 22:11:12 +0000 https://www.dynamicyield.com/?post_type=lesson&p=135394

With a comprehensive testing methodology and a renewed perspective toward experiment analysis, marketers can start gleaning meaningful insights from every A/B test, no matter the outcome.

The post There are no failed A/B tests: How to ensure every experiment yields meaningful results appeared first on Dynamic Yield.

]]>
135394lesson en Personalization and Testing Frameworks https://www.dynamicyield.com/tags/personalization-and-testing-frameworks/ 135394 https://www.dynamicyield.com/lesson/no-failed-ab-tests/ August 20, 2020 lesson A/B Testing & Optimization, Agnostic, Personalization and Testing Frameworks, Analytics, Conversion Optimization, eCommerce, Marketing, Product Management, Tactical Guides, Thought Leadership, A/B Testing & Optimization
Guidelines for running effective Bayesian A/B tests https://www.dynamicyield.com/lesson/running-effective-bayesian-ab-tests/ Thu, 09 Jul 2020 12:45:26 +0000 https://www.dynamicyield.com/?post_type=lesson&p=131426

In this post, we describe the basic ideas behind Bayesian statistics and how they feed into business decisions you will need to make at the end of a test.

The post Guidelines for running effective Bayesian A/B tests appeared first on Dynamic Yield.

]]>
131426lesson en Personalization and Testing Frameworks https://www.dynamicyield.com/tags/personalization-and-testing-frameworks/ 131426 https://www.dynamicyield.com/lesson/running-effective-bayesian-ab-tests/ July 9, 2020 lesson A/B Testing & Optimization, Agnostic, Personalization and Testing Frameworks, Analytics, Conversion Optimization, Marketing, Tactical Guides, A/B Testing & Optimization
A/A testing and decision making in experimentation https://www.dynamicyield.com/lesson/aa-testing-in-experimentation/ Thu, 09 Jul 2020 12:37:49 +0000 https://www.dynamicyield.com/?post_type=lesson&p=131419

A/A testing is meant to check that the underlying system is running properly. In this post, we'll cover some of subtle issues to consider as you run them.

The post A/A testing and decision making in experimentation appeared first on Dynamic Yield.

]]>
131419lesson en Personalization and Testing Frameworks https://www.dynamicyield.com/tags/personalization-and-testing-frameworks/ 131419 https://www.dynamicyield.com/lesson/aa-testing-in-experimentation/ July 9, 2020 lesson A/B Testing & Optimization, Agnostic, Personalization and Testing Frameworks, Analytics, Conversion Optimization, Marketing, Tactical Guides, A/B Testing & Optimization
Client-side vs server-side A/B testing and personalization https://www.dynamicyield.com/lesson/client-side-vs-server-side/ Thu, 02 Jul 2020 14:54:24 +0000 https://www.dynamicyield.com/?post_type=lesson&p=130425

client-side vs server-sideAn in-depth analysis of the most important technical considerations when comparing client-side vs server-side rendering.

The post Client-side vs server-side A/B testing and personalization appeared first on Dynamic Yield.

]]>
130425lesson en Personalization and Testing Frameworks https://www.dynamicyield.com/tags/personalization-and-testing-frameworks/ Personalization Infrastructure https://www.dynamicyield.com/tags/personalization-infrastructure/ 130425 https://www.dynamicyield.com/lesson/client-side-vs-server-side/ July 2, 2020 lesson A/B Testing & Optimization, Agnostic, Personalization and Testing Frameworks, Personalization Infrastructure, Conversion Optimization, Development, Leadership, Product Management, Thought Leadership, A/B Testing & Optimization
The impact of A/B tests and personalization on SEO https://www.dynamicyield.com/lesson/impact-of-ab-testing-on-seo/ https://www.dynamicyield.com/lesson/impact-of-ab-testing-on-seo/#comments Fri, 26 Jul 2019 12:00:00 +0000 https://www.dynamicyield.com/?p=91

a/b testsRead about Google's official SEO advice on A/B or multivariate testing, and how to minimize the possible impact of A/B testing on SEO.

The post The impact of A/B tests and personalization on SEO appeared first on Dynamic Yield.

]]>
https://www.dynamicyield.com/lesson/impact-of-ab-testing-on-seo/feed/ 4 91lesson en Personalization and Testing Frameworks https://www.dynamicyield.com/tags/personalization-and-testing-frameworks/ SEO and Personalization https://www.dynamicyield.com/tags/seo-and-personalization/ 91 https://www.dynamicyield.com/lesson/impact-of-ab-testing-on-seo/ July 26, 2019 lesson A/B Testing & Optimization, Agnostic, Personalization and Testing Frameworks, SEO and Personalization, Conversion Optimization, Marketing, Industry Research, Thought Leadership, A/B Testing & Optimization
How to analyze and interpret A/B testing results https://www.dynamicyield.com/lesson/ab-testing-analysis/ https://www.dynamicyield.com/lesson/ab-testing-analysis/#respond Thu, 03 May 2018 20:33:56 +0000 https://www.dynamicyield.com/?p=32159/

a/b testingAnalyzing A/B testing results is one of the most important stages of an experiment. But it's also the least talked about. Here's how to do it right.

The post How to analyze and interpret A/B testing results appeared first on Dynamic Yield.

]]>
https://www.dynamicyield.com/lesson/ab-testing-analysis/feed/ 0 32159lesson en Audience Segmentation https://www.dynamicyield.com/tags/audience-segmentation/ Personalization and Testing Frameworks https://www.dynamicyield.com/tags/personalization-and-testing-frameworks/ 32159 https://www.dynamicyield.com/lesson/ab-testing-analysis/ May 3, 2018 lesson A/B Testing & Optimization, Agnostic, Audience Segmentation, Personalization and Testing Frameworks, Analytics, Conversion Optimization, Tactical Guides, Thought Leadership, A/B Testing & Optimization
Segmented A/B tests: Avoiding average experiences https://www.dynamicyield.com/lesson/ab-testing-without-segmentation/ https://www.dynamicyield.com/lesson/ab-testing-without-segmentation/#respond Fri, 20 Apr 2018 15:46:24 +0000 https://www.dynamicyield.com/?p=32157/

segmented A/B testsOne of the biggest mistakes a company makes when A/B testing is selecting an average audience. Instead, they should be making segmentation an essential part of their test design — here’s how.

The post Segmented A/B tests: Avoiding average experiences appeared first on Dynamic Yield.

]]>
https://www.dynamicyield.com/lesson/ab-testing-without-segmentation/feed/ 0 32157lesson en Audience Segmentation https://www.dynamicyield.com/tags/audience-segmentation/ Personalization and Testing Frameworks https://www.dynamicyield.com/tags/personalization-and-testing-frameworks/ 32157 https://www.dynamicyield.com/lesson/ab-testing-without-segmentation/ April 20, 2018 lesson A/B Testing & Optimization, Agnostic, Audience Segmentation, Personalization and Testing Frameworks, Conversion Optimization, eCommerce, Marketing, Tactical Guides, Thought Leadership, A/B Testing & Optimization
Building an experimentation growth plan: A Kopari Beauty case study https://www.dynamicyield.com/lesson/kopari-beauty/ https://www.dynamicyield.com/lesson/kopari-beauty/#respond Thu, 10 Aug 2017 04:00:00 +0000 https://www.dynamicyield.com/?p=22970/

A conversation on personalization, conversion optimization and what makes the coconut the most kickass ingredient known to (wo)man with cosmetics retailer Kopari.

The post Building an experimentation growth plan: A Kopari Beauty case study appeared first on Dynamic Yield.

]]>
https://www.dynamicyield.com/lesson/kopari-beauty/feed/ 0 22970lesson en Behavioral Overlays and Notifications https://www.dynamicyield.com/tags/behavioral-overlays-and-notifications/ Marketing Strategies https://www.dynamicyield.com/tags/marketing-strategies/ Personalization and Testing Frameworks https://www.dynamicyield.com/tags/personalization-and-testing-frameworks/ 22970 https://www.dynamicyield.com/lesson/kopari-beauty/ August 10, 2017 lesson A/B Testing & Optimization, eCommerce, Behavioral Overlays and Notifications, Marketing Strategies, Personalization and Testing Frameworks, eCommerce, Leadership, Marketing, Thought Leadership, A/B Testing & Optimization
Understanding conversion attribution scoping in A/B testing https://www.dynamicyield.com/lesson/conversion-attribution-scoping/ https://www.dynamicyield.com/lesson/conversion-attribution-scoping/#respond Wed, 31 May 2017 04:00:00 +0000 https://www.dynamicyield.com/?p=21258/

conversion attributionUnderstand the influence of different conversion attribution configurations on your personalization and A/B testing campaigns.

The post Understanding conversion attribution scoping in A/B testing appeared first on Dynamic Yield.

]]>
https://www.dynamicyield.com/lesson/conversion-attribution-scoping/feed/ 0 21258lesson en Personalization and Testing Frameworks https://www.dynamicyield.com/tags/personalization-and-testing-frameworks/ 21258 https://www.dynamicyield.com/lesson/conversion-attribution-scoping/ May 31, 2017 lesson A/B Testing & Optimization, Agnostic, Personalization and Testing Frameworks, Analytics, Conversion Optimization, eCommerce, Marketing, Thought Leadership, A/B Testing & Optimization
Choosing the right traffic allocation in A/B testing https://www.dynamicyield.com/lesson/traffic-allocation/ https://www.dynamicyield.com/lesson/traffic-allocation/#respond Mon, 13 Feb 2017 14:04:29 +0000 https://www.dynamicyield.com/?p=115918

traffic allocationLearn how to choose the right traffic allocation method for your A/B tests and avoid common pitfalls, ensuring impactful, valid results.

The post Choosing the right traffic allocation in A/B testing appeared first on Dynamic Yield.

]]>
https://www.dynamicyield.com/lesson/traffic-allocation/feed/ 0 115918lesson en Personalization and Testing Frameworks https://www.dynamicyield.com/tags/personalization-and-testing-frameworks/ 115918 https://www.dynamicyield.com/lesson/traffic-allocation/ February 13, 2017 lesson A/B Testing & Optimization, Agnostic, Personalization and Testing Frameworks, Conversion Optimization, eCommerce, Marketing, Tactical Guides, A/B Testing & Optimization
Frequentist vs. Bayesian approach in A/B testing https://www.dynamicyield.com/lesson/bayesian-testing/ https://www.dynamicyield.com/lesson/bayesian-testing/#comments Mon, 26 Sep 2016 04:00:00 +0000 https://www.dynamicyield.com/?p=17150

frequentist vs bayesianThe industry is moving toward the Bayesian framework as it is a simpler, less restrictive, more reliable, and more intuitive approach to A/B testing.

The post Frequentist vs. Bayesian approach in A/B testing appeared first on Dynamic Yield.

]]>
https://www.dynamicyield.com/lesson/bayesian-testing/feed/ 2 17150lesson en Personalization and Testing Frameworks https://www.dynamicyield.com/tags/personalization-and-testing-frameworks/ 17150 https://www.dynamicyield.com/lesson/bayesian-testing/ September 26, 2016 lesson A/B Testing & Optimization, Agnostic, Personalization and Testing Frameworks, Conversion Optimization, eCommerce, Marketing, Thought Leadership, A/B Testing & Optimization
Choosing the right conversion optimization objective https://www.dynamicyield.com/lesson/optimization-objective/ https://www.dynamicyield.com/lesson/optimization-objective/#respond Thu, 19 Feb 2015 05:00:00 +0000 https://www.dynamicyield.com/?p=7468

optimization objectiveConversion optimization can be a very powerful process, but it’s easy to get carried away by the methodology. Here's how to choose the right optimization objective.

The post Choosing the right conversion optimization objective appeared first on Dynamic Yield.

]]>
https://www.dynamicyield.com/lesson/optimization-objective/feed/ 0 7468lesson en Personalization and Testing Frameworks https://www.dynamicyield.com/tags/personalization-and-testing-frameworks/ 7468 https://www.dynamicyield.com/lesson/optimization-objective/ February 19, 2015 lesson A/B Testing & Optimization, Agnostic, Personalization and Testing Frameworks, Conversion Optimization, eCommerce, Marketing, Tactical Guides, A/B Testing & Optimization
Beyond A/B testing: Multi-armed bandit experiments https://www.dynamicyield.com/lesson/contextual-bandit-optimization/ https://www.dynamicyield.com/lesson/contextual-bandit-optimization/#comments Thu, 12 Feb 2015 05:00:00 +0000 https://www.dynamicyield.com/?p=7414

Multi-armed banditLearn how multi-armed bandit algorithms conclude experiments earlier than the classic A/B test while making fewer statistical errors on the way.

The post Beyond A/B testing: Multi-armed bandit experiments appeared first on Dynamic Yield.

]]>
https://www.dynamicyield.com/lesson/contextual-bandit-optimization/feed/ 1 7414lesson en Personalization and Testing Frameworks https://www.dynamicyield.com/tags/personalization-and-testing-frameworks/ 7414 https://www.dynamicyield.com/lesson/contextual-bandit-optimization/ February 12, 2015 lesson A/B Testing & Optimization, Agnostic, Personalization and Testing Frameworks, Analytics, Conversion Optimization, eCommerce, Marketing, Thought Leadership, A/B Testing & Optimization
Why reaching and protecting statistical significance is so important in A/B tests https://www.dynamicyield.com/lesson/statistical-significance/ https://www.dynamicyield.com/lesson/statistical-significance/#comments Mon, 09 Jun 2014 04:00:00 +0000 https://www.dynamicyield.com/?p=1783

statistical significanceDelve deeper into the mechanics of “classic” A/B testing, become familiar with the actual meaning of statistical significance, and discover the pitfalls threatening the validity of your test results.

The post Why reaching and protecting statistical significance is so important in A/B tests appeared first on Dynamic Yield.

]]>
https://www.dynamicyield.com/lesson/statistical-significance/feed/ 5 1783lesson en Personalization and Testing Frameworks https://www.dynamicyield.com/tags/personalization-and-testing-frameworks/ 1783 https://www.dynamicyield.com/lesson/statistical-significance/ June 9, 2014 lesson A/B Testing & Optimization, Agnostic, Personalization and Testing Frameworks, Analytics, Conversion Optimization, eCommerce, Marketing, Thought Leadership, A/B Testing & Optimization
An introduction to A/B testing and optimization https://www.dynamicyield.com/lesson/introduction-to-ab-testing/ https://www.dynamicyield.com/lesson/introduction-to-ab-testing/#respond Mon, 19 May 2014 04:00:00 +0000 https://www.dynamicyield.com/?p=97

a/b testingA comprehensive guide to A/B testing, explaining the differences between A/B and multivariate testing, how to conduct tests in a structured and progressive way, and the thought process behind choosing the right experiment.

The post An introduction to A/B testing and optimization appeared first on Dynamic Yield.

]]>
https://www.dynamicyield.com/lesson/introduction-to-ab-testing/feed/ 0 97lesson en Personalization and Testing Frameworks https://www.dynamicyield.com/tags/personalization-and-testing-frameworks/ 97 https://www.dynamicyield.com/lesson/introduction-to-ab-testing/ May 19, 2014 lesson A/B Testing & Optimization, Agnostic, Personalization and Testing Frameworks, Conversion Optimization, eCommerce, Marketing, Thought Leadership, A/B Testing & Optimization