{"id":108223,"date":"2026-03-10T09:00:00","date_gmt":"2026-03-10T16:00:00","guid":{"rendered":"https:\/\/www.crazyegg.com\/blog\/?p=108223"},"modified":"2026-03-09T06:58:36","modified_gmt":"2026-03-09T13:58:36","slug":"bucket-testing","status":"publish","type":"post","link":"https:\/\/www.crazyegg.com\/blog\/bucket-testing\/","title":{"rendered":"What Is Bucket Testing, When Should You Run It &amp; How?"},"content":{"rendered":"\n<p>Bucket testing is a controlled experiment where you split website traffic between two or more page versions to find which one converts better.<\/p>\n\n\n\n<p>In the article, I&#8217;ll explain what bucket testing is, when it makes sense to use it (and when it doesn&#8217;t), and how to run a test grounded in real visitor behavior, not guesswork.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>What is bucket testing?<\/strong><\/h2>\n\n\n\n<p>Bucket testing is a controlled experimentation method in which you randomly split your audience into two or more equal groups, or buckets, show them different versions of a page (or any other marketing asset), and measure which one performs better against a specific goal, like improving the conversion rate.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" width=\"1200\" height=\"720\" src=\"https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09063129\/Bucket-Testing-_Featured-Image.png\" alt=\"Illustrated comparison of A\/B test variants. \" class=\"wp-image-108236\" srcset=\"https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09063129\/Bucket-Testing-_Featured-Image.png 1200w, https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09063129\/Bucket-Testing-_Featured-Image-300x180.png 300w, https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09063129\/Bucket-Testing-_Featured-Image-1024x614.png 1024w, https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09063129\/Bucket-Testing-_Featured-Image-768x461.png 768w\" sizes=\"(max-width: 1200px) 100vw, 1200px\" \/><\/figure>\n\n\n\n<h3 class=\"wp-block-heading\">A bucket test example<\/h3>\n\n\n\n<p>Imagine your product page attracts traffic but doesn&#8217;t convert. You analyze heatmaps and session recordings and realize there might be an issue with the call-to-action button placement.&nbsp;<\/p>\n\n\n\n<p>You have some ideas on how to fix it, but it\u2019s just a hunch.&nbsp;<\/p>\n\n\n\n<p>With bucket testing, you can validate your ideas and find the CTA position that performs best.<\/p>\n\n\n\n<p>You would do it by:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Creating multiple versions of the page with the buttons in different places<\/li>\n\n\n\n<li>Splitting the visitors into equal groups<\/li>\n\n\n\n<li>Sending one group to the original version, called the control<\/li>\n\n\n\n<li>Sending the other groups to the other versions, called the treatments or variations<\/li>\n\n\n\n<li>Measuring the performance of each<\/li>\n<\/ul>\n\n\n\n<p>Visitor buckets engage with the different versions of the web page over the same period, you know the performance shifts due to design changes rather than external factors, like seasonal fluctuations or competitors&#8217; marketing campaigns.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Bucket testing benefits<\/h3>\n\n\n\n<p>Thanks to bucket testing, you can:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Understand target audience preferences<\/strong>. The test is a chance to learn about your visitors&#8217; motivations.<\/li>\n\n\n\n<li><strong>Make data-driven decisions.<\/strong> Instead of debating which option is better, you let the data decide.<\/li>\n\n\n\n<li><strong>Get a stakeholder buy-in. <\/strong>Quantitative test results are easier to defend to decision-makers than gut feelings.<\/li>\n\n\n\n<li><strong>Reduce risk.<\/strong> You test changes on a portion of your traffic before rolling it out to everyone. If the variation underperforms, only a fraction of visitors are exposed.<\/li>\n\n\n\n<li><strong>Boost profits through compounding gains. <\/strong>Improvements stack up across the funnel, increasing revenue and reducing overheads.<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\">Bucket testing vs. A\/B testing vs. split testing<\/h2>\n\n\n\n<p>Bucket testing, <a href=\"https:\/\/www.crazyegg.com\/ab-testing\" target=\"_blank\" rel=\"noreferrer noopener\">A\/B testing<\/a>, and <a href=\"https:\/\/www.crazyegg.com\/blog\/split-testing\/\" target=\"_blank\" rel=\"noreferrer noopener\">split testing<\/a> refer to the same kind of controlled experiment \u2014 randomly splitting traffic between versions and measuring which one performs better.<\/p>\n\n\n\n<p>The three terms come from different contexts:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Bucket testing <\/strong>comes from software engineering, where frameworks assign users to buckets for experimentation.<\/li>\n\n\n\n<li><strong>A\/B testing<\/strong> is the most common term today and covers experiments with two or more variants.<\/li>\n\n\n\n<li><strong>Split testing<\/strong> originated in direct mail marketing, where marketers would split a mailing list between two versions of a letter to see which pulled more responses.\u00a0<\/li>\n<\/ul>\n\n\n\n<p>Use whichever term your team uses. I will stick to bucket testing in this article.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Bucket testing vs. multivariate testing vs. multi-armed bandit testing<\/h2>\n\n\n\n<p>The main principle behind bucket testing, multivariate testing, and multi-armed bandit (MAB) testing is the same: you show different versions to different groups and measure performance.&nbsp;<\/p>\n\n\n\n<p>The difference is in how many elements you test and how you split the traffic.<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>In bucket testing, you change <strong><em>one element <\/em><\/strong>and split traffic evenly between a control and variation(s). It answers a single question: Did this specific change improve the key metric?&nbsp;&nbsp;<\/li>\n\n\n\n<li>In multivariate testing, you make changes to <strong><em>multiple elements <\/em><\/strong>at the same time \u2014 say headline, image, and CTA button \u2014 and test every combination to find which mix performs best. If your page gets enough traffic, multivariate testing compresses several rounds of bucket testing into one experiment. If it doesn&#8217;t, seeing statistically significant differences takes a lot of time.<\/li>\n\n\n\n<li>In multi-armed bandit testing, you split traffic between variants just like in bucket testing. But the split isn&#8217;t fixed. <strong><em>An algorithm monitors conversion rates and gradually shifts more traffic to the better-performing version. <\/em><\/strong>The advantage is speed. You stop sending visitors to a losing variant while the test is still running. The tradeoff? The variants don&#8217;t see the same volume of traffic under the same conditions, so the results are less definitive.<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-table\"><table class=\"has-fixed-layout\"><thead><tr><th><\/th><th><strong>Key difference<\/strong><\/th><th><strong>Best use case<\/strong><\/th><th><strong>Main limitation<\/strong><\/th><\/tr><\/thead><tbody><tr><td><strong>Bucket testing<\/strong><\/td><td>One change at a time, traffic split evenly.<\/td><td>Measuring the impact of one change<\/td><td>Multiple experiments needed to test many elements.<\/td><\/tr><tr><td><strong>Multivariate testing<\/strong><\/td><td>Multiple elements simultaneously<\/td><td>Finding the best mix of elements&nbsp;<\/td><td>Needs high traffic to reach statistical significance.<\/td><\/tr><tr><td><strong>Multi-armed bandit testing<\/strong><\/td><td>Dynamically shifts traffic toward better-performing variants during the test<\/td><td>Optimizing conversions quickly<\/td><td>Results are less definitive<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">When should you run a bucket test?<\/h2>\n\n\n\n<p>Use bucket testing when:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>You need certainty to make key decisions: <\/strong>Bucket tests give you the definitive answer. Vital for major decisions that are likely to move the metric, but also time-consuming, and so not practical for minor, less consequential tweaks.<\/li>\n\n\n\n<li><strong>You test a single change: <\/strong>The test works for individual changes to one design aspect. If you change two or more at the same time, you won&#8217;t know which one caused the lift. For multiple changes, use multivariate testing.<\/li>\n\n\n\n<li><strong>You have an evidence-based hypothesis: <\/strong>A data-backed assumption about user behavior gives the test focus.&nbsp;<\/li>\n\n\n\n<li><strong>The page gets enough traffic to produce a statistically significant result <\/strong>within a reasonable timeframe (1-2 weeks): If you can&#8217;t get big enough samples, use qualitative research methods like session recordings or heatmaps. They\u2019re no substitute for experiments, but might be enough to surface the root cause.&nbsp;<\/li>\n\n\n\n<li><strong>The experiment isn\u2019t time-sensitive: <\/strong>The bucket test takes at least a week, so it works best for ongoing optimization, rather than short campaigns, like flash sales or seasonal promotions. Multi-armed bandit testing is better here.<\/li>\n\n\n\n<li><strong>When you don\u2019t know the answer: <\/strong>Statisticians may frown here, but the solution is sometimes obvious without testing.&nbsp;<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>How to run a bucket test in 6 steps<\/strong><\/h2>\n\n\n\n<p>Running a bucket test comes down to six steps:<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>Define your goal and choose the metrics to track<\/li>\n\n\n\n<li>Formulate the hypothesis&nbsp;<\/li>\n\n\n\n<li>Design variations<\/li>\n\n\n\n<li>Split the traffic and launch the test<\/li>\n\n\n\n<li>Gather enough data for statistical significance<\/li>\n\n\n\n<li>Analyze the results and iterate<\/li>\n<\/ol>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>1. Define your goal and choose the metrics to track<\/strong><\/h3>\n\n\n\n<p>First, pick the key metric you&#8217;re trying to improve.<\/p>\n\n\n\n<p>These could be:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Conversion rate<\/li>\n\n\n\n<li>Click-Through Rate (CTR)<\/li>\n\n\n\n<li>Average Order Value (AOV)<\/li>\n\n\n\n<li>Bounce rate and exit rate<\/li>\n\n\n\n<li>Time on page<\/li>\n\n\n\n<li>Scroll depth<\/li>\n\n\n\n<li>Page load speed<\/li>\n<\/ul>\n\n\n\n<p>Or<em> <\/em>any other metrics aligned with your goal.&nbsp;<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" width=\"1689\" height=\"899\" src=\"https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09063921\/Bucket-Testing-Goal-Setup.png\" alt=\"Crazy Egg A\/B test setup screen showing goal selection options including Conversion, Subscribe, and custom goals.\" class=\"wp-image-108238\" srcset=\"https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09063921\/Bucket-Testing-Goal-Setup.png 1689w, https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09063921\/Bucket-Testing-Goal-Setup-300x160.png 300w, https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09063921\/Bucket-Testing-Goal-Setup-1024x545.png 1024w, https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09063921\/Bucket-Testing-Goal-Setup-768x409.png 768w, https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09063921\/Bucket-Testing-Goal-Setup-1536x818.png 1536w\" sizes=\"(max-width: 1689px) 100vw, 1689px\" \/><\/figure>\n\n\n\n<p>Pick also countermetrics to monitor for unintended side effects.<\/p>\n\n\n\n<p>A variation may increase the conversion rate, but if the bounce rate skyrockets at the same time, it may cancel all gains.&nbsp;<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>2. Formulate a hypothesis based on insights from analytics<\/strong><\/h3>\n\n\n\n<p>To write your hypothesis, use this template.<\/p>\n\n\n\n<p>&#8220;Changing [element] from [current state] to [proposed state] will increase [metric].&#8221;<\/p>\n\n\n\n<p>For example, &#8220;Moving the CTA button to the center of the page will increase the conversion rate by 7%.&#8221;<\/p>\n\n\n\n<p>Formulating the hypothesis requires an understanding of the issue and its impact.<\/p>\n\n\n\n<p>This understanding comes from quantitative and qualitative data:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/www.crazyegg.com\/web-analytics\" target=\"_blank\" rel=\"noreferrer noopener\"><strong>Web analytics<\/strong><\/a><strong>: <\/strong>Find pages that attract traffic but fail to convert. Or where visitors bounce.<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" width=\"1400\" height=\"931\" src=\"https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09064046\/Bucket-Testing-Analytics-Visitor-Dashboard.png\" alt=\"Analytics dashboard showing 25.1k unique visitors with real-time tracking and AI-generated insights callouts.\" class=\"wp-image-108239\" srcset=\"https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09064046\/Bucket-Testing-Analytics-Visitor-Dashboard.png 1400w, https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09064046\/Bucket-Testing-Analytics-Visitor-Dashboard-300x200.png 300w, https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09064046\/Bucket-Testing-Analytics-Visitor-Dashboard-1024x681.png 1024w, https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09064046\/Bucket-Testing-Analytics-Visitor-Dashboard-768x511.png 768w\" sizes=\"(max-width: 1400px) 100vw, 1400px\" \/><\/figure>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Funnel analysis: <\/strong>Analyze user journeys across your website and learn where they drop off.&nbsp;<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" width=\"1400\" height=\"1000\" src=\"https:\/\/www.crazyegg.com\/blog\/wp-content\/uploads\/2026\/03\/Bucket-Testing-Signup-Form.gif\" alt=\"Crazy Egg funnel analysis GIF. \" class=\"wp-image-108240\"\/><\/figure>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/www.crazyegg.com\/confetti\" target=\"_blank\" rel=\"noreferrer noopener\"><strong>Confetti<\/strong><\/a><strong> and <\/strong><a href=\"https:\/\/www.crazyegg.com\/click-maps\" target=\"_blank\" rel=\"noreferrer noopener\"><strong>click maps<\/strong><\/a><strong>:<\/strong> Discover where exactly your users click and how often to identify focal points. That&#8217;s how <a href=\"https:\/\/www.crazyegg.com\/case-study\/wall-monkeys\" target=\"_blank\" rel=\"noreferrer noopener\">Wall Monkeys<\/a> realized their website visitors preferred to jump right into search instead of clicking on the CTA button.\u00a0<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" width=\"1358\" height=\"794\" src=\"https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09064241\/Bucket-Testing-Heatmap-WallMonkeys.jpg\" alt=\"Heatmap of Wall Monkeys homepage showing click concentration on the search bar and Shop Now button.\" class=\"wp-image-108241\" srcset=\"https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09064241\/Bucket-Testing-Heatmap-WallMonkeys.jpg 1358w, https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09064241\/Bucket-Testing-Heatmap-WallMonkeys-300x175.jpg 300w, https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09064241\/Bucket-Testing-Heatmap-WallMonkeys-1024x599.jpg 1024w, https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09064241\/Bucket-Testing-Heatmap-WallMonkeys-768x449.jpg 768w\" sizes=\"(max-width: 1358px) 100vw, 1358px\" \/><\/figure>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/www.crazyegg.com\/scrollmap\" target=\"_blank\" rel=\"noreferrer noopener\"><strong>Scroll maps<\/strong><\/a><strong>: <\/strong>Learn how far users scroll and which parts of the page they never see. This can explain why they don&#8217;t engage with user interface elements or miss crucial information.&nbsp;<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" width=\"1200\" height=\"860\" src=\"https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09064308\/Bucket-Testing-Scrollmap-BlogPage.png\" alt=\"Scrollmap of QuickSprout blog page with fold line at 681px and high-popularity content callout.\" class=\"wp-image-108242\" srcset=\"https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09064308\/Bucket-Testing-Scrollmap-BlogPage.png 1200w, https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09064308\/Bucket-Testing-Scrollmap-BlogPage-300x215.png 300w, https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09064308\/Bucket-Testing-Scrollmap-BlogPage-1024x734.png 1024w, https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09064308\/Bucket-Testing-Scrollmap-BlogPage-768x550.png 768w\" sizes=\"(max-width: 1200px) 100vw, 1200px\" \/><\/figure>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/www.crazyegg.com\/recordings\" target=\"_blank\" rel=\"noreferrer noopener\"><strong>Session recordings<\/strong><\/a><strong>:<\/strong> Watch your clients interact with your pages. Their hesitations, rage clicks, back-and-forth scrolling. <a href=\"https:\/\/www.crazyegg.com\/enterprise#intuit\" target=\"_blank\" rel=\"noreferrer noopener\">Intuit<\/a> used them to understand why the Tsheets pricing page wasn&#8217;t converting despite high user engagement.<\/li>\n\n\n\n<li><strong>Error reports:<\/strong> Find JavaScript errors that cause user friction.<\/li>\n\n\n\n<li><a href=\"https:\/\/www.crazyegg.com\/surveys\" target=\"_blank\" rel=\"noreferrer noopener\"><strong>User surveys<\/strong><\/a><strong>: <\/strong>Ask visitors to report bugs, errors, or poor user experience, or suggest improvements.<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" width=\"498\" height=\"415\" src=\"https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09064353\/Bucket-Testing-Feedback-Survey.png\" alt=\"Crazy Egg survey popup asking &quot;How can we improve this page?&quot; with a text field and Next button.\" class=\"wp-image-108243\" srcset=\"https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09064353\/Bucket-Testing-Feedback-Survey.png 498w, https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09064353\/Bucket-Testing-Feedback-Survey-300x250.png 300w\" sizes=\"(max-width: 498px) 100vw, 498px\" \/><\/figure>\n\n\n\n<p>To get a complete picture, you&#8217;ll likely use a number of the tools.<\/p>\n\n\n\n<p>For example, funnel analysis to find the pages where users drop off, heatmaps to find patterns in how different segments interact with the page, and session recordings to see what exactly individual users do.&nbsp;<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>3. Design the variations<\/strong><\/h3>\n\n\n\n<p>To run the bucket test, you need at least two versions: the current one, the control, and a new one, the variation or treatment.&nbsp;<\/p>\n\n\n\n<p>Common elements to test include CTA buttons, headlines, images, page layout, forms, and navigation.<\/p>\n\n\n\n<figure class=\"wp-block-table\"><table class=\"has-fixed-layout\"><thead><tr><th><\/th><th><strong>What you can change<\/strong><\/th><\/tr><\/thead><tbody><tr><td><strong>CTA buttons<\/strong><\/td><td>Text, color, size, shape, placement on page<\/td><\/tr><tr><td><strong>Headlines and copy<\/strong><\/td><td>Wording, length, tone, value proposition framing<\/td><\/tr><tr><td><strong>Images and video<\/strong><\/td><td>Hero image, product photos (lifestyle vs. product-only), video vs. static, sliders vs. single image<\/td><\/tr><tr><td><strong>Page layout<\/strong><\/td><td>Content order, column structure, spacing, what appears above vs. below the fold<\/td><\/tr><tr><td><strong>Navigation<\/strong><\/td><td>Items shown, labels, placement, full nav vs. stripped-down vs. hidden<\/td><\/tr><tr><td><strong>Forms<\/strong><\/td><td>Number of fields, which fields are required, validation style, single-step vs. progressive<\/td><\/tr><tr><td><strong>Checkout flow<\/strong><\/td><td>Single-page vs. multi-step, guest checkout default, progress indicators, express payment placement<\/td><\/tr><tr><td><strong>Pricing presentation<\/strong><\/td><td>Tier structure, anchoring, annual vs. monthly default, trust signals near price<\/td><\/tr><tr><td><strong>Social proof<\/strong><\/td><td>Review placement, testimonial format, trust badges, and customer counts<\/td><\/tr><tr><td><strong>Pop-ups and opt-ins<\/strong><\/td><td>Timing (immediate vs. delayed), trigger (scroll, exit intent, time), incentive type, display format<\/td><\/tr><tr><td><strong>Urgency and scarcity<\/strong><\/td><td>Stock level warnings, countdown timers, free shipping thresholds<\/td><\/tr><tr><td><strong>Mobile UX<\/strong><\/td><td>Tap target size, sticky CTA bars, thumb-zone placement, simplified navigation<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<p>For example, <a href=\"https:\/\/www.crazyegg.com\/case-study\/miller-and-smith\" target=\"_blank\" rel=\"noreferrer noopener\">Miller and Smith<\/a> removed images from their pages to help visitors find what they needed more quickly, and they added links to unclickable elements to improve navigation and reduce dead clicks.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" width=\"1360\" height=\"1274\" src=\"https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09064433\/Bucket-Testing-Heatmap-HomepageScroll.png\" alt=\"Scroll heatmap of a home collections website showing low engagement below the fold.\" class=\"wp-image-108244\" srcset=\"https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09064433\/Bucket-Testing-Heatmap-HomepageScroll.png 1360w, https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09064433\/Bucket-Testing-Heatmap-HomepageScroll-300x281.png 300w, https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09064433\/Bucket-Testing-Heatmap-HomepageScroll-1024x959.png 1024w, https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09064433\/Bucket-Testing-Heatmap-HomepageScroll-768x719.png 768w\" sizes=\"(max-width: 1360px) 100vw, 1360px\" \/><\/figure>\n\n\n\n<p>With Crazy Egg, you can create your variations inside the app with the visual page editor. So no need to wait for your busy developers.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" width=\"384\" height=\"264\" src=\"https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09064503\/Bucket-Testing-Test-Type-Selection.png\" alt=\"A\/B test type selection screen with Page Editor and URL Redirect options.\" class=\"wp-image-108245\" srcset=\"https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09064503\/Bucket-Testing-Test-Type-Selection.png 384w, https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09064503\/Bucket-Testing-Test-Type-Selection-300x206.png 300w\" sizes=\"(max-width: 384px) 100vw, 384px\" \/><\/figure>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>4. Split traffic and launch the experiment<\/strong><\/h3>\n\n\n\n<p>Once your control and variation are ready, and you&#8217;ve set your goals, randomly assign visitors to each version.&nbsp;<\/p>\n\n\n\n<p>A couple of things to bear in mind:<\/p>\n\n\n\n<p>1. Each visitor must see the same version every time they return.<\/p>\n\n\n\n<p>We call it &#8216;sticky assignment&#8217;, and you enforce it with cookies or user IDs that lock visitors into their assigned bucket. Without it, the same person might see the control on Monday and the variation on Tuesday, which skews the test results.&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<\/p>\n\n\n\n<p>On sites using a CDN, caching can break sticky assignment and result in the wrong variant being served to returning users. You can prevent it by adding experiment-assignment cookies to cache keys.&nbsp;<\/p>\n\n\n\n<p>2. If you&#8217;re running multiple tests at once, use mutual exclusion groups so each visitor only enters one test. Otherwise, you can\u2019t isolate the impact of each test.&nbsp;<\/p>\n\n\n\n<p>Most A\/B testing tools, including Crazy Egg, handle all this automatically, but if you&#8217;re running a custom setup, it&#8217;s worth checking.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>5. Wait for statistically significant results<\/strong><\/h3>\n\n\n\n<p>Statistical significance means the difference between your variants is unlikely to be due to chance.<\/p>\n\n\n\n<p>The 95% threshold is the norm. It means that if you repeated the test 100 times, you\u2019d see a similar outcome 95 times.<\/p>\n\n\n\n<p>Statistical significance requires the right sample size.<\/p>\n\n\n\n<p>There are a bunch of online calculators, like the <a href=\"https:\/\/cxl.com\/ab-test-calculator\/\" target=\"_blank\" rel=\"noreferrer noopener\">CXL<\/a> one, that you can use to determine the minimum sample size, as long as you have the three inputs:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Baseline conversion rate<\/li>\n\n\n\n<li>Minimum effect you want to detect<\/li>\n\n\n\n<li>Confidence level<\/li>\n<\/ul>\n\n\n\n<p>Let&#8217;s say your baseline conversion rate is 3% and you&#8217;re hoping to achieve a 20% lift at 95% confidence, you will need roughly 9,500 visitors per variant.&nbsp;<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" width=\"1592\" height=\"621\" src=\"https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09064550\/Bucket-Testing-Sample-Size-Calculator.png\" alt=\"Sample size calculator showing inputs for confidence level and MDE with results of 9,684 per group.\" class=\"wp-image-108246\" srcset=\"https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09064550\/Bucket-Testing-Sample-Size-Calculator.png 1592w, https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09064550\/Bucket-Testing-Sample-Size-Calculator-300x117.png 300w, https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09064550\/Bucket-Testing-Sample-Size-Calculator-1024x399.png 1024w, https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09064550\/Bucket-Testing-Sample-Size-Calculator-768x300.png 768w, https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09064550\/Bucket-Testing-Sample-Size-Calculator-1536x599.png 1536w\" sizes=\"(max-width: 1592px) 100vw, 1592px\" \/><\/figure>\n\n\n\n<p>In practice, most teams don\u2019t take the time to calculate sample size ahead of time, then sample sizes are accidentally too small. So teams assume they have statistical significance before they actually do.<br><br>A simple workaround is to not worry about sample size and wait for the test to hit 99% statistical significance instead. Crazy Egg displays the figure on the A\/B testing dashboard as results come in, so anyone can do it.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" width=\"1504\" height=\"254\" src=\"https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09064614\/Bucket-Testing-Variants-Conversion-Table.png\" alt=\"A\/B test results table comparing Control (7.94%) and Variant #1 (7.26%) conversion rates.\" class=\"wp-image-108247\" srcset=\"https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09064614\/Bucket-Testing-Variants-Conversion-Table.png 1504w, https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09064614\/Bucket-Testing-Variants-Conversion-Table-300x51.png 300w, https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09064614\/Bucket-Testing-Variants-Conversion-Table-1024x173.png 1024w, https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09064614\/Bucket-Testing-Variants-Conversion-Table-768x130.png 768w\" sizes=\"(max-width: 1504px) 100vw, 1504px\" \/><\/figure>\n\n\n\n<p>Whichever approach you choose, follow these two rules:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Run for at least one full business cycle. <\/strong>On an e-commerce website, that&#8217;s a week because purchasing behavior patterns change between weekdays and weekends.&nbsp;&nbsp;<\/li>\n\n\n\n<li><strong>Run the complete test. <\/strong>Don\u2019t rush to call the winner even if the initial results seem clear.&nbsp;<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>6. Analyze, implement, repeat<\/strong><\/h3>\n\n\n\n<p>When the test reaches your target sample size, the difference is statistically significant, and the treatment wins, deploy it.&nbsp;<\/p>\n\n\n\n<p>But don&#8217;t stop there:<\/p>\n\n\n\n<p>Go back to behavioral data.<\/p>\n\n\n\n<p>Study the heatmaps. Watch the session recordings. Formulate new hypotheses.<\/p>\n\n\n\n<p>Remember Wall Monkeys I mentioned above? Their first test saw &#8220;only&#8221; a 27% conversion rate increase. But it informed a second one, which brought a 550% lift.<\/p>\n\n\n\n<p>And if the difference isn&#8217;t statistically significant?&nbsp;<\/p>\n\n\n\n<p>Check other metrics. You may not have hit the primary goal, but you might have improved the user experience or made the page easier to maintain, and the change may still be worth deploying.<\/p>\n\n\n\n<p>And even if not, it isn&#8217;t a wasted effort. You&#8217;ve just eliminated one insignificant variable. So it&#8217;s easier to find the significant ones.&nbsp;<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" width=\"1024\" height=\"558\" src=\"https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09064633\/Bucket-Testing-AB-Results-Dashboard.png\" alt=\"QuickSprout A\/B test dashboard showing homepage exclamation mark test with conversion rate and goal value data.\" class=\"wp-image-108248\" srcset=\"https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09064633\/Bucket-Testing-AB-Results-Dashboard.png 1024w, https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09064633\/Bucket-Testing-AB-Results-Dashboard-300x163.png 300w, https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09064633\/Bucket-Testing-AB-Results-Dashboard-768x419.png 768w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>The bucket test is only as good as the hypothesis behind it<\/strong><\/h2>\n\n\n\n<p>Most bucket testing guides start with &#8220;pick something to test&#8221; and jump straight to setup.<\/p>\n\n\n\n<p>To make consistent improvements, you can&#8217;t guess what to test.<\/p>\n\n\n\n<p>You need to identify underperforming pages, watch what visitors actually do on them, look for the friction, and build hypotheses around that evidence. And only then use bucket tests to validate them.&nbsp;<\/p>\n\n\n\n<p>Crazy Egg combines bucket testing with analytics, heatmaps, session recordings, and surveys in one platform. So, you can start analyzing user behavior, collecting feedback, and testing today \u2014 <a href=\"https:\/\/www.crazyegg.com\/signup\" target=\"_blank\" rel=\"noreferrer noopener\">for free!<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Bucket testing is a controlled experiment where you split website traffic between two or more page versions to find which one converts better. In the&#8230;<\/p>\n","protected":false},"author":280,"featured_media":108236,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_eb_attr":"","_lmt_disableupdate":"","_lmt_disable":"","site-sidebar-layout":"default","site-content-layout":"","ast-site-content-layout":"default","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","ast-disable-related-posts":"","theme-transparent-header-meta":"","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"default","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"footnotes":""},"categories":[4],"tags":[],"class_list":["post-108223","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-conversion-optimization"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.4 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>What Is Bucket Testing, When Should You Run It &amp; How?<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.crazyegg.com\/blog\/bucket-testing\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"What Is Bucket Testing, When Should You Run It &amp; How?\" \/>\n<meta property=\"og:description\" content=\"Bucket testing is a controlled experiment where you split website traffic between two or more page versions to find which one converts better. In the...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.crazyegg.com\/blog\/bucket-testing\/\" \/>\n<meta property=\"og:site_name\" content=\"The Daily Egg\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/crazyegganalytics\/\" \/>\n<meta property=\"article:published_time\" content=\"2026-03-10T16:00:00+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09063129\/Bucket-Testing-_Featured-Image.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"720\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Pawel Tatarek\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@CrazyEgg\" \/>\n<meta name=\"twitter:site\" content=\"@CrazyEgg\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Pawel Tatarek\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"11 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/www.crazyegg.com\\\/blog\\\/bucket-testing\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.crazyegg.com\\\/blog\\\/bucket-testing\\\/\"},\"author\":{\"name\":\"Pawel Tatarek\",\"@id\":\"https:\\\/\\\/www.crazyegg.com\\\/blog\\\/#\\\/schema\\\/person\\\/e38eb9237db3356e214882ff34a96c3e\"},\"headline\":\"What Is Bucket Testing, When Should You Run It &amp; How?\",\"datePublished\":\"2026-03-10T16:00:00+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.crazyegg.com\\\/blog\\\/bucket-testing\\\/\"},\"wordCount\":2354,\"publisher\":{\"@id\":\"https:\\\/\\\/www.crazyegg.com\\\/blog\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/www.crazyegg.com\\\/blog\\\/bucket-testing\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/ceblog.s3.amazonaws.com\\\/wp-content\\\/uploads\\\/2026\\\/03\\\/09063129\\\/Bucket-Testing-_Featured-Image.png\",\"articleSection\":[\"Conversion\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.crazyegg.com\\\/blog\\\/bucket-testing\\\/\",\"url\":\"https:\\\/\\\/www.crazyegg.com\\\/blog\\\/bucket-testing\\\/\",\"name\":\"What Is Bucket Testing, When Should You Run It &amp; How?\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.crazyegg.com\\\/blog\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/www.crazyegg.com\\\/blog\\\/bucket-testing\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/www.crazyegg.com\\\/blog\\\/bucket-testing\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/ceblog.s3.amazonaws.com\\\/wp-content\\\/uploads\\\/2026\\\/03\\\/09063129\\\/Bucket-Testing-_Featured-Image.png\",\"datePublished\":\"2026-03-10T16:00:00+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.crazyegg.com\\\/blog\\\/bucket-testing\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.crazyegg.com\\\/blog\\\/bucket-testing\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.crazyegg.com\\\/blog\\\/bucket-testing\\\/#primaryimage\",\"url\":\"https:\\\/\\\/ceblog.s3.amazonaws.com\\\/wp-content\\\/uploads\\\/2026\\\/03\\\/09063129\\\/Bucket-Testing-_Featured-Image.png\",\"contentUrl\":\"https:\\\/\\\/ceblog.s3.amazonaws.com\\\/wp-content\\\/uploads\\\/2026\\\/03\\\/09063129\\\/Bucket-Testing-_Featured-Image.png\",\"width\":1200,\"height\":720,\"caption\":\"Illustrated comparison of A\\\/B test variants.\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.crazyegg.com\\\/blog\\\/bucket-testing\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Blog\",\"item\":\"https:\\\/\\\/www.crazyegg.com\\\/blog\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Conversion\",\"item\":\"https:\\\/\\\/www.crazyegg.com\\\/blog\\\/category\\\/conversion-optimization\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"What Is Bucket Testing, When Should You Run It &amp; How?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.crazyegg.com\\\/blog\\\/#website\",\"url\":\"https:\\\/\\\/www.crazyegg.com\\\/blog\\\/\",\"name\":\"The Daily Egg\",\"description\":\"Conversion Rate Optimization Made Easy\",\"publisher\":{\"@id\":\"https:\\\/\\\/www.crazyegg.com\\\/blog\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.crazyegg.com\\\/blog\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/www.crazyegg.com\\\/blog\\\/#organization\",\"name\":\"Crazy Egg\",\"url\":\"https:\\\/\\\/www.crazyegg.com\\\/blog\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.crazyegg.com\\\/blog\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/ceblog.s3.amazonaws.com\\\/wp-content\\\/uploads\\\/2015\\\/06\\\/Crazy-Egg-logo-small.png\",\"contentUrl\":\"https:\\\/\\\/ceblog.s3.amazonaws.com\\\/wp-content\\\/uploads\\\/2015\\\/06\\\/Crazy-Egg-logo-small.png\",\"width\":191,\"height\":100,\"caption\":\"Crazy Egg\"},\"image\":{\"@id\":\"https:\\\/\\\/www.crazyegg.com\\\/blog\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/crazyegganalytics\\\/\",\"https:\\\/\\\/x.com\\\/CrazyEgg\",\"https:\\\/\\\/www.linkedin.com\\\/company\\\/crazy-egg\\\/\",\"https:\\\/\\\/www.youtube.com\\\/channel\\\/UCJNe_xmPi07YezxaqfoRVqg\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/www.crazyegg.com\\\/blog\\\/#\\\/schema\\\/person\\\/e38eb9237db3356e214882ff34a96c3e\",\"name\":\"Pawel Tatarek\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/3c48cd644cd8ad806980efab7c716ce97174d27291f7f64df087f38b53c1d689?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/3c48cd644cd8ad806980efab7c716ce97174d27291f7f64df087f38b53c1d689?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/3c48cd644cd8ad806980efab7c716ce97174d27291f7f64df087f38b53c1d689?s=96&d=mm&r=g\",\"caption\":\"Pawel Tatarek\"},\"description\":\"Pawel Tatarek is a freelance content writer and editor specializing in long-form content for B2B SaaS brands. He writes about product and project management, analytics, UI\\\/UX design, SEO, and marketing (to name just a few). You can find him at tatarek.co.uk.\",\"url\":\"https:\\\/\\\/www.crazyegg.com\\\/blog\\\/author\\\/pawel\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"What Is Bucket Testing, When Should You Run It &amp; How?","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.crazyegg.com\/blog\/bucket-testing\/","og_locale":"en_US","og_type":"article","og_title":"What Is Bucket Testing, When Should You Run It &amp; How?","og_description":"Bucket testing is a controlled experiment where you split website traffic between two or more page versions to find which one converts better. In the...","og_url":"https:\/\/www.crazyegg.com\/blog\/bucket-testing\/","og_site_name":"The Daily Egg","article_publisher":"https:\/\/www.facebook.com\/crazyegganalytics\/","article_published_time":"2026-03-10T16:00:00+00:00","og_image":[{"width":1200,"height":720,"url":"https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09063129\/Bucket-Testing-_Featured-Image.png","type":"image\/png"}],"author":"Pawel Tatarek","twitter_card":"summary_large_image","twitter_creator":"@CrazyEgg","twitter_site":"@CrazyEgg","twitter_misc":{"Written by":"Pawel Tatarek","Est. reading time":"11 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.crazyegg.com\/blog\/bucket-testing\/#article","isPartOf":{"@id":"https:\/\/www.crazyegg.com\/blog\/bucket-testing\/"},"author":{"name":"Pawel Tatarek","@id":"https:\/\/www.crazyegg.com\/blog\/#\/schema\/person\/e38eb9237db3356e214882ff34a96c3e"},"headline":"What Is Bucket Testing, When Should You Run It &amp; How?","datePublished":"2026-03-10T16:00:00+00:00","mainEntityOfPage":{"@id":"https:\/\/www.crazyegg.com\/blog\/bucket-testing\/"},"wordCount":2354,"publisher":{"@id":"https:\/\/www.crazyegg.com\/blog\/#organization"},"image":{"@id":"https:\/\/www.crazyegg.com\/blog\/bucket-testing\/#primaryimage"},"thumbnailUrl":"https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09063129\/Bucket-Testing-_Featured-Image.png","articleSection":["Conversion"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.crazyegg.com\/blog\/bucket-testing\/","url":"https:\/\/www.crazyegg.com\/blog\/bucket-testing\/","name":"What Is Bucket Testing, When Should You Run It &amp; How?","isPartOf":{"@id":"https:\/\/www.crazyegg.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.crazyegg.com\/blog\/bucket-testing\/#primaryimage"},"image":{"@id":"https:\/\/www.crazyegg.com\/blog\/bucket-testing\/#primaryimage"},"thumbnailUrl":"https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09063129\/Bucket-Testing-_Featured-Image.png","datePublished":"2026-03-10T16:00:00+00:00","breadcrumb":{"@id":"https:\/\/www.crazyegg.com\/blog\/bucket-testing\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.crazyegg.com\/blog\/bucket-testing\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.crazyegg.com\/blog\/bucket-testing\/#primaryimage","url":"https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09063129\/Bucket-Testing-_Featured-Image.png","contentUrl":"https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2026\/03\/09063129\/Bucket-Testing-_Featured-Image.png","width":1200,"height":720,"caption":"Illustrated comparison of A\/B test variants."},{"@type":"BreadcrumbList","@id":"https:\/\/www.crazyegg.com\/blog\/bucket-testing\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Blog","item":"https:\/\/www.crazyegg.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Conversion","item":"https:\/\/www.crazyegg.com\/blog\/category\/conversion-optimization\/"},{"@type":"ListItem","position":3,"name":"What Is Bucket Testing, When Should You Run It &amp; How?"}]},{"@type":"WebSite","@id":"https:\/\/www.crazyegg.com\/blog\/#website","url":"https:\/\/www.crazyegg.com\/blog\/","name":"The Daily Egg","description":"Conversion Rate Optimization Made Easy","publisher":{"@id":"https:\/\/www.crazyegg.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.crazyegg.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.crazyegg.com\/blog\/#organization","name":"Crazy Egg","url":"https:\/\/www.crazyegg.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.crazyegg.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2015\/06\/Crazy-Egg-logo-small.png","contentUrl":"https:\/\/ceblog.s3.amazonaws.com\/wp-content\/uploads\/2015\/06\/Crazy-Egg-logo-small.png","width":191,"height":100,"caption":"Crazy Egg"},"image":{"@id":"https:\/\/www.crazyegg.com\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/crazyegganalytics\/","https:\/\/x.com\/CrazyEgg","https:\/\/www.linkedin.com\/company\/crazy-egg\/","https:\/\/www.youtube.com\/channel\/UCJNe_xmPi07YezxaqfoRVqg"]},{"@type":"Person","@id":"https:\/\/www.crazyegg.com\/blog\/#\/schema\/person\/e38eb9237db3356e214882ff34a96c3e","name":"Pawel Tatarek","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/3c48cd644cd8ad806980efab7c716ce97174d27291f7f64df087f38b53c1d689?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/3c48cd644cd8ad806980efab7c716ce97174d27291f7f64df087f38b53c1d689?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/3c48cd644cd8ad806980efab7c716ce97174d27291f7f64df087f38b53c1d689?s=96&d=mm&r=g","caption":"Pawel Tatarek"},"description":"Pawel Tatarek is a freelance content writer and editor specializing in long-form content for B2B SaaS brands. He writes about product and project management, analytics, UI\/UX design, SEO, and marketing (to name just a few). You can find him at tatarek.co.uk.","url":"https:\/\/www.crazyegg.com\/blog\/author\/pawel\/"}]}},"modified_by":"Lauren Knoll","_links":{"self":[{"href":"https:\/\/www.crazyegg.com\/blog\/wp-json\/wp\/v2\/posts\/108223","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.crazyegg.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.crazyegg.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.crazyegg.com\/blog\/wp-json\/wp\/v2\/users\/280"}],"replies":[{"embeddable":true,"href":"https:\/\/www.crazyegg.com\/blog\/wp-json\/wp\/v2\/comments?post=108223"}],"version-history":[{"count":4,"href":"https:\/\/www.crazyegg.com\/blog\/wp-json\/wp\/v2\/posts\/108223\/revisions"}],"predecessor-version":[{"id":108251,"href":"https:\/\/www.crazyegg.com\/blog\/wp-json\/wp\/v2\/posts\/108223\/revisions\/108251"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.crazyegg.com\/blog\/wp-json\/wp\/v2\/media\/108236"}],"wp:attachment":[{"href":"https:\/\/www.crazyegg.com\/blog\/wp-json\/wp\/v2\/media?parent=108223"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.crazyegg.com\/blog\/wp-json\/wp\/v2\/categories?post=108223"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.crazyegg.com\/blog\/wp-json\/wp\/v2\/tags?post=108223"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}