{"id":10520,"date":"2024-08-01T08:47:42","date_gmt":"2024-08-01T08:47:42","guid":{"rendered":"https:\/\/www.copebusiness.com\/?p=10520"},"modified":"2025-02-17T08:11:39","modified_gmt":"2025-02-17T08:11:39","slug":"blocked-by-robots-txt","status":"publish","type":"post","link":"https:\/\/www.copebusiness.com\/es\/google-search-console\/bloqueado-por-robots-txt\/","title":{"rendered":"How to Fix Blocked by robots.txt Issue in Google Search Console"},"content":{"rendered":"\t\t<div data-elementor-type=\"wp-post\" data-elementor-id=\"10520\" class=\"elementor elementor-10520\">\n\t\t\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-0fa7e30 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"0fa7e30\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-1438d7c\" data-id=\"1438d7c\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-b95f8f4 elementor-widget elementor-widget-elementskit-heading\" data-id=\"b95f8f4\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"elementskit-heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<div class=\"ekit-wid-con\" ><div class=\"ekit-heading elementskit-section-title-wraper text_left   ekit_heading_tablet-   ekit_heading_mobile-\"><h2 class=\"ekit-heading--title elementskit-section-title \">About the Issue<\/h2><div class=\"ekit_heading_separetor_wraper ekit_heading_elementskit-border-divider ekit-dotted\"><div class=\"elementskit-border-divider ekit-dotted\"><\/div><\/div><\/div><\/div>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-487299c elementor-widget elementor-widget-text-editor\" data-id=\"487299c\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>The \u00abBlocked by robots.txt\u00bb error in Google Search Console signifies that your website&#8217;s robots.txt file is preventing Googlebot from accessing specific URLs. This can hinder your website&#8217;s visibility in search results. <\/p><div id=\"ez-toc-container\" class=\"ez-toc-v2_0_84 ez-toc-wrap-left counter-hierarchy ez-toc-counter ez-toc-grey ez-toc-container-direction\">\n<div class=\"ez-toc-title-container\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">On this page<\/p>\n<span class=\"ez-toc-title-toggle\"><a href=\"#\" class=\"ez-toc-pull-right ez-toc-btn ez-toc-btn-xs ez-toc-btn-default ez-toc-toggle\" aria-label=\"Alternar tabla de contenidos\"><span class=\"ez-toc-js-icon-con\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #0a0a0a;color:#0a0a0a\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #0a0a0a;color:#0a0a0a\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/span><\/a><\/span><\/div>\n<nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/www.copebusiness.com\/es\/technical-seo\/como-a-tell-if-technical-seo-provider-hacer-bueno-trabajo\/#Why_This_Is_Hard_to_Evaluate\" >Why This Is Hard to Evaluate<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/www.copebusiness.com\/es\/technical-seo\/como-a-tell-if-technical-seo-provider-hacer-bueno-trabajo\/#11_Ways_to_Evaluate_Your_Technical_SEO_Provider\" >11 Ways to Evaluate Your Technical SEO Provider<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/www.copebusiness.com\/es\/technical-seo\/como-a-tell-if-technical-seo-provider-hacer-bueno-trabajo\/#What_to_Do_If_Youre_Not_Satisfied_With_the_Answers\" >What to Do If You&#8217;re Not Satisfied With the Answers<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/www.copebusiness.com\/es\/technical-seo\/como-a-tell-if-technical-seo-provider-hacer-bueno-trabajo\/#A_Quick_Self-Audit_Checklist\" >A Quick Self-Audit Checklist<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/www.copebusiness.com\/es\/technical-seo\/como-a-tell-if-technical-seo-provider-hacer-bueno-trabajo\/#Frequently_Asked_Questions\" >Frequently Asked Questions<\/a><\/li><\/ul><\/nav><\/div>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-c5ee1e6 elementor-widget elementor-widget-image\" data-id=\"c5ee1e6\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<img fetchpriority=\"high\" decoding=\"async\" width=\"1366\" height=\"645\" src=\"https:\/\/www.copebusiness.com\/wp-content\/uploads\/2024\/08\/blocked-by-robots-txt-issue-in-gsc.png\" class=\"attachment-full size-full wp-image-10523\" alt=\"Blocked by Robots.txt Issue in GSC\" srcset=\"https:\/\/www.copebusiness.com\/wp-content\/uploads\/2024\/08\/blocked-by-robots-txt-issue-in-gsc.png 1366w, https:\/\/www.copebusiness.com\/wp-content\/uploads\/2024\/08\/blocked-by-robots-txt-issue-in-gsc-600x283.png 600w, https:\/\/www.copebusiness.com\/wp-content\/uploads\/2024\/08\/blocked-by-robots-txt-issue-in-gsc-300x142.png 300w, https:\/\/www.copebusiness.com\/wp-content\/uploads\/2024\/08\/blocked-by-robots-txt-issue-in-gsc-1024x484.png 1024w, https:\/\/www.copebusiness.com\/wp-content\/uploads\/2024\/08\/blocked-by-robots-txt-issue-in-gsc-768x363.png 768w\" sizes=\"(max-width: 1366px) 100vw, 1366px\" title=\"\">\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-7975255 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"7975255\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-1b9f734\" data-id=\"1b9f734\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-c512654 elementor-widget elementor-widget-elementskit-heading\" data-id=\"c512654\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"elementskit-heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<div class=\"ekit-wid-con\" ><div class=\"ekit-heading elementskit-section-title-wraper text_left   ekit_heading_tablet-   ekit_heading_mobile-\"><h2 class=\"ekit-heading--title elementskit-section-title \">What is robots.txt?<\/h2><div class=\"ekit_heading_separetor_wraper ekit_heading_elementskit-border-divider ekit-dotted\"><div class=\"elementskit-border-divider ekit-dotted\"><\/div><\/div><\/div><\/div>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-10f5539 elementor-widget elementor-widget-text-editor\" data-id=\"10f5539\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<ul><li>A text file located at the root of your website.<\/li><li>Instructs search engine crawlers like Googlebot which pages to crawl and index.<\/li><li>Uses directives like \u00abUser-agent,\u00bb \u00abDisallow,\u00bb and \u00abAllow\u00bb to control access. <\/li><\/ul>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-1a89620 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"1a89620\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-0303402\" data-id=\"0303402\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-6d09a8e elementor-widget elementor-widget-elementskit-heading\" data-id=\"6d09a8e\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"elementskit-heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<div class=\"ekit-wid-con\" ><div class=\"ekit-heading elementskit-section-title-wraper text_left   ekit_heading_tablet-   ekit_heading_mobile-\"><h2 class=\"ekit-heading--title elementskit-section-title \">Understanding Which URLs to Block<\/h2><div class=\"ekit_heading_separetor_wraper ekit_heading_elementskit-border-divider ekit-dotted\"><div class=\"elementskit-border-divider ekit-dotted\"><\/div><\/div><\/div><\/div>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-e7da251 elementor-widget elementor-widget-text-editor\" data-id=\"e7da251\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>Many types of URLs don&#8217;t need to be indexed in search results and could be the reason for the waste of Google\u2019s crawl budget. These often include:<\/p><ul><li><strong>Dynamic URLs:<\/strong> URLs with parameters like search terms, filters, or product variations.<\/li><li><strong>Account-specific URLs:<\/strong> Pages related to user accounts, shopping carts, or checkout processes.<\/li><\/ul><p>These URLs can be blocked from being indexed using a <em><strong>robots.txt file<\/strong><\/em>.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-4076943 elementor-widget elementor-widget-image\" data-id=\"4076943\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<img decoding=\"async\" width=\"1366\" height=\"645\" src=\"https:\/\/www.copebusiness.com\/wp-content\/uploads\/2024\/08\/urls-reported-in-blocked-by-robots-txt.png\" class=\"attachment-full size-full wp-image-10522\" alt=\"URLs Reported in Blocked by Robots.txt\" srcset=\"https:\/\/www.copebusiness.com\/wp-content\/uploads\/2024\/08\/urls-reported-in-blocked-by-robots-txt.png 1366w, https:\/\/www.copebusiness.com\/wp-content\/uploads\/2024\/08\/urls-reported-in-blocked-by-robots-txt-600x283.png 600w, https:\/\/www.copebusiness.com\/wp-content\/uploads\/2024\/08\/urls-reported-in-blocked-by-robots-txt-300x142.png 300w, https:\/\/www.copebusiness.com\/wp-content\/uploads\/2024\/08\/urls-reported-in-blocked-by-robots-txt-1024x484.png 1024w, https:\/\/www.copebusiness.com\/wp-content\/uploads\/2024\/08\/urls-reported-in-blocked-by-robots-txt-768x363.png 768w\" sizes=\"(max-width: 1366px) 100vw, 1366px\" title=\"\">\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-f957091 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"f957091\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-330f32a\" data-id=\"330f32a\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-74978f7 elementor-widget elementor-widget-elementskit-heading\" data-id=\"74978f7\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"elementskit-heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<div class=\"ekit-wid-con\" ><div class=\"ekit-heading elementskit-section-title-wraper text_left   ekit_heading_tablet-   ekit_heading_mobile-\"><h2 class=\"ekit-heading--title elementskit-section-title \">When to Fix Blocked URLs<\/h2><div class=\"ekit_heading_separetor_wraper ekit_heading_elementskit-border-divider ekit-dotted\"><div class=\"elementskit-border-divider ekit-dotted\"><\/div><\/div><\/div><\/div>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-520e102 elementor-widget elementor-widget-text-editor\" data-id=\"520e102\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>While it&#8217;s generally okay to block the above types of URLs, sometimes important pages might accidentally be blocked. This can negatively impact your website&#8217;s visibility in search results.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-5f3bda1 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"5f3bda1\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-3b2583a\" data-id=\"3b2583a\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-e4c36b0 elementor-widget elementor-widget-elementskit-heading\" data-id=\"e4c36b0\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"elementskit-heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<div class=\"ekit-wid-con\" ><div class=\"ekit-heading elementskit-section-title-wraper text_left   ekit_heading_tablet-   ekit_heading_mobile-\"><h2 class=\"ekit-heading--title elementskit-section-title \">Steps to Fix the Issue<\/h2><div class=\"ekit_heading_separetor_wraper ekit_heading_elementskit-border-divider ekit-dotted\"><div class=\"elementskit-border-divider ekit-dotted\"><\/div><\/div><\/div><\/div>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-7fad2e1 elementor-widget elementor-widget-heading\" data-id=\"7fad2e1\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">Identify the Affected URLs:<\/h3>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-4484b53 elementor-widget elementor-widget-text-editor\" data-id=\"4484b53\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<ul><li>Use Google Search Console&#8217;s \u00abIndex Coverage\u00bb report to find pages with the \u00abBlocked by robots.txt\u00bb error.<\/li><li>Inspect the affected URLs to determine if they should be accessible to Googlebot.<\/li><\/ul>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-f21d3fb elementor-widget elementor-widget-heading\" data-id=\"f21d3fb\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">Access and Edit Your robots.txt File:<\/h3>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-39a6ff6 elementor-widget elementor-widget-text-editor\" data-id=\"39a6ff6\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<ul><li>Use an FTP client or your website&#8217;s content management system (CMS) to access the file.<\/li><li>Make a backup copy of the file before making any changes.<\/li><\/ul>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-ef2a59a elementor-widget elementor-widget-heading\" data-id=\"ef2a59a\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">Analyze the robots.txt File:<\/h3>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-3705092 elementor-widget elementor-widget-text-editor\" data-id=\"3705092\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<ul><li>Check for directives that might be blocking Googlebot from accessing the affected URLs.<\/li><li>Common culprits include overly broad \u00abDisallow\u00bb directives or incorrect syntax.<\/li><\/ul>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-ee743c5 elementor-widget elementor-widget-heading\" data-id=\"ee743c5\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">Make Necessary Changes:<\/h3>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-91f9b75 elementor-widget elementor-widget-text-editor\" data-id=\"91f9b75\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<ul><li>If you want Googlebot to access the URLs, remove or modify the relevant \u00abDisallow\u00bb directives.<\/li><li>For example, if the directive is <em><strong>Disallow: \/products\/<\/strong><\/em>, you can change it to <em><strong>Disallow: \/products\/sale\/<\/strong><\/em> to allow access to other product pages.<\/li><li>Ensure proper syntax and avoid using wildcard characters excessively.<\/li><\/ul>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-eeada43 elementor-widget elementor-widget-heading\" data-id=\"eeada43\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">Test Your Changes:<\/h3>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-223c802 elementor-widget elementor-widget-text-editor\" data-id=\"223c802\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<ul><li>Use a <a href=\"https:\/\/technicalseo.com\/tools\/robots-txt\/\" target=\"_blank\" rel=\"noopener nofollow\">robots.txt testing tool<\/a> to verify that the changes have the desired effect.<\/li><li>Check if Googlebot can now access the previously blocked URLs.<\/li><\/ul>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-9611548 elementor-widget elementor-widget-heading\" data-id=\"9611548\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">Submit the Updated robots.txt File:<\/h3>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-430c994 elementor-widget elementor-widget-text-editor\" data-id=\"430c994\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<ul><li>Save the modified robots.txt file to your website&#8217;s root.<\/li><li>Allow some time for Googlebot to re-crawl your website and update its index.<\/li><\/ul>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-74e90f0 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"74e90f0\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-7e4b6e5\" data-id=\"7e4b6e5\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-68bdb8c elementor-widget elementor-widget-elementskit-heading\" data-id=\"68bdb8c\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"elementskit-heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<div class=\"ekit-wid-con\" ><div class=\"ekit-heading elementskit-section-title-wraper text_left   ekit_heading_tablet-   ekit_heading_mobile-\"><h2 class=\"ekit-heading--title elementskit-section-title \">Additional Tips<\/h2><div class=\"ekit_heading_separetor_wraper ekit_heading_elementskit-border-divider ekit-dotted\"><div class=\"elementskit-border-divider ekit-dotted\"><\/div><\/div><\/div><\/div>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-f6be73c elementor-widget elementor-widget-text-editor\" data-id=\"f6be73c\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<ul><li><strong>Be Specific:<\/strong> Use precise directives to control access to specific pages or directories.<\/li><li><strong>Avoid Overblocking:<\/strong> Blocking too many pages can negatively impact your website&#8217;s visibility.<\/li><li><strong>Use \u00abAllow\u00bb Directives:<\/strong> If you want to explicitly allow access to certain pages, use \u00abAllow\u00bb directives.<\/li><li>C<strong>onsider Using \u00abSitemap.xml\u00bb:<\/strong> Submit a sitemap to Google Search Console to help prioritize important pages.<\/li><li><strong>Monitor for Changes:<\/strong> Regularly review your robots.txt file and Google Search Console to ensure it&#8217;s working as intended.<\/li><\/ul><p><strong>Example robots.txt:<\/strong><\/p><ul><li>User-agent: Googlebot<\/li><li>Disallow: \/admin\/<\/li><li>Disallow: \/checkout\/<\/li><li>Allow: \/images\/<\/li><\/ul><p>This example allows Googlebot to access all pages except those in the \u00ab\/admin\/\u00bb and \u00ab\/checkout\/\u00bb directories. It also explicitly allows access to images.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-d89f01f elementor-widget elementor-widget-text-editor\" data-id=\"d89f01f\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p><strong>Remember:<\/strong> Carefully review your website&#8217;s structure and goals before making changes to your robots.txt file. Incorrect modifications can have unintended consequences.<\/p><p>By following these steps, you can effectively fix the \u00abBlocked by robots.txt\u00bb issue and improve your website&#8217;s visibility in search results.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-21ee7f2 post_cat elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"21ee7f2\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-a5d84d8\" data-id=\"a5d84d8\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-887b661 post_cat elementor-widget elementor-widget-elementskit-blog-posts\" data-id=\"887b661\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"elementskit-blog-posts.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<div class=\"ekit-wid-con\" >        <div id=\"post-items--887b661\" class=\"row post-items\">\n                    <div class=\"col-lg-4 col-md-6\">\n\n                                    <div class=\"elementskit-post-image-card\">\n                        <div class=\"elementskit-entry-header\">\n                                                            <a href=\"https:\/\/www.copebusiness.com\/es\/technical-seo\/do-i-need-fractional-technical-seo-especialista\/\" class=\"elementskit-entry-thumb\">\n                                    <img decoding=\"async\" src=\"https:\/\/www.copebusiness.com\/wp-content\/uploads\/2026\/06\/specialist-consultant-team-workshop.png\" alt=\"Do I Need a Fractional Technical SEO Specialist for My Business?\" title=\"\">\n                                <\/a><!-- .elementskit-entry-thumb END -->\n                                                            \n                            \n\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div><!-- .elementskit-entry-header END -->\n\n\t\t\t\t\t\t<div class=\"elementskit-post-body \">\n\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<h2 class=\"entry-title\">\n\t\t\t\t\t<a href=\"https:\/\/www.copebusiness.com\/es\/technical-seo\/do-i-need-fractional-technical-seo-especialista\/\">\n\t\t\t\t\t\tDo I Need a Fractional Technical SEO Specialist for My Business?\t\t\t\t\t<\/a>\n\t\t\t\t<\/h2>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t                                                            <div class=\"btn-wraper\">\n                                    \n                                                                            <a class=\"elementskit-btn whitespace--normal\" id=\"\" href=\"https:\/\/www.copebusiness.com\/es\/technical-seo\/do-i-need-fractional-technical-seo-especialista\/\">\n                                        \t                                            Explore more                                         <\/a>\n                                                                    <\/div>\n                                                    <\/div><!-- .elementskit-post-body END -->\n                    <\/div>\n                \n            <\/div>\n                    <div class=\"col-lg-4 col-md-6\">\n\n                                    <div class=\"elementskit-post-image-card\">\n                        <div class=\"elementskit-entry-header\">\n                                                            <a href=\"https:\/\/www.copebusiness.com\/es\/technical-seo\/como\/\" class=\"elementskit-entry-thumb\">\n                                    <img decoding=\"async\" src=\"https:\/\/www.copebusiness.com\/wp-content\/uploads\/2026\/06\/website-growth-content-planning-calendar.png\" alt=\"How Often Should You Do Technical SEO Maintenance?\" title=\"\">\n                                <\/a><!-- .elementskit-entry-thumb END -->\n                                                            \n                            \n\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div><!-- .elementskit-entry-header END -->\n\n\t\t\t\t\t\t<div class=\"elementskit-post-body \">\n\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<h2 class=\"entry-title\">\n\t\t\t\t\t<a href=\"https:\/\/www.copebusiness.com\/es\/technical-seo\/como\/\">\n\t\t\t\t\t\tHow Often Should You Do Technical SEO Maintenance?\t\t\t\t\t<\/a>\n\t\t\t\t<\/h2>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t                                                            <div class=\"btn-wraper\">\n                                    \n                                                                            <a class=\"elementskit-btn whitespace--normal\" id=\"\" href=\"https:\/\/www.copebusiness.com\/es\/technical-seo\/como\/\">\n                                        \t                                            Explore more                                         <\/a>\n                                                                    <\/div>\n                                                    <\/div><!-- .elementskit-post-body END -->\n                    <\/div>\n                \n            <\/div>\n                    <div class=\"col-lg-4 col-md-6\">\n\n                                    <div class=\"elementskit-post-image-card\">\n                        <div class=\"elementskit-entry-header\">\n                                                            <a href=\"https:\/\/www.copebusiness.com\/es\/technical-seo\/como-a-tell-if-technical-seo-provider-hacer-bueno-trabajo\/\" class=\"elementskit-entry-thumb\">\n                                    <img decoding=\"async\" src=\"https:\/\/www.copebusiness.com\/wp-content\/uploads\/2026\/06\/consultant-reviewing-business-reports.png\" alt=\"How to Tell If Your Technical SEO Provider Is Doing Good Work\" title=\"\">\n                                <\/a><!-- .elementskit-entry-thumb END -->\n                                                            \n                            \n\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div><!-- .elementskit-entry-header END -->\n\n\t\t\t\t\t\t<div class=\"elementskit-post-body \">\n\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<h2 class=\"entry-title\">\n\t\t\t\t\t<a href=\"https:\/\/www.copebusiness.com\/es\/technical-seo\/como-a-tell-if-technical-seo-provider-hacer-bueno-trabajo\/\">\n\t\t\t\t\t\tHow to Tell If Your Technical SEO Provider Is Doing Good Work\t\t\t\t\t<\/a>\n\t\t\t\t<\/h2>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t                                                            <div class=\"btn-wraper\">\n                                    \n                                                                            <a class=\"elementskit-btn whitespace--normal\" id=\"\" href=\"https:\/\/www.copebusiness.com\/es\/technical-seo\/como-a-tell-if-technical-seo-provider-hacer-bueno-trabajo\/\">\n                                        \t                                            Explore more                                         <\/a>\n                                                                    <\/div>\n                                                    <\/div><!-- .elementskit-post-body END -->\n                    <\/div>\n                \n            <\/div>\n                <\/div>\n       <\/div>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"<p>About the Issue The &laquo;Blocked by robots.txt&raquo; error in Google Search Console signifies that your website&rsquo;s robots.txt file is preventing [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":10575,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"site-sidebar-layout":"default","site-content-layout":"","ast-site-content-layout":"default","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","ast-disable-related-posts":"","theme-transparent-header-meta":"","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"set","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[159],"tags":[],"class_list":["post-10520","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-google-search-console"],"jetpack_publicize_connections":[],"_links":{"self":[{"href":"https:\/\/www.copebusiness.com\/es\/wp-json\/wp\/v2\/posts\/10520","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.copebusiness.com\/es\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.copebusiness.com\/es\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.copebusiness.com\/es\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.copebusiness.com\/es\/wp-json\/wp\/v2\/comments?post=10520"}],"version-history":[{"count":13,"href":"https:\/\/www.copebusiness.com\/es\/wp-json\/wp\/v2\/posts\/10520\/revisions"}],"predecessor-version":[{"id":12129,"href":"https:\/\/www.copebusiness.com\/es\/wp-json\/wp\/v2\/posts\/10520\/revisions\/12129"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.copebusiness.com\/es\/wp-json\/wp\/v2\/media\/10575"}],"wp:attachment":[{"href":"https:\/\/www.copebusiness.com\/es\/wp-json\/wp\/v2\/media?parent=10520"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.copebusiness.com\/es\/wp-json\/wp\/v2\/categories?post=10520"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.copebusiness.com\/es\/wp-json\/wp\/v2\/tags?post=10520"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}