To avoid undesirable content in the search indexes, webmasters can instruct spiders not to crawl certain files or directories through the standard robots.txt file in the root directory of the domain. Additionally, a page can be explicitly excluded from a search engine's database by using a meta tag specific to robots (usually ). When a search engine visits a site, the robots.txt located in the root directory is the first file crawled. The robots.txt file is then parsed and will instruct the robot as to which pages are not to be crawled. As a search engine crawler may keep a cached copy of this file, it may on occasion crawl pages a webmaster does not wish crawled. Pages typically prevented from being crawled include login specific pages such as shopping carts and user-specific content such as search results from internal searches. In March 2007, Google warned webmasters that they should prevent indexing of internal search results because those pages are considered search spam.[47]
Thanks for sharing these great tips last August! I’ve recently adopted them and I have a question (that’s kind of connected to the last post): how important would promoting content be when using this strategy? For example, through Google Adwords. As I guess that would depend on the circumstances, but I am trying to discover if there’s a ‘formula’ here. Thanks in advance!

Thank you so much for taking the time to write this long article, it must have taken you forever but I think you helped a lot of bloggers out there. It definitely helped me! I’ve been struggling to maintain my blog’s traffic even though I write new posts frequently. The tip about having the most updated version of the post was especially helpful. My niche is DIY all-natural cleaning and beauty products, and I don’t want people to see the same product every time they go to my site. Thanks again for your help!


The best way to avoid this is proactively asking the right questions. Ask about resource support. Ask about historic roadblocks. Ask to be introduced to other players who otherwise hide behind an email here and there. Ask about the company's temperature regarding a bigger SEO strategy vs. short, quick-hit campaigns. Don't be your own biggest obstacle — I've never heard of anyone getting angry about over-communication unless it paralyzes progress.

Reality bites. You could draft up an amazing strategy, bright-eyed and bushy-tailed, to which you're rebuilding an entire category structure of one of the website's most lucrative lines... only to find out there's a ticket queue for the necessary resources that's more than 6 months long. Despite your brilliant idea, you're going to look bad when the client calls you out on not understanding their business.
Add relevant links back to your site. Throughout your answer, sprinkle a few relevant links back to your website. The more relevant they are to the question, the more clicks and traffic they will generate. You can also finish your answers with a link to your lead magnet, concluding with something like this: “Want to know more about how to start a business? Check out my free checklist with 10 steps for starting your first business!” and a link to the lead magnet (in this example, the checklist).
Hi, my name is Dimitrios and I am responsible for Crave Culinaire’s digital marketing. I would like to drive more traffic to Crave’s blog. Since Crave Culinaire is the only catering company who provides molecular cuisine, I thought about craving a blog post about that. The influencers in this niche have great success in utilizing recipes on their blogs. I will share some recipes of Brian Roland, owner and head chef of Crave Culinaire.
A breadcrumb is a row of internal links at the top or bottom of the page that allows visitors to quickly navigate back to a previous section or the root page. Many breadcrumbs have the most general page (usually the root page) as the first, leftmost link and list the more specific sections out to the right. We recommend using breadcrumb structured data markup28 when showing breadcrumbs.
I can feel the excitement in your writing, and thanks for all this free info you know how to get loyal subscribers, I believe you are one of the best in the business, no up selling just honesty, its so refreshing, i cant keep up with you I have only just finished the awesome piece of content you told me to write and just about to modify it then finally start promoting, i will be looking at this also THANK YOU, PS i couldn’t make your last course but i will get on board for the next one
How do you ask others for link opportunities? Most of the time people are only interested in either reciprocal links, or them providing guest posts on my site (when I reach out). And I can’t imagine if I did a round up post getting many inbound links. People would be thrilled that they had received a link, and wouldn’t create a reciprocal link to destroy the value.

I’m considering a niche that I’m not sure I can find good influencers for – fundraising. School fundraising or charitable fundraising. I’m passionate about it but how would I get my articles shared by influencers? The non-profit sector is somewhat apprehensive about promoting commercial sites, unless it’s fundraising software. The name really says it all: “non”-profit.
Laura,Great post.  This touches something I wish more SEOs practiced: conversion optimization. I think most SEOs think of what they do as a service for, instead of a partnership with clients.  The end result should never be raw traffic, but value obtained through targeted, CONVERTING traffic.You make excellent points about market research, product input, content creation, and other functions many SEOs and SEMs neglect.More and more SEO providers focus only on assembly line basics and worn out techniques instead of challenging themsleves to learn product marketing, usability, and conversion optimization.Your advice on market research is extremely valuable.Great start to a promising series.  I look forward to more!
We often see posts on how to get blog topic ideas or ideas on creating visuals but nobody ever talked about new link building ideas. The ways you showed here some are absolutely unheard to me. You know what I think you should write a post on how to get your own link building ideas…where to start…how to proceed…how do I know it’s full proof…it surely comes with lots of experiments…but the point is starting…….I know sounds weird but I know you will come up with something 🙂
As I had a teacher at school who was always really picky on how to draw conclusions I must say that the conclusions you drew for your health situation might be true, but dangerous. For example: If slightly more women than men suffer from health deseases it could be wise to write the information toward women. But, if you take search behaviour into account thing could look a lot different: It might turn up that men search more than women or that (senior) men are more present on the net than women.

What are the pain points? What things drive the members of this organization to drink? From the customer support to the higher-ups, there are things that knock the company down. How do they get back up? Why are the pains they're looking to work around? It may not be realistic to interview the whole company, but ideally you can get a representative to answer these.
Really its just a matter of getting creative - grab a cup of caffeine and think for a minute about what resources you have to try to get some insight on your visitors (or target markets) and their needs before you dive in.  Think about how much time it might take you (or what the cost of the reports would be if you are going to buy some market research reports), and tack that onto your billing as an optional service.

Current search engine optimization focuses on techniques such as making sure that each web page has appropriate title tags and that the content is not "thin" or low-quality. High-quality content is original, authoritative, factual, grammatically correct, and engaging to users. Poorly edited articles with spelling and grammatical errors will be demoted by search engines. For more information on thin content see More Guidance on Building High-quality Sites.
But I've recently heard some chatter voicing the polar opposite. I've heard the sentiment to wholly ignore certain data points because they don't represent the real person. To me, that's bad advice — directional data is better than the romantic notion of success based on your "gut" feel. Estimated search volume, clicks, and even impressions give credence not only to a keyword, but a bigger theme. This starts to create direction and an understanding of need, which leads to your next few rounds of audience recognition.
In December 2009, Google announced it would be using the web search history of all its users in order to populate search results.[33] On June 8, 2010 a new web indexing system called Google Caffeine was announced. Designed to allow users to find news results, forum posts and other content much sooner after publishing than before, Google caffeine was a change to the way Google updated its index in order to make things show up quicker on Google than before. According to Carrie Grimes, the software engineer who announced Caffeine for Google, "Caffeine provides 50 percent fresher results for web searches than our last index..."[34] Google Instant, real-time-search, was introduced in late 2010 in an attempt to make search results more timely and relevant. Historically site administrators have spent months or even years optimizing a website to increase search rankings. With the growth in popularity of social media sites and blogs the leading engines made changes to their algorithms to allow fresh content to rank quickly within the search results.[35]

Getting free website traffic may not cost you monetarily, but it will require effort on your part. However, the effort you put in will equate to the quality of the traffic you generate. As mentioned above, there is no point in getting more traffic to your website if those visitors are not likely to engage with your pages, convert into leads, or become customers.

Let me tell you a story. Early in my tenure at Yahoo we tried to get into the site dev process in the early stages in order to work SEO into the Product Recommendations Documents (PRD) before wireframing began. But as a fairly new horizontal group not reporting into any of the products, this was often difficult. Nay, damn near impossible. So usually we made friends with the product teams and got in where we could.
Content gaps – make an inventory of the site’s key content assets, are they lacking any foundational/cornerstone content pieces, non-existent content types, or relevant topic areas that haven’t been covered? What topics or content are missing from your competitors? Can you beat your competitors’ information-rich content assets? Useful guides on Content Gap Analysis:
I love your post. I keep coming back because you always have great content I can use in my business as well as share. Since I own my own Digital Marketing company I guess you would be one of THE influencers in Internet Marketing field. I just started my business and because most influencers on twitter are talking about Content Marketing, that is what I have been writing about. But my site is only about a month old so I will just stay consistent in my writing. I’m also in the process of changing my navigation bar so be know how to get to what they want faster. Which would be “what is SEO”, etc. Thanks and would love any advice you can give me.
Thanks Brian. I’ve had a “a-ha” moment thanks to you! Great advice. I knew that backlinks would improve the organic SEO rankings to our client-targeted landing pages but I never knew it was through getting influencers to backlink blogs. I always just assumed it was great content that users wanted to share with others. It was driving me mad why people love my content but never share enough. Now I know!
The world is mobile today. Most people are searching on Google using a mobile device. The desktop version of a site might be difficult to view and use on a mobile device. As a result, having a mobile ready site is critical to your online presence. In fact, starting in late 2016, Google has begun experiments to primarily use the mobile version of a site's content42 for ranking, parsing structured data, and generating snippets.
A solid content marketing and SEO strategy is also the most scalable way to promote your business to a wide audience. And this generally has the best ROI, as there is no cost per click — so you are scaling your marketing without directly scaling your costs. This kind of SEO strategy is not right for every business, but when it is a good fit, it’s almost unbeatable.
Provide full functionality on all devices. Mobile users expect the same functionality - such as commenting and check-out - and content on mobile as well as on all other devices that your website supports. In addition to textual content, make sure that all important images and videos are embedded and accessible on mobile devices. For search engines, provide all structured data and other metadata - such as titles, descriptions, link-elements, and other meta-tags - on all versions of the pages.

Before you say it – no, true guest blogging isn’t dead, despite what you may have heard. Securing a guest post on a reputable site can increase blog traffic to your website and help build your brand into the bargain. Be warned, though – standards for guest blogging have changed radically during the past eighteen months, and spammy tactics could result in stiff penalties. Proceed with caution.

Yep and sometimes it’s just being a little creative. I’ve started a little blog on seo/wordpress just for fun actually… no great content on it like here though… but because the competition is so tough in these niches I decided to take another approach. I created a few WordPress plugins that users can download for free from wordpress.org… and of course these link to my site so this gets me visitors each day.

Really great article. In some cases when you are creating strategies there are many SEO companies that focus more on finding link building opportunities rather than actually create visual assets or other link earning content. Do you think more emphasis should be placed on creating these assets first based first on understanding hot topics or refining a customers pain points?

I understand that some SEO agencies and departments are not built for the big SEO campaigns. Strategic work takes time, and speeding (or scaling) through the development stage will likely do more harm than good. It's like cramming for a test — you're going to miss information that's necessary for a good grade. It would be my pleasure if this post inspired some change in your departments.
I am a little confused on your first point. Sorry if it is a simple one to understand and I’m just missing it. What good would finding dead links on Wiki do for my personal website? I thought you would explain how to find dead links faster within my own site… but it seems that your tip is way more valuable than that. I just don’t quite understand what I do to positively affect MY site with this. Any help would be great 🙂 THANKS!
Your posts are amazingly right on target. In this specific post, #3 resonated with with personally. I am a content manager as well as a blogger for the website mentioned. I promote through different blog sites and social media. In fact, i just finished an article about you. Credited to you and your website of course. Thank you for such amazing information. You make things sound so easy. Thanks again!

That second link will still help you because it will pass extra PR to that page. But in terms of anchor text, most of the experiments I’ve seen show that the second link’s anchor text probably doesn’t help. That being said, Google is more sophisticated than when a lot of these came out so they may count both anchors. But to stay on the safe side I recommend adding keywords to navigation links if possible.
×