Robots.txt is not an appropriate or effective way of blocking sensitive or confidential material. It only instructs well-behaved crawlers that the pages are not for them, but it does not prevent your server from delivering those pages to a browser that requests them. One reason is that search engines could still reference the URLs you block (showing just the URL, no title or snippet) if there happen to be links to those URLs somewhere on the Internet (like referrer logs). Also, non-compliant or rogue search engines that don't acknowledge the Robots Exclusion Standard could disobey the instructions of your robots.txt. Finally, a curious user could examine the directories or subdirectories in your robots.txt file and guess the URL of the content that you don't want seen.
You mentioned: "many times clients have already done this work.  Ask them for copies of their market research reports when you start a project.  It will save you a ton of time and effort!"  We do this with most of our clients, like you said we have found that around 75% of the have some kind of Market research done, that saves you a lot of time and helps setting up the right SEO Strategy. 

SEO may generate an adequate return on investment. However, search engines are not paid for organic search traffic, their algorithms change, and there are no guarantees of continued referrals. Due to this lack of guarantees and certainty, a business that relies heavily on search engine traffic can suffer major losses if the search engines stop sending visitors.[61] Search engines can change their algorithms, impacting a website's placement, possibly resulting in a serious loss of traffic. According to Google's CEO, Eric Schmidt, in 2010, Google made over 500 algorithm changes – almost 1.5 per day.[62] It is considered a wise business practice for website operators to liberate themselves from dependence on search engine traffic.[63] In addition to accessibility in terms of web crawlers (addressed above), user web accessibility has become increasingly important for SEO.
I read The Art of War in college, written by the Chinese general Sun Tzu (author of the quote above). While his actual existence is debated, his work is often considered as brilliant military strategy and philosophy. Thus, The Art of War is often co-opted into business for obvious reasons. Throughout the book, you'll realize tactics and strategy are not interchangeable terms.

You probably visit at least a few sites that are relevant to your business on a regular basis, so why not join the conversation? Commenting doesn’t necessarily provide an immediate boost to referral traffic right away, but making a name for yourself by providing insightful, thought-provoking comments on industry blogs and sites is a great way to get your name out there – which can subsequently result in driving more traffic to your own site. Just remember that, as with guest posting, quality and relevance are key – you should be engaging with other people in your niche, not dropping spam links on unrelated websites.
For some reason I had to delete some pages, these pages are using the HTML suffix, so I blocked them in robots.txt use Disallow: /*.html, but it’s been almost a year, I found that google robot often capture these pages, How can I quickly let Google completely remove these pages? And I have removed these URL from google webmaster tool by google index-> remove URLs, but Google still capture these pages.

Fortunately, Google puts more weight on the anchor text of external links anyway. So as long as some of your external links have your target anchors, you’re probably OK with a “Home” button. In fact, I’ve ranked homepages with a “Home” anchor text nav button for some seriously competitive terms. So it’s not a make-or-break ranking signal by any means.


A solid content marketing and SEO strategy is also the most scalable way to promote your business to a wide audience. And this generally has the best ROI, as there is no cost per click — so you are scaling your marketing without directly scaling your costs. This kind of SEO strategy is not right for every business, but when it is a good fit, it’s almost unbeatable.

Expert roundups have been abused in the Internet Marketing industry, but they are effective for several reasons. First, you don’t have to create any content. The “experts” create all the content. Second, it is ego bait. Meaning, anyone who participated in the roundup will likely share it with their audience. Last, it is a great way to build relationships with influencers.
Black hat SEO involves techniques such as paying to post links to a website on link farms, stuffing the metadata with nonrelated keywords, and using text that is invisible to readers to attract search engines. These and many other black hat SEO tactics may boost traffic, but search engines frown on the use of such measures. Search engines may punish sites that employ these methods by reducing their page rank or delisting them from search results.
Your posts are amazingly right on target. In this specific post, #3 resonated with with personally. I am a content manager as well as a blogger for the website mentioned. I promote through different blog sites and social media. In fact, i just finished an article about you. Credited to you and your website of course. Thank you for such amazing information. You make things sound so easy. Thanks again!
On a dating niche site I took the ‘ego-bait’ post one step further and had sexy girls perform a dance and strip to revel the names of the major bloggers in my niche written on their bodies. As you can imagine it got a lot of attention from the big players in my niche and my audience and is a little more creative for getting links, shares and traffic.
Marcus Miller is an experienced SEO and PPC consultant based in Birmingham, UK. Marcus focuses on strategy, audits, local SEO, technical SEO, PPC and just generally helping businesses dominate search and social. Marcus is managing director of the UK SEO and digital marketing company Bowler Hat and also runs wArmour aka WordPress Armour which focuses on helping WordPress owners get their security, SEO and site maintenance dialled in without breaking the bank.
Yep and sometimes it’s just being a little creative. I’ve started a little blog on seo/wordpress just for fun actually… no great content on it like here though… but because the competition is so tough in these niches I decided to take another approach. I created a few WordPress plugins that users can download for free from wordpress.org… and of course these link to my site so this gets me visitors each day.
Use your keyword list to determine how many different pillar pages you should create. Ultimately, the number of topics for which you create pillar pages should coincide with how many different products, offerings, and locations your business has. This will make it much easier for your prospects and customers to find you in search engines no matter what keywords they use.
Thanks for a this timely article. If I understand it correctly, are you saying that we would better be off looking at market data in our niche and make an article of that for influencers to share rather than actionable tips that the target clients would be interested in? Shouldn’t there be a double strategy – articles for the influencers to share and articles for the users to enjoy?
I find it interesting that you talked about nutrition supplements for athletes. I am very close to launching such a product for enhancing aerobic exercise performance in women (ie. improved times in a 3 mile run).. The product contains no stimulants or exotic herbs. In fact three of the five ingredients are well known minerals, but in forms not found in most multi-vitamin-mineral supplements. The research behind the product comes from me. The credibility behind the research is that I am a professor of human nutrition with over 100 research papers. Now, the trick will be to use my connections and credibility in a business savvy way.
I have been trying to produce more content because I believed the lack of traffic was to the small amount of content, but after reading your blog post, i’m beginning to doubt wether or not this is quality content. I will definitely do more research on influencers on my niche, now I have to figure out how to get their attention with my kind of content.
Expert roundups have been abused in the Internet Marketing industry, but they are effective for several reasons. First, you don’t have to create any content. The “experts” create all the content. Second, it is ego bait. Meaning, anyone who participated in the roundup will likely share it with their audience. Last, it is a great way to build relationships with influencers.
Hey Brian I must say it’s a awesome content you are sharing .my question to you is how did you transform from a nutrition expert to a Seo master I mean both subjects are poles apart so how did you learn SEO can you share your story because I find my self in similar situation I am an engineer by profession and I am starting a ecommerce business niche is Apparel no experience of watspever in Blog writing and SEO if you can throw some resources where I can improve my skills that would be a huge help
Promoting your websites by publishing articles to various article directories is by no means a new idea but still an extremely effective way to drive traffic. If you write content and publish it to websites like Article Base, and Article Dashboard website owners will pick it up and post it. This idea is similar to guest blogging except that you only have to write one piece of content that can end up on hundreds of even thousands of blogs and websites. The same rule applies here: don’t be boring – be creative and interesting and use common keywords in your article and title so website owners can find it!

AdWords and Facebook are further vehicles for reaching the appropriate audiences with more refined messaging. I think it's important to create personas for your current visitors and the type of visitors you want to attract. It might be valuable to create personas of those you don't want to attract, to keep in the back of your mind as your content and advertising calendar is being built following the delivery of your overall strategy.
Wow Brian, You have solved my problem. A few days back I was looking for ways to increase traffic on my tech blog, I found this blog post by you while I was looking out for possible tricks to increase traffic. I must say that few of the tricks mentioned above really worked for me. For example, I updated a few old posts on my blog, I did try the broken link building technique and the last I did was to repost my content on Medium.
Content gaps – make an inventory of the site’s key content assets, are they lacking any foundational/cornerstone content pieces, non-existent content types, or relevant topic areas that haven’t been covered? What topics or content are missing from your competitors? Can you beat your competitors’ information-rich content assets? Useful guides on Content Gap Analysis:

This post and the Skycraper technique changed my mind about how I approach SEO, I’m not a marketing expert and I haven’t ranked sites that monetize really well, I’m just a guy trying to get some projects moving on and I’m not even in the marketing business so I just wanted to say that the way you write makes the information accesible, even if you’re not a native english speaker as myself.


The world is mobile today. Most people are searching on Google using a mobile device. The desktop version of a site might be difficult to view and use on a mobile device. As a result, having a mobile ready site is critical to your online presence. In fact, starting in late 2016, Google has begun experiments to primarily use the mobile version of a site's content42 for ranking, parsing structured data, and generating snippets.

A navigational page is a simple page on your site that displays the structure of your website, and usually consists of a hierarchical listing of the pages on your site. Visitors may visit this page if they are having problems finding pages on your site. While search engines will also visit this page, getting good crawl coverage of the pages on your site, it's mainly aimed at human visitors.

Early versions of search algorithms relied on webmaster-provided information such as the keyword meta tag or index files in engines like ALIWEB. Meta tags provide a guide to each page's content. Using metadata to index pages was found to be less than reliable, however, because the webmaster's choice of keywords in the meta tag could potentially be an inaccurate representation of the site's actual content. Inaccurate, incomplete, and inconsistent data in meta tags could and did cause pages to rank for irrelevant searches.[10][dubious – discuss] Web content providers also manipulated some attributes within the HTML source of a page in an attempt to rank well in search engines.[11] By 1997, search engine designers recognized that webmasters were making efforts to rank well in their search engine, and that some webmasters were even manipulating their rankings in search results by stuffing pages with excessive or irrelevant keywords. Early search engines, such as Altavista and Infoseek, adjusted their algorithms to prevent webmasters from manipulating rankings.[12]
How do you ask others for link opportunities? Most of the time people are only interested in either reciprocal links, or them providing guest posts on my site (when I reach out). And I can’t imagine if I did a round up post getting many inbound links. People would be thrilled that they had received a link, and wouldn’t create a reciprocal link to destroy the value.
Google Analytics is an invaluable source of data on just about every conceivable aspect of your site, from your most popular pages to visitor demographics. Keep a close eye on your Analytics data, and use this information to inform your promotional and content strategies. Pay attention to what posts and pages are proving the most popular. Inspect visitor data to see how, where and when your site traffic is coming from.
Sending out regular newsletters and promoting offers through email is a great way to stay in touch with your customers and can also help to get traffic to your website. Provide useful information and links to pages on your website where they can learn more, such as through blog posts and landing pages for particular offers. Just make sure that you don`t continually bombard your readers with emails or your customers will either disengage with, delete, or unsubscribe from your emails.
×