Robots.txt is not an appropriate or effective way of blocking sensitive or confidential material. It only instructs well-behaved crawlers that the pages are not for them, but it does not prevent your server from delivering those pages to a browser that requests them. One reason is that search engines could still reference the URLs you block (showing just the URL, no title or snippet) if there happen to be links to those URLs somewhere on the Internet (like referrer logs). Also, non-compliant or rogue search engines that don't acknowledge the Robots Exclusion Standard could disobey the instructions of your robots.txt. Finally, a curious user could examine the directories or subdirectories in your robots.txt file and guess the URL of the content that you don't want seen.
To avoid undesirable content in the search indexes, webmasters can instruct spiders not to crawl certain files or directories through the standard robots.txt file in the root directory of the domain. Additionally, a page can be explicitly excluded from a search engine's database by using a meta tag specific to robots (usually ). When a search engine visits a site, the robots.txt located in the root directory is the first file crawled. The robots.txt file is then parsed and will instruct the robot as to which pages are not to be crawled. As a search engine crawler may keep a cached copy of this file, it may on occasion crawl pages a webmaster does not wish crawled. Pages typically prevented from being crawled include login specific pages such as shopping carts and user-specific content such as search results from internal searches. In March 2007, Google warned webmasters that they should prevent indexing of internal search results because those pages are considered search spam.[47]

Tablet - We consider tablets as devices in their own class, so when we speak of mobile devices, we generally do not include tablets in the definition. Tablets tend to have larger screens, which means that, unless you offer tablet-optimized content, you can assume that users expect to see your site as it would look on a desktop browser rather than on a smartphone browser.


I read your post on my mobile phone while on a bus travel and it stirred me due to the fact that I’ve been doing SEO lately the poor man’s way like blog commenting, Social bookmarking, forum signature, directory submission, etc. I don’t know if any of these things still work today since I’ve been practicing them since 2008. These 25 SEO tactics that you have shared got my interest. Actually I am planning to make a new site right now after reading this one. I found out that maybe I’ve been doing a lot of spamming lately that my site is still not ranking on my desired keywords. And also, you have pointed out that it is not just by means of Keyword planner that we will be able to get keywords since there are others like, as what you have said, the wikipedia and the like. I am planning to make use of this article as my guide in starting a new one. I bookmarked it… honestly.. 🙂 And since I have read a lot of articles regarding SEO tips from other sites, I can compare them to your tactics and this is more interesting and exciting. I want to build a quality site that can make me generate income for long years. THANK YOU FOR BEING GENEROUS WITH YOUR KNOWLEDGE. I will try to communicate with you through email and I hope you can coach me Brian. .. please.. 🙂
Sorry for the long comment, I just am really happy to see that after all those years of struggle you finally made a break through and you definitely deserve it bro. I’ve had my own struggles as well and just reading this got me a little emotional because I know what it feels like to never wanting to give up on your dreams and always having faith that one day your time will come. It’s all a matter of patience and learning from failures until you get enough experience to become someone who can generate traffic and bring value to readers to sustain long term relationships.
Like the hundreds of people already, I thought this was an amazing post. You have a great way of breaking things down into ways that the average reader will be able to understand and make actionable. I think this is a great resource for our readers, so I included it in my monthly roundup of the best SEO, social media, and content marketing articles. https://www.northcutt.com/blog/2014/02/january-resource-round-up-the-best-of-seo-social-media-and-content-marketing/

Really its just a matter of getting creative - grab a cup of caffeine and think for a minute about what resources you have to try to get some insight on your visitors (or target markets) and their needs before you dive in.  Think about how much time it might take you (or what the cost of the reports would be if you are going to buy some market research reports), and tack that onto your billing as an optional service.

Search engines use complex mathematical algorithms to interpret which websites a user seeks. In this diagram, if each bubble represents a website, programs sometimes called spiders examine which sites link to which other sites, with arrows representing these links. Websites getting more inbound links, or stronger links, are presumed to be more important and what the user is searching for. In this example, since website B is the recipient of numerous inbound links, it ranks more highly in a web search. And the links "carry through", such that website C, even though it only has one inbound link, has an inbound link from a highly popular site (B) while site E does not. Note: Percentages are rounded.
Think about the words that a user might search for to find a piece of your content. Users who know a lot about the topic might use different keywords in their search queries than someone who is new to the topic. For example, a long-time football fan might search for [fifa], an acronym for the Fédération Internationale de Football Association, while a new fan might use a more general query like [football playoffs]. Anticipating these differences in search behavior and accounting for them while writing your content (using a good mix of keyword phrases) could produce positive results. Google Ads provides a handy Keyword Planner34 that helps you discover new keyword variations and see the approximate search volume for each keyword. Also, Google Search Console provides you with the top search queries your site appears for and the ones that led the most users to your site in the Performance Report35.
There are a number of ways to optimize your website for conversion—such as by including calls to action and lead capture forms in the right places, providing the information your visitors are seeking, and making navigation easy and intuitive. But the first step is to be attracting the right visitors to your site in the first place. Your goal when it comes to website traffic is to be driving more qualified visitors to your site. That is, those who are most likely to convert into leads and customers.
People love to learn, and webinars are an excellent way to impart your wisdom to your eagerly waiting audience. Combined with an effective social promotion campaign, webinars are a great way to increase traffic to your website. Send out an email a week or so ahead of time, as well as a “last chance to register” reminder the day before the webinar. Make sure to archive the presentation for later viewing, and promote your webinars widely through social media. If you're wondering how to do a webinar, click the link for some tips.

Another example when the “nofollow" attribute can come handy are widget links. If you are using a third party's widget to enrich the experience of your site and engage users, check if it contains any links that you did not intend to place on your site along with the widget. Some widgets may add links to your site which are not your editorial choice and contain anchor text that you as a webmaster may not control. If removing such unwanted links from the widget is not possible, you can always disable them with “nofollow" attribute. If you create a widget for functionality or content that you provide, make sure to include the nofollow on links in the default code snippet.
I consulted a few years ago before Yahoo and CNET and my clients were all small businesses, even friends' sites.  No matter the size of the project, you can still try to get some insight into your target audiences and what they need or want.  I mentioned in a previous comment I used Search once to determine sentiment on a site vs. it's competitors by searching for a feature the site and its competitors all had, along with "like", "love", "hate", "wish", etc.  I also took note of who the people were who said those things and where they were talking (forums, twitter, etc).  It's a hacked manual approach and although not nearly as quality as a good market research report, at least I have a llittle bit of insight before going out to make site recommendations based solely on tags & links.  If you're recommending the site build things that people want (and fix or remove things that they dont), you're more likely to gain links and traffic naturally.
Wow I wish I had the comments you do. So you’re saying that by re-visiting and re-writing old posts garnered 111% more traffic by updating old posts? I feel like I go back from time to time to do this, mostly to keep information current. This tip makes me want to revisit all my old posts to see what could be updated. That’s a lot of low hanging fruit. Thanks for this one.
Thanks for a this timely article. If I understand it correctly, are you saying that we would better be off looking at market data in our niche and make an article of that for influencers to share rather than actionable tips that the target clients would be interested in? Shouldn’t there be a double strategy – articles for the influencers to share and articles for the users to enjoy?

Search engine optimization (SEO) is often about making small modifications to parts of your website. When viewed individually, these changes might seem like incremental improvements, but when combined with other optimizations, they could have a noticeable impact on your site's user experience and performance in organic search results. You're likely already familiar with many of the topics in this guide, because they're essential ingredients for any web page, but you may not be making the most out of them.
Thanks Brian for your article. I am in the healthy living niche. I want to team up with bloggers in my own niche where we can share material it makes sense to me. But I have my own unique message and that is what I have been devoted to! Dah! I see now that my focus should be on what is popular among my peers and add to this. I think I’m finally getting the picture! I am specifically into FOOD MEDICINE perhaps I should start writting about the dangers of a Gluten free diet! Not for everyone!
Page and Brin founded Google in 1998.[23] Google attracted a loyal following among the growing number of Internet users, who liked its simple design.[24] Off-page factors (such as PageRank and hyperlink analysis) were considered as well as on-page factors (such as keyword frequency, meta tags, headings, links and site structure) to enable Google to avoid the kind of manipulation seen in search engines that only considered on-page factors for their rankings. Although PageRank was more difficult to game, webmasters had already developed link building tools and schemes to influence the Inktomi search engine, and these methods proved similarly applicable to gaming PageRank. Many sites focused on exchanging, buying, and selling links, often on a massive scale. Some of these schemes, or link farms, involved the creation of thousands of sites for the sole purpose of link spamming.[25]

“Syndicate carefully: If you syndicate your content on other sites, Google will always show the version we think is most appropriate for users in each given search, which may or may not be the version you’d prefer. However, it is helpful to ensure that each site on which your content is syndicated includes a link back to your original article. You can also ask those who use your syndicated material to use the noindex meta tag to prevent search engines from indexing their version of the content.”


In February 2011, Google announced the Panda update, which penalizes websites containing content duplicated from other websites and sources. Historically websites have copied content from one another and benefited in search engine rankings by engaging in this practice. However, Google implemented a new system which punishes sites whose content is not unique.[36] The 2012 Google Penguin attempted to penalize websites that used manipulative techniques to improve their rankings on the search engine.[37] Although Google Penguin has been presented as an algorithm aimed at fighting web spam, it really focuses on spammy links[38] by gauging the quality of the sites the links are coming from. The 2013 Google Hummingbird update featured an algorithm change designed to improve Google's natural language processing and semantic understanding of web pages. Hummingbird's language processing system falls under the newly recognized term of 'Conversational Search' where the system pays more attention to each word in the query in order to better match the pages to the meaning of the query rather than a few words [39]. With regards to the changes made to search engine optimization, for content publishers and writers, Hummingbird is intended to resolve issues by getting rid of irrelevant content and spam, allowing Google to produce high-quality content and rely on them to be 'trusted' authors.

Like the hundreds of people already, I thought this was an amazing post. You have a great way of breaking things down into ways that the average reader will be able to understand and make actionable. I think this is a great resource for our readers, so I included it in my monthly roundup of the best SEO, social media, and content marketing articles. https://www.northcutt.com/blog/2014/02/january-resource-round-up-the-best-of-seo-social-media-and-content-marketing/


Thanks Brain, these tips are useful. The key thing with most of the tips that you provided is that it will take time and most people want to have more traffic, but they do not want to do the work and put in the time. However, if you put in the word and you do a quality job then it will work out. I think that is the overall strategies that a lot of SEOs have to do today is just to take the time and figure out quality strategies.
#6 Go on podcasts! In 13 years of SEO and digital marketing, I’ve never had as much bang for the buck. You go on for 20 minutes, get access to a new audience and great natural links on high dwell time sites (hosts do all the work!). Thanks for including this tip Brian, I still don’t think the SEO community has caught on to the benefits of podcast guesting campaigns for SEO and more…it’s changed my business for sure.
There are a few competitive tools we tend to gravitate towards in our industry. SEMrush is a fantastic tool allowing anyone to look up a website and get an estimated search visibility and traffic share. Drilling in shows how well pages perform independently. Gleaning through exports can quickly reveal what topics are driving traffic, to which you might replicate or improve your own version.
5) Post at the right time. Let’s say you want to post in the r/Entrepreneur/ subreddit, but there’s already a post in the #1 spot with 200 upvotes, and it was posted 4 hours ago. If you post at that time, you probably won’t overtake that #1 spot, and you’ll get less traffic. However, if you wait a day, check back, and see that the new #1 spot only has 12-15 upvotes, you’ll have a golden opportunity. It will be much easier for you to hit the #1 spot and get hundreds of upvotes.
Google recommends that all websites use https:// when possible. The hostname is where your website is hosted, commonly using the same domain name that you'd use for email. Google differentiates between the "www" and "non-www" version (for example, "www.example.com" or just "example.com"). When adding your website to Search Console, we recommend adding both http:// and https:// versions, as well as the "www" and "non-www" versions.

Really great article. In some cases when you are creating strategies there are many SEO companies that focus more on finding link building opportunities rather than actually create visual assets or other link earning content. Do you think more emphasis should be placed on creating these assets first based first on understanding hot topics or refining a customers pain points?
Thanks Brain, these tips are useful. The key thing with most of the tips that you provided is that it will take time and most people want to have more traffic, but they do not want to do the work and put in the time. However, if you put in the word and you do a quality job then it will work out. I think that is the overall strategies that a lot of SEOs have to do today is just to take the time and figure out quality strategies.
Fantastic information ,extremely informative and highly valuable for individuals looking to achieve website traffic.Our marketing team involved themselves in this activity using a hybrid email marketing called EasySendy Pro. We saw some vast improvement in our email open rate and click through rate. Therefore, as per my experience I can confidently say that email marketing is very effective and also it drives good amount of traffic .
Over the next few posts, and starting with this one, I’m going to share with you a detailed 8-step process for creating your own SEO strategy (what I often refer to as an SRD (SEO Research Document)), beginning with defining target audiences and taking it all the way through some fairly comprehensive competitive research, search traffic projections, content strategies, and specific goals and prioritizations.
There are community forums setup online for virtually every niche, industry, or topic you can imagine. The internet is a prime place for like minded people to talk to each other. 9 times out of 10 you can find a forum for your industry just by typing in [your industry]forum.com or searching for “[Your Industry] Forum” on Google. Find the forums in your industry with the largest user base, start posting there and become an active community member. Most forums will allow you to leave a link to your website in your post signature, so the more you post the more traffic you get.

Not all strategies have to be big. Sometimes your window is small, and you're forced to build for a distinct — or tiny — opportunity. Maybe you don't have time for a proper large-scale strategy at all; a tactic or two might be all you can do to carry in a win. Just make that very clear with your boss or client. Don't misrepresent what you're trying to build as an SEO campaign.


Another way to increase traffic to your website is to get listed in free online directories and review sites. For most of these sites, your profile will have a link to your website, so actively updating these listings and getting positive reviews is likely to result in more website traffic. In addition, many directories like Yelp have strong domain authority on Google. There’s a chance that your business’s free Yelp page could rank high for relevant searches.
×