You may not want certain pages of your site crawled because they might not be useful to users if found in a search engine's search results. If you do want to prevent search engines from crawling your pages, Google Search Console has a friendly robots.txt generator to help you create this file. Note that if your site uses subdomains and you wish to have certain pages not crawled on a particular subdomain, you'll have to create a separate robots.txt file for that subdomain. For more information on robots.txt, we suggest this Webmaster Help Center guide on using robots.txt files13.

In March 2006, KinderStart filed a lawsuit against Google over search engine rankings. KinderStart's website was removed from Google's index prior to the lawsuit, and the amount of traffic to the site dropped by 70%. On March 16, 2007, the United States District Court for the Northern District of California (San Jose Division) dismissed KinderStart's complaint without leave to amend, and partially granted Google's motion for Rule 11 sanctions against KinderStart's attorney, requiring him to pay part of Google's legal expenses.[70][71]
This one is so obvious, we’re going to look at it first. Paid search, social media advertising and display advertising (try our Smart Ads Creator!) are all excellent ways of attracting visitors, building your brand and getting your site in front of people. Adjust your paid strategies to suit your goals – do you just want more traffic, or are you looking to increase conversions, too? Each paid channel has its pros and cons, so think carefully about your objectives before you reach for your credit card.
Sending out regular newsletters and promoting offers through email is a great way to stay in touch with your customers and can also help to get traffic to your website. Provide useful information and links to pages on your website where they can learn more, such as through blog posts and landing pages for particular offers. Just make sure that you don`t continually bombard your readers with emails or your customers will either disengage with, delete, or unsubscribe from your emails.
I have been trying to produce more content because I believed the lack of traffic was to the small amount of content, but after reading your blog post, i’m beginning to doubt wether or not this is quality content. I will definitely do more research on influencers on my niche, now I have to figure out how to get their attention with my kind of content.
For example, let’s say I have a health site. I have several types of articles on health, drug information, and information on types of diseases and conditions. My angle on the site is that I’m targeting seniors. If I find out seniors are primarily interested in information on prescription drug plans and cheap blood pressure medication, then I know that I want to provide information specifically on those things. This allows me to hone in on that market’s needs and de-prioritize or bypass other content.
Yahoo! might be losing the search engine market share battle but they still dominate in the Question and Answers arena. People ask thousands of questions every day in almost every niche and industry you can imagine. A quick search for “Search Engine Optimization” shows over 1,300 questions that can be answered. The key to driving massive amounts of traffic from Yahoo! Answers is to give genuinely helpful answers. Instead of trying to create a blatant advertisement for your website work on becoming an authority in your industry. This technique has the potential to send you far more than 100 visitors. When people use search engines to look for the questions you answered often times a Yahoo! Answers result will appear near the top of the search results. This will give you and your website a ton of exposure if you answer commonly asked questions!
Thanks for a this timely article. If I understand it correctly, are you saying that we would better be off looking at market data in our niche and make an article of that for influencers to share rather than actionable tips that the target clients would be interested in? Shouldn’t there be a double strategy – articles for the influencers to share and articles for the users to enjoy?
What is the leadership like? What kind of culture do they cultivate? In smaller companies, the leaders tend to influence the culture. In larger companies, unfortunately, this can get lost. But if you have access to the leadership, spend some time learning about their vision. It should match up to the company's core values, but sometimes there are more gems locked in their minds.
I can feel the excitement in your writing, and thanks for all this free info you know how to get loyal subscribers, I believe you are one of the best in the business, no up selling just honesty, its so refreshing, i cant keep up with you I have only just finished the awesome piece of content you told me to write and just about to modify it then finally start promoting, i will be looking at this also THANK YOU, PS i couldn’t make your last course but i will get on board for the next one
When Larry wrote about the kick in the proverbial teeth that eBay took from Google’s Panda update, we managed to secure a link from Ars Technica in the Editor’s Pick section alongside links to The New York Times and National Geographic. Not too shabby – and neither was the resulting spike in referral traffic. Learn what types of links send lots of referral traffic, and how to get them, in this post.
#16 is interesting because no one really knows about it. Myself and a former colleagu did a test on it about 4 years ago and published our results which conculded what you are saying. Since then I’ve been careful to follow this rule. The only issue is that often times using the exact kw does not “work” for navigation anchor texts. But with a little CSS trickery one can get the code for the nav bar to be lower in the code, prioritizing contextual links. I’ve also seen sites add links to 3-5 specific and important internal pages with keyword rich anchor texts, at the very top of the page in order to get those important internal links to be indexed first.
Landing pages are another free source of traffic to your website. These are pages specific to your offers, such as for redeeming a discount code, downloading a free guide, or starting a free trial. They contain the details users need in order to move forward and convert, and focus on one specific call to action, making it more likely to happen. Because landing pages are so specific, you can get very targeted in your messaging, increasing the traffic coming to those pages.
Whatever industry you’re in, chances are there are at least one or two major conventions and conferences that are relevant to your business. Attending these events is a good idea – speaking at them is even better. Even a halfway decent speaking engagement is an excellent way to establish yourself as a thought leader in your industry and gain significant exposure for your site.
For some reason I had to delete some pages, these pages are using the HTML suffix, so I blocked them in robots.txt use Disallow: /*.html, but it’s been almost a year, I found that google robot often capture these pages, How can I quickly let Google completely remove these pages? And I have removed these URL from google webmaster tool by google index-> remove URLs, but Google still capture these pages.
×