Traditionally, defining a target audience involves determining their age, sex, geographic locations, and especially their needs (aka pain points). Check out usability.gov’s description of personas and how to do task analysis & scenarios for more details, or better yet, read Vanessa Fox’s upcoming book about personas related to search and conversion.
Sure, we did keyword research, we recommended partnerships and widgets and architecture advice, but we didn’t step back and take a good look at our target audiences, what sites were meeting their specific needs in search results, and what we specifically could build into the product that would be far more desirable than what everyone else had (not even thought of yet ideally) to make sure our entire site is superior, resulting in the inevitable stealing of search traffic from our competitors.
The leading search engines, such as Google, Bing and Yahoo!, use crawlers to find pages for their algorithmic search results. Pages that are linked from other search engine indexed pages do not need to be submitted because they are found automatically. The Yahoo! Directory and DMOZ, two major directories which closed in 2014 and 2017 respectively, both required manual submission and human editorial review. Google offers Google Search Console, for which an XML Sitemap feed can be created and submitted for free to ensure that all pages are found, especially pages that are not discoverable by automatically following links in addition to their URL submission console. Yahoo! formerly operated a paid submission service that guaranteed crawling for a cost per click; however, this practice was discontinued in 2009.