A Grimoire for the Wizards of Search

SERP's & Searchers
A compendium of magical spells for the wizards of search and technology.

To the outside world, we are the mystical manipulators of magical energies that surround the inner sanctum of search. However, within our ranks, we are divided... the wizards of the white hat and the wizards of the black hat. We eternally battle to control the virtual domain of the everpresent Google, who was, who is and who will be to come, the Master of Past and Present.

There are powerful spells and arcane knowledge that we possess to channel the energies of semantics and the internet.

Level 1 Spells:

• Summon Keywords: This ability allows the wizard of search to conjure up lists of relevant keywords. At higher levels, this spell allows the wizard to have a more focused and refined list.
• Reveal Plugins: The legendary Firefox, unlike the Explorer has the ability to allow wizards to customize it according to their needs, during incantations, this can be helpful to give the wizard to see deeper into the site than normal.
• Detect Spam: Upon looking at the page, the wizard will be able to spot non-sensical and repeating phrases that plague the site.
• View Source: There is a hidden world behind all websites, the wizards of search are able to decipher the source and divine the hidden knowledge that it has.
• Summon Directories: The search wizard can tap the energies and forces that flow from public directories. These energies enhance the site with a glow that the Search Gods recognize.
• Spam Source: One of the first spells the wizards of the black hat learns, this allows the wizard to manipulate the search engines with repetative words. This ability could backfire however, as they could be banished by the Search Gods.

Level 2 Spells:

• Summon Key Phrases: The wizard is now able to craft the summoned keywords into phrases that match the intent of the site.
  
• Summon Title Tags: The wizard is able to manipulate the site's source directly and give it the ability to be named. Once a page or a site has a true name, the Gods of Search can properly identify it and give it its due.
  
• Detect Redirect I: This spell allows the wizard to detect the simplest of redirects, the meta-refresh and the Java Redirect. Once the redirect is identified the wizard is able to channel the coding magic to put them in order.
  
• Find Whois: The "Whois" spell allows the wizard to find other sites on the same IP, revealing other efforts of the black hat wizards.
  
• Text of Invisibility: A higher level of the spam spell, this allows the black hat wizards to hide their spam with white on white text, text under images, spammed ALT tags and source code spam so that the users dont see the spam.
  
• Shrink Text: Another black hat spell, this causes normal text to be shrunk past the point of legibility, yet still be seen by users and search engines. Another variation of the spam spell, it often causes confusion and anger in user behavior.
  
• Summon Links I: A summoning spell more powerful than "summon directory", this spell allows the wizard to manipulate the words on the page to draw unsuspecting users to feel a compulsion to link to them. At this level, the user has a good chance to resist the urge, but each link adds more energy to the site.

Level 3 Spells:

• Invoke User Intent: The wizard is able to determine the users' mind and use the keyword phrases to guide them along the path of their intent.
  
• Summon Description: This spell combines the ability to charm the user into entering the site, while keeping the keyword integrity intact.
  
• Summon Link Bait: The wizard is able to charm a massive amount of people into linking to their site.
  
• Detect Redirct II: Upon detection, the wizard is able to see more difficult redirects and divine the type of them, 301 and 302 redirects become second nature to the wizard.
  
• Summon Paid Traffic: By combining the energy channels of the search engines, the wizard sacrifices a small amount of their own vitality in exchange for traffic and the potential to gain a higher amount of vitality
  
• Div of Invisibility: The wizards of the black hat are able to hide some of their spam spells in a div of invisibility, while it's harder for the search engines to catch, there is a chance that they will.
  
• Summon Link Farm: Another black hat wizard technique, this spell summons thousands and thousands of links from other sites, these energy channels are less effective than the true channels, they provide a short term benefit to the black hat wizard.
  
• Evoke Lesser Blogger: Once evoked, the lesser blogger writes about the wizard and hails their efforts in front of their own audience. Both wizards benefit from this spell... but it's also a double edged spell, there's a chance that the blogger will turn on the wizard and try to break him down.
  
• Summon Lesser Industry Contact: There are many wizards of search, this spell allows the wizard access to speak with the industry contact over long distances, the incantations and help from the industry contact allow the lesser wizard to focus and potentially spark new ideas.
  

Level 4 Spells:

• Behavioral Scrying: With this spell, the wizard can see into the minds of multiple users and allow them to create enchantments to attract more and more people. The users find what they want and share some of their vitality with the wizard.
  
• Summon Links III: At this level, the links summoned are from high level wizards, institutions and other quality sites. There is a chance, that at this point, the summoned links will continually rise on their own.
  
• Control Page Rank: One of the tools of the black hat wizard is to manipulate the very energy of the mythic page rank, they're able to use the forces of the search engines against them and create an illusiory page rank.
  
• Decipher Analytics: This spell translates the numbers, graphs and percentages of the analytics portal into real information, when used with the spell behavioral scrying, the potential is limitless.
  
• Invoke Keyword Campaign: The highest level of the keyword spells, the wizard can form a vast chain of keywords that focus on user intent and relevance into a grand unified keyword strategy.
  
• Link Bomb: One of the tools of the black hat wizard, they're able to turn the search engines themselves into weapons. With the link bomb, the wizard can target specific phrases and force their enemy into a negative situation.
  
• Summon Greater Blogger: Like the summon lesser blogger, this allows the wizard to connect with the powers of the other wizards. At this point, there is a low chance of failure since the wizard is able to effectively wield their powers.
  
• Trade Show Teleport: A simple spell in actuality, but powerful in application. The wizard must be at a certain level to understand the concepts and applications of the trade shows.. the added benefit is that the material spell cost is usually paid by someone else.
  
• Create Spell: At this point in the wizard's experience, they're able to see the interaction of all the mystical energies of the search matrix and can create their own spells to see if they work or fail.
  

Level 5 Spells:

• Create Blog: With a vast amount of knowledge and experience, the wizard becomes a lesser blogger. Forging out into the search matrix and sharing ideas and thoughts, the wizard allows other, lesser search wizards to benefit from their knowledge.
  
• Hijack Ranking: One of the deadliest and dangerous spells of the black hats, this spell allows a wizard to take away, without knowledge or consent of the search Gods, the rankings of their competitors and enemies. However, the danger of getting caught and forcing the search gods to change the search energies is high.
  
• Pacify Client: Often times, those who the wizard deals with have unrealistic expectations of the limits of the search wizard. With cool logic and explanations, the wizard is able to charm the client into understanding the basics of the magic of search.
  
• Summon Viral Links: The highest level of link summoning, the wizard invests a small amount of energy and causes thousands of users to create links for them... once summoned, the users pass along and cause other users to link. The duration of this spell widely varies.
  
• Summon Named Blogger: The wizard, at this level is able to connect with and get a link from some of the demi-gods of search, Matt Cutts, Andy Beal or Jeremy Zawodny
  
• Voice of SES: Gaining the voice of SES confirms your status in the search wizarding world. Hundreds and thousands of other wizards come to hear your methods, your insights and your spells. Often thought of as the highest level to attain before you reach demi-god status, the more you become the Voice of SES, there is no limit from where you can go.
  
• Divine Competitor Strategy: The wizard is able to take all the spells, components, tools and scrying methods to divine the strategy of the competition. With this look into the actions of those against you, the wizard is able to create a counter strategy.
  

If you'd like to add to the wizards of search grimorie, just let me know and I'll add them.

Defining Search Metrics: Search Engine Saturation

In my last articles about search engine metrics, I defined search engine presence as "the number of times a site shows across the search engines for a selected set of keywords". Next, I defined, explained and showed an example of search engine fluctuation as "the natural fluctuation of presence of the same selected set of keywords over time".

This time, I want to talk about the two types of search engine saturation. I'd like to defne search engine saturation as essentially "presence over the total data size". In statistics, the data size is represented by the variable "n". If the data size is a dozen eggs, then n=12. The data size of states in the US is n=50. In this case, we're measuring results over three search engines. "SE" = 3. If we included Ask.com in the results, SE would equal 4. However, at this point, we're only measuring 3 search engines, Google, MSN and Yahoo!.

The next part is the total number of results tallied. Since we're measuring the top 15 ranks in Google, the top 10 in MSN and Yahoo!. With this information, we can calculate the total data size for any data capture.

n= (# of keywords) * (15 Google + 10 MSN + 10 Yahoo!).

in this case:

n= (3)*(35) = 105

To calculate the saturation, you divide each presence by "n" to get the percentage of the search engines the site occupies as a function of the entire marketspace.

Domains	SE Presence	SE Presence	SE Saturation	AVG Saturation
www.apple.com	7	17	16.19%	11.43%
www.engadget.com	7	9	8.57%	7.62%
en.wikipedia.org	4	7	6.67%	5.24%
www.gizmodo.com	6	6	5.71%	5.71%
www.appleinsider.com	5	4	3.81%	4.29%
www.mobilewhack.com	5	4	3.81%	4.29%
www.thinksecret.com	7	3	2.86%	4.76%
news.bbc.co.uk	4	3	2.86%	3.33%
www.businessweek.com	3	3	2.86%	2.86%
appleiphone.blogspot.com	0	3	2.86%	1.43%
www.macworld.com	1	3	2.86%	1.90%
www.everythingiphone.com	5	2	1.90%	3.33%
gizmodo.com	4	1	0.95%	2.38%

Apple.com has a presence of 17, and divided by 105, the search engine saturation equals 16.19%, which represents the market share of the marketspace. This number will fluctuate as the results fluctuate. The saturation measurement is useful as a snapshot of the search engine space and a result of your campaign. However, what's really important is the trend of data. You want your presence to rise and you will want your average saturation to rise as well. The average saturation measures the health of the life of the campaign as the raw numbers of the presence fluctuate. In essence, it's a measurement that you can measure and quantify to see if you're doing well, or if you're trending down.

Each of these metrics have value in and of themselves, however, when taken as a whole, they start to give you a clearer picture of the life of the natural search campaign.

Defining Search Metrics: Search Engine Fluctuation

LeeAnn Prescott, the research director for the US markets at Hitwise,
revealed that after Steve Jobs unveiled the iPhone at MacWorld, that the search demand for the iPhone has superceded the search demand for the iPod. It's only a slight coincidence that earlier I defined the concept of "search engine presence" using the example of the iPhone.

That search engine presence measured the top ranking sites, ignoring position, instead focusing on ranking on a variety of terms, that dominate the search engines for a selected sampling of keywords.

Because I was explaining a concept, I chose to use a small sample of keywords that related to a topic that interested me. I used: "iphone, apple iphone, ipod phone". The results were as follows.

	1/10/2007
Domains	SE Presence
www.apple.com	7
www.thinksecret.com	7
www.engadget.com	7
www.gizmodo.com	6
www.appleinsider.com	5
www.mobilewhack.com	5
www.everythingiphone.com	5
gizmodo.com	4
en.wikipedia.org	4
news.bbc.co.uk	4
www.businessweek.com	3

These sites ranked for the preceding terms on 10 Jan. However, for the 4 weeks that ended on 20 Jan, Hitwise compiled the following top sites that had traffic from the term "iPhone".

Apple's sites receive over 50% of the traffic from the iPhone search, however, Engadget, by being one of the most trusted sites on consumer electronics and also having the benefit of ranking well across the board for the searches, received the 4th highest amount of traffic. Hitwise and my search engine presence tool measures two different things, I can only measure presence, Hitwise can measure traffic. While I know that I'm comparing apples to oranges, here's where we see the overlap of traffic and presence.

In the 13 days where I took my first measurements, the search engine marketspace has fluctuated. Supporting the idea that traffic and clickthroughs can influence ranking in the search engines. Notice that Apple and Engadget have a significant upsurge in their presence.

	1/10/2007	1/23/2007
Domains	SE Presence	SE Presence
www.apple.com	7	17
www.engadget.com	7	9
en.wikipedia.org	4	7
www.gizmodo.com	6	6
www.appleinsider.com	5	4
www.mobilewhack.com	5	4
www.thinksecret.com	7	3
news.bbc.co.uk	4	3
www.businessweek.com	3	3
appleiphone.blogspot.com	0	3
www.macworld.com	1	3
www.everythingiphone.com	5	2
gizmodo.com	4	1

We see EverythingiPhone.com, Gizmodo and ThinkSecret.com drop in their presence, we see Wikipedia increase their presence.

As the search for iPhones increase, as they have... that's created the circumstances for the search engines to continually shuffle the results, shuffle the ranks and shuffle the presence. However, what we have strong evidence for here is that ranks change, presence fluctuates and the environment changes. Therefore, it's vital for any company who has a search engine marketing strategy to keep tabs on the environment for their selected keywords and not just on the position or rank of just a few. If you dont notice the change, it's likely that you could be left behind.

While LeeAnn Prescott and I are measuring two different things, traffic vs. presence. The overlapping data as it applies to the search engines often complement each other and provide a larger picture of what's happening.

Thanks LeeAnn, your article was brilliant, informative and I enjoyed reading every bit of it.

Defining Search Metrics: Search Engine Presence

In an earlier post, I mentioned (without explicitly defining) the term of "search engine presence". This came from the dissatisfaction I felt when talking to clients about the health of their search engine optimization/ marketing campaigns. All too often, I would hear the same mantra..."I want to be number 1 for the term X" or "Why aren't I number 1 for the term X?"

This felt inherently wrong to me. However, I couldn't really answer their question, nor could I give them a sure-fire way to attain that position. I sometimes felt that I should be glib and say "If I knew that answer, I'd be working at Google as one of their engineers, right?"

At the same time, everyone who's been in search marketing for more than a week knows that it's best to rank well on a variety of keywords, while remaining true to the core goals of the site. After looking at some WebPosition Gold ranking reports, something struck me as odd about them, they gave the ranking reports, but the data it gave seemed too myopic. This is when I started thinking about "presence" as a metric for measuring the health of the search marketing campaign.

I went to Adam Schultz, and I proposed to him a creation of a simple program that we would later called the Competitive Analysis Baseline Reporting tool. This program would take the core, top level keywords from the client's input... adjusted and perfected by some keyword research and take a look at which sites ranked for those keywords. We wanted to get a good look at the entire search spectrum, so we took the top 15 results in Google, the top 10 in MSN and the top 10 in Yahoo!. This way we would get an overview of what I later called the search engine marketspace. It's a capture of data at a specific time of what the marketspace is.

For a practical example, lets take a few keywords... "iphone, apple iphone, ipod phone" for this example, we don't need a lot of keywords because I'm looking at defining, in a practical sense, "presence".

So, with 3 keywords and (15 Google + 10 MSN + 10 Yahoo) we can expect to have a sample size of 105 potential slots for search engine results to appear. When the same company, like Apple shows up across the search engines and at different positions, their presence is counted as 1. Each presence is counted and sorted for the total presence. In this case, the top 1o results is as follows:

	1/10/2007
Domains	SE Presence
www.apple.com	7
www.thinksecret.com	7
www.engadget.com	7
www.gizmodo.com	6
www.appleinsider.com	5
www.mobilewhack.com	5
www.everythingiphone.com	5
gizmodo.com	4
en.wikipedia.org	4
news.bbc.co.uk	4
www.businessweek.com	3

For those terms, Apple.com shows up in Google, MSN and Yahoo 7 times, as does Thinksecret.com and Engadget.com. Gizmodo shows up 6 times, and so on. The idea here is not to diminish the actual position, or rank of the site, but emphasize the presence in the overall search marketspace. When your company relies on capturing qualified traffic from search, it's obviously better to have several keywords working for you, rather than focusing on only one keyword. Unfortunately, all too often, SEO/ SEM companies attract the client by either telling the prospect what they want to hear, or implying that ranking on their top keyword is paramount to success.

What we see here is a lack of education and a hype of expectations. When the client is properly educated on the strategies of SEO and SEM, they're more likely to abandon the expectation of the single keyword on top hope and adopt a more gestalt view of the search engines as an environment that changes, evolves and fluctuates. Once they see that, they'll recognize the value of having several keywords that work for them and not just one.