And on the 12th day, Google said let their be spiders
For some reason, The Simpsons comes to mind when thinking about the 12 day since purchasing this domain. I’m picturing Bart and Lisa knocking on Burns’ giant mansion door and upon seeing kids after opening the door, Burns yells “Release the spiders!” Yep, instead of the hounds being released it appears as though Google has released the spiders. Well, to be accurate it’s not just Google. I’m getting a few. Here are my top 10.
| Visits | |
|---|---|
| 362 |
49.5%
|
| 92 |
12.6%
|
| 54 |
7.4%
|
| 43 |
5.9%
|
| 26 |
3.6%
|
| 23 |
3.1%
|
| 23 |
3.1%
|
| 20 |
2.7%
|
| 20 |
2.7%
|
| 14 |
1.9%
|
On the 12th day, it seems I did something that really got them paying attention to this website. I’ll have to figure it out and keep you all updated. It may just be natural. Either way, spiders visits went from 5 to 96 and then to 238. In the past 5 days the site had anywhere between 10 and 40 unique visitors. Personally, I’m more happy about the dramatic increase in spiders because those directly lead to getting your page ranked.
Spiders, bots, webcrawlers, etc.. are essentially programs that go through massive amounts of websites and keep track of the information on them. So Google’s spider is going to crawl around and visit my site and go to each of the pages it can find and read all the content as well as the meta tags for the page it located. It takes the list of the important words I defined in my meta tags (using wordpress all-in-one seo) as well as the title of the page and compares it to the content. Then the Google bot analyzes the data and stores it in it’s database.
Eventually, when Google trusts my site enough, it will begin to show each one of my pages in it’s search results. Where I’m positioned in Google’s results is determined by many different factors and I’m sure I’ll get into that later. Since Google’s method for ranking is proprietary and only known by them, we have to get as much knowledge as possible on how they work. Google talks about it to the public and the general idea of what to do and how to do it is pretty much known.
Not all spiders are used to index your blog pages on search engines. Some are used to collect email addresses for spam. Some are used to determine if you have any copywrited content on your page. Some are used to gather your content and then publish them on their own websites. Some are used to scan for security vulnerabilities on your website.
This is why it’s important to have some sort of tool for your blog that allows you to analyze the traffic and the spiders that visit your website. I use statpress for wordpress to quickly analyze the traffic. I also have various other stat tools including one from my web host. Analyzing your traffic is important for many different reasons, the above is just one of them.
If you are using Google Adsense, one of the spiders that will visit your site will be used to determine what your blog is about in order to display relevant advertisements on your page.
Overall, the presence of an increase in spiders is important because it means your site is getting out there. It means that your internet presence is increasing and various search engines are aware of your site and are going to rank it in searches.
An increase in spiders directly leads to an increase in traffic.
Tags: Bots, google, SEO, Spiders, traffic
