Indexing pages and getting rank problems

Last night I heard a complain that Google isn’t indexing a web-page. That guy even wondered if he had been banned for some reason.

To understand what’s the problem we asked a few questions, got his website name and had a look at it.

What we got from his answers:

  1. Website is very new: only a few days on the net.
  2. He had verified it using Google Webmaster Tools
  3. It’s URL was added to Google: How to add a link to google
  4. His robot file was

user agent: *
allow: /

So, for starters: his website was new, did not have inbound links to it, thus, it was untrustworthy from Google point of view. Page will get more trust and get indexed  too, it just takes more time. Second and third knowledge point let us understand that Google is aware is this page and will visit it sooner or later.

Now forth point: Yes, Google understands it, but still, it’s better to change the robot file to:

User-agent: *
Disallow:
It’s universal syntax: all spiders must understand it. And, it would be good to add your sitemap too, like:
Sitemap: <path to your sitemap>/sitemap.xml
It makes the spiders job easier (Note: you must keep your sitemap updated at all times).

Next: What we found out using his website name:

  • It was not banned, we could see it using Google search:

info:<your websitename here>

  • From SEO point of view: it needed much improvement – This is what Google spider saw:

** PLEASE DESCRIBE THIS IMAGE **
** PLEASE DESCRIBE THIS IMAGE **
** PLEASE DESCRIBE THIS IMAGE **
** PLEASE DESCRIBE THIS IMAGE **
** PLEASE DESCRIBE THIS IMAGE **

Now, I won’t go into SEO details here, but one thing all of us should remember: Check your page with text browsers. If you can see all information while doing so, so will search engines.

So, the page is not banned, it will get indexed, but, following SEO guidelines: Google Webmaster guidelines for example, would return greater gain to your PageRank.

Remember: If you create good reputation and content for your site it will prosper, but: if you follow SEO guidelines too, you will prosper even more – if people can’t find you, they can’t help you prosper.

Some helpfull websites: