Posts

Showing posts from 2015

How Google treats "allow" field in robots.txt

Image
What is mean by Robots.txt: robots.txt is set of instructions for blocking the particular pages, folder, images, etc... Also, we can block the particular search engines by using robots.txt. like, Google, Bing, Yahoo, etc.

Allowing all the search engines and accessing all the files.

User-agent: *
Disallow:

Disallowing all the search engines and not accessible all the files.
User-agent: *
Disallow: /

if we need to exclude all the files except few files, what we could do.
we have to use the disallow command for all the files, which need to be excluded. either files can be accessible by the search engines. Check the robotstxt.org advice here.
To exclude all files except one
This is currently a bit awkward, as there is no "Allow" field. The easy way is to put all files to be disallowed into a separate directory, say "stuff", and leave the one file in the level above this directory: User-agent: * Disallow: /~joe/stuff/
REF: http://www.robotstxt.org/robotstxt.html
As per Google:To excl…

PageRank is still considerable?

What is mean by Pagrank: Pagerank equation is based on site backlinks(authority). If we are going to link someone, like

website A -> links -> website B

website A rank juice(authority) will flow to website B. So many people used this methodology to gain rank in shorter period.

PageRank Negatives: Yes, it's lead to link farms, link exchanges, and paid links. People still believe about pagrank and doing some bad techniques to earn pagerank such as called link schemes. But now Google alerted about Pagerank and they have changed their algorithm to clean the spam websites in search results. For avoiding this kind of pagerank manipulation, Google invented "Penguin" Algorithm.

Which helpful to prevent,

1. Low quality links
2. Over optimized anchor texts
3. Keywords stuffing

Pagerank is dead: Yes finally Google(John Muller) announced  on 06 Oct 2014.

Ref: https://www.youtube.com/watch?v=-GlxLlpm3Ew#t=1230

But still so many people are believe about Pagerank and keep posting ab…