How To Control Website Crawlers What You Want To Show to Them??
2014-06-28, 08:46 PM,
#1
How To Control Website Crawlers What You Want To Show to Them?? like in facebook debug tool they can see all the contents of your website but i only want to limit what i want to show to their crawler .. is this possible??
Reply
Share This Thread :
2014-06-28, 08:48 PM, (This post was last modified: 2014-06-28, 08:48 PM by BlackHatSEO.)
#2
The official way would be tags like "nofollow" and "noindex". And of course the famous "robots.txt" file. Please have a look into the Google Webmaster Tools, too.

The inofficial way would be cloaking.

This place is intentionally left blank.
Reply
2014-06-28, 08:58 PM, (This post was last modified: 2014-06-28, 08:58 PM by skyfinity.)
#3
i got brads cpa 5 redirector would that work ?? if my site is not a wp ?
Reply


Related Threads
Thread Author Replies Views Last Post
  [ASK] Movie Streaming Website Script sonpink 19 4,356 2018-02-15, 05:21 PM
Last Post: mineshparikh
  Website help, would like some help from a coder Elk 13 423 2018-02-04, 11:04 AM
Last Post: rinaldohack
  Why people don't put website url in youtube description (BH Niches) akimo10 8 478 2018-01-26, 08:56 PM
Last Post: tamnga
  Do you guys show surveys in your videos? OvRey 4 278 2018-01-19, 08:50 PM
Last Post: zamnajali
  How can I track my website? CriticSay 4 248 2018-01-09, 09:14 PM
Last Post: iBrobot





About Us | Contact Us | CPA Elites | Advertise | Stats | Staff Team

© 2013-2018 CPA Elites Ltd
Enhanced by MyBB and WallBB
Return to top