Host Speech Sponsors

+ Reply to Thread
Results 1 to 5 of 5
  1. #1

    Where robots.txt file uploaded to hosting directory?

    Hello friends,

    Where robots.txt file uploaded to hosting directory?

  2. #2
    Host Speech Heart
    Join Date
    Oct 2016
    Posts
    633
    First you have to create RObots.txt file after that upload file,some following steps are used to upload the file:

    1. Creating Robots.txt
    Step 1: Open a simple text editor, such as TextEditor or Notepad. Name the file robots.txt
    and select the location where you want the file to be saved.
    Step 2: Start the file with the first line. User-agent line specifies directions to all or a specific search bot.
    Step 3: Decide what folders and files you don’t want to get indexed.
    2. Installing Robots.txt with CPanel:
    Step 1: Access your cPanel File Manager and choose the main site directory.
    Then, simply click on “Upload” button and upload your robots.txt file.
    Step 2: Go back to the cPanel File Manager.
    Go back to the main site directory and you will notice that your robots.txt file has been uploaded.

  3. #3
    Host Speech Heart
    Join Date
    Feb 2017
    Location
    Forum
    Posts
    694
    Robots.txt is a text file that lists webpages which contain instructions for search engines robots. The file lists webpages that are allowed and disallowed from search engine crawling.
    Cheap VPS Hosting | $1 VPS Hosting
    Cheap Windows VPS | Windows with Remote Desktop
    Cheap Dedicated Servers | Free IPMI | Unmetered Bandwidth

  4. #4
    Super Noob
    Join Date
    Nov 2017
    Location
    Bangalore
    Posts
    5
    Robots.txt is a text (not html) file you put on your site to tell search robots which pages you would like them not to visit.
    Robots.txt is by no means mandatory for search engines but generally search engines obey what they are asked not to do.
    It is important to clarify that robots.txt is not a way from preventing search engines from crawling your site

  5. #5


 

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts