Technology Blog
  • Tutorials
    • Github
    • MAMP
    • Twitter
    • Mac
    • SEO
  • Laravel
  • Web Design
  • Technology News
  • Random
Technology Blog
  • Tutorials
    • Github
    • MAMP
    • Twitter
    • Mac
    • SEO
  • Laravel
  • Web Design
  • Technology News
  • Random

Tag Archives: robots.txt

19 Jan

How to create a Robots.txt file ?

  • Share via Facebook 
  • Share via Google 
  • Share via Twitter 
  • Share via LinkedIn 

what is robots.txt?

Robot Exclusion Standard Protocol or Robots.txt is a text file which is placed at the root of website. The standard was proposed by Martijn Koster in 1994. The main aim of robots.txt file is to tell web crawler or robots to index or not index a website/webpage.
Read More →

Abhay Singh Posted in SEO, Tutorials robots.txt, seo 1 Comment

Post navigation

Recent Posts

  • 7 tech tricks/skills that you can learn right now in 10 minutes
  • Create Custom Error Pages in Laravel 5
  • How to add custom class in Laravel 5
  • Commonly used Helper functions – Laravel 5
  • Disable CSRF Check on Specific Routes in Laravel 5
All rights reserved. The content is copyrighted to Techigniter.in
Contact | Terms of service | Privacy Policy
↑