I found this robots.txt file tutorial helpful. I’m running WP for two friends who want to use it to keep their students informed, yet private from the world. Disable all the pingback and trackback settings, and utilize the robots.txt file to accomplish this. Also, for my site, I’ll use it so Google doesn’t index any images I have.
Bryan is a Trust & Safety Wrangler at Automattic. He's also a photographer, card magician, and cat whisperer. (Thanks to my friend and colleague Steve Blythe for the sweet photo!) View all posts by Bryan Villarin