/* Code Comments */1 post tagged with "webcrawlers"
robots.txt vs meta tags
2022-11-28
|~4 min read
|648 words
We recently discovered that our file wasn’t configured properly and pages we were expecting to be excluded from search engines. In…
2022-11-28
|~4 min read
|648 words
We recently discovered that our file wasn’t configured properly and pages we were expecting to be excluded from search engines. In…