Web related issues such as design, programming, search engine optimisation, database, revenue generation, streaming. This is also my area to give back to the internet community that has given me so much.
It is not sexy but it useful. The robots.txt is suppose to tell robots/bots/crawlers where they can crawl on a web site. The robots.txt mus...