Change: Changed robots.txt to stop the indexing of certain folders.
Change: When the system detects a file not found in certain folders it is immediately returned with the error.