ng add @angular/seo

_From @IgorMinar on April 18, 2018 10:7_

### Bug Report or Feature Request (mark with an `x`)
```
- [ ] bug report -> please search issues before submitting
- [x] feature request
```

### Area
```
- [ ] devkit
- [x] schematics
```

### Versions
v6

### Desired functionality
I'd like to be able to invoke `ng add @angular/seo` and have the CLI make my application search engine friendly. Initially I'd like to see the following feature provided by the schematics:

- generate robots.txt with no rules but a simple instructions/link on how to setup blacklist rules
- generate sitemap.xml with similar documentation/links as in robots.txt
- add code that would feature detect and conditionally load polyfills needed by the crawlers
- setup error logging via global error handler with an option to redirect the output to a remote server
- provide facilities to easily add and remove the `noindex` metadata to emulate the HTTP 404 and 500 status codes

### Mention any other details that might be useful

_Copied from original issue: angular/devkit#729_

Start by reviewing the Angular CLI schematics area and the `ng add` flow described in the issue. Break the request into the listed SEO features—robots.txt, sitemap.xml, crawler polyfills, error logging, and noindex handling—and clarify scope and acceptance criteria before changing anything; no files or tests are named.

Written by the indexing model from the issue text.