Migrate Production Crawlers to CD Azure

# What

Production crawlers are hosted in a Microsoft Azure subscription. Only MSFT staff with have access.
Without access to the Crawlers in azure we cannot

- Stop and start crawlers
- Scale instances of app services up and down
- See metrics on CPU and memory
- Configure env vars and secrets

# What has been done

We have experimented by deploying one crawler into CD prod https://github.com/clearlydefined/crawler/pull/608
That crawler is currently off.
As it's on same App Service plan as the API and Web site it caused resource contention

# What we need to do before we can redeploy

Decide if App Services are suitable for the crawler
If so we would need to provision new App Service plans in CD Azure and deploy the crawler to that.