ADF queries_ResourceGraph_ExecuteQuery only fetches first 1000 results

🐛 Problem

When fetching resource graph queries with more than 1000 results it would only fetch 1000 results. For example the src/templates/finops-hub/modules/Microsoft.FinOpsHubs/Recommendations/queries/Recommendations-Microsoft-AdvisorCost.json could return more then 1000 results.

Change should happen in src/templates/finops-hub/modules/Microsoft.FinOpsHubs/AzureResourceGraph/app.bicep

👣 Repro steps

TODO: Add repro steps below:

1. add recommandation for the finops hub
2. execute the pipeline queries_ExecuteETL in ADF
3. check how many results end up in ingestion recommendation blob storage
4. would give you 1000 rows back.

🤔 Expected

return all records back.

📷 Screenshots

TODO: If applicable, add screenshots to help explain your problem. Remove if not applicable.

🔧 Environment

• FinOps hub version: 14
• Billing account type: MCA (Microsoft Customer Agreement)
• Power BI report type: Storage-based / ADX (Azure Data Explorer)
• Cost Management export: FOCUS 1.2-preview

ℹ️ Additional context

TODO: Add any other context about the problem here. Remove if not applicable.

🙋‍♀️ Ask for the community

We could use your help:

1. Please vote this issue up (👍) to prioritize it.
2. Leave comments to help us solidify the vision.