influxdata / influxdata/docs-v2

Upper limits for running and managing tasks

Open
#4,365 0 comments 0 reactions 0 assignees View on GitHub
good-first-issue
Dominant language
JavaScript
Stars
82
Forks
326
Avg merge
1d 1h
Merged PRs (30d)
82

Description

Document advisory for running and managing lots of tasks.

From a recent [Slack thread](https://influxdata.slack.com/archives/C89G3JD2R/p1659467670567709):

Are there any guidelines on an upper limit of tasks that you can run in Cloud?

6 replies

- For cloud at least, we have customers with 10,000's of tasks, the problem is usually they run into timeout limits for task execution, so somewhat short tasks you can run a ton of

- There is also a query duration limit - number of minutes of execution time that a single customer can use in a window. (I make a distinction between this limit and “timeouts”)

- You will also have a hard time using the UI to manage them effectively if you have many thousands (customers with those numbers use some automation against the API to create and update them, generally)

- Re the aggregate time limits Phil mentioned, using the offset setting can be helpful to spread tasks out a bit if a customer hits those limits

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the linked Slack thread, then identify where task limits and task-management guidance belong in the documentation. Done means an advisory covering task volume, execution timeouts, aggregate query-duration limits, UI and API management at scale, and using offsets to spread execution.

Written by the indexing model from the issue text.

Assessment

Domain
cloud, documentation
Issue type
Documentation
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.