aws / aws/containers-roadmap

[ECS] [request]: Support `awslogs-format` option for `logConfiguration.options`

Open
#1,719 3 comments 10 reactions 0 assignees View on GitHub
ECS Proposed
Dominant language
Shell
Stars
5.4k
Forks
334
PR merge metrics
No merged PRs in 30d

Description

### Community Note

* Please vote on this issue by adding a 👍 [reaction](https://blog.github.com/2016-03-10-add-reactions-to-pull-requests-issues-and-comments/) to the original issue to help the community and maintainers prioritize this request
* Please do not leave "+1" or "me too" comments, they generate extra noise for issue followers and do not help prioritize the request
* If you are interested in working on this issue or have submitted a pull request, please leave a comment

**Tell us about your request**
Add `awslogs-format` in `logConfiguration.options` of TaskDefinition (ContainerDefinition).

**Which service(s) is this request for?**
ECS

**Tell us about the problem you're trying to solve. What are you trying to do, and why is it hard?**
Amazon CloudWatch Logs has a feature called EMF which enables the customers to emit a structured log entry and let CWL parse and emit CloudWatch Metrics on behalf of the customers. https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/CloudWatch_Embedded_Metric_Format.html

Recently, Docker merged a new feature to support EMF with `awslogs` logging driver (https://github.com/moby/moby/pull/42838) by using `awslogs-format` option. See also the original issue https://github.com/moby/moby/issues/42731

Now, I think ECS is ready to take this feature and allows the customers to opt-in this feature so that the customers can use EMF feature very easily without any additional infrastructure. They just need to emit the structured json to STDOUT/STDERR!

I couldn't find this option in the ECS doc https://docs.aws.amazon.com/AmazonECS/latest/developerguide/using_awslogs.html#create_awslogs_logdriver_options If you have already supported, please update the document. Otherwise, this request :)

**Are you currently working around this issue?**
Giving up to use EMF and just logging JSON. This is still helpful because CloudWatch Logs Insights can visualize but EMF is preferred to monitor.

**Additional context**
N/A

**Attachments**
N/A

Contributor guide

Open the contributing guide

Research direction

Start by reviewing the ECS TaskDefinition ContainerDefinition logConfiguration options and the linked Docker awslogs-format change. Confirm whether ECS already supports the option; if not, the request is complete when ECS accepts it and the AWS ECS awslogs documentation describes its use.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, docker
Domain
cloud, observability-sre
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.