containers / containers/podman-compose

Could not get JVM parameters and dynamic configurations properly

Open
#793 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
6.2k
Forks
622
PR merge metrics
No merged PRs in 30d

Description

### Issue Description

https://github.com/apache/flink-playgrounds/tree/master/table-walkthrough

```bash
podman-compose build
podman-compose up -d
```

both jobmanager or taskmanager get error
```
Could not get JVM parameters and dynamic configurations properly
```

docker-compose is ok

refer to https://nightlies.apache.org/flink/flink-docs-release-1.17/docs/try-flink/table_api/#once-more-with-streaming

### Steps to reproduce the issue

Steps to reproduce the issue
1. clone project, https://github.com/apache/flink-playgrounds
2. cd table-walkthrough
3. run services
```bash
podman-compose build
podman-compose up -d
```

### Describe the results you received

```
Starting Task Manager
[ERROR] The execution result is empty.
[ERROR] Could not get JVM parameters and dynamic configurations properly.
[ERROR] Raw output from BashJavaUtils
```

### Describe the results you expected

```
table-walkthrough-taskmanager-1 | Starting Task Manager
table-walkthrough-taskmanager-1 | Starting taskexecutor as a console application on host 8568d3c8e7bc.
table-walkthrough-taskmanager-1 | 2023-10-18 16:00:12,852 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner [] - --------------------------------------------------------------------------------
table-walkthrough-taskmanager-1 | 2023-10-18 16:00:12,862 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner [] - Preconfiguration:
table-walkthrough-taskmanager-1 | 2023-10-18 16:00:12,863 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner [] -
table-walkthrough-taskmanager-1 |
table-walkthrough-taskmanager-1 |
table-walkthrough-taskmanager-1 | RESOURCE_PARAMS extraction logs:
table-walkthrough-taskmanager-1 | jvm_params: -Xmx536870902 -Xms536870902 -XX:MaxDirectMemorySize=268435458 -XX:MaxMetaspaceSize=268435456
table-walkthrough-taskmanager-1 | dynamic_configs: -D taskmanager.memory.network.min=134217730b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.off-heap.size=0b -D taskmanager.memory.jvm-metaspace.size=268435456b -D external-resources=none -D taskmanager.memory.jvm-overhead.min=201326592b -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=134217730b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=536870920b -D taskmanager.memory.task.heap.size=402653174b -D taskmanager.numberOfTaskSlots=1 -D taskmanager.memory.jvm-overhead.max=201326592b
```

### podman info output

```yaml
host:
arch: arm64
buildahVersion: 1.32.0
cgroupControllers:
- cpu
- io
- memory
- pids
cgroupManager: systemd
cgroupVersion: v2
conmon:
package: conmon-2.1.7-2.fc38.aarch64
path: /usr/bin/conmon
version: 'conmon version 2.1.7, commit: '
cpuUtilization:
idlePercent: 90.87
systemPercent: 6.53
userPercent: 2.61
cpus: 4
databaseBackend: boltdb
distribution:
distribution: fedora
variant: coreos
version: "38"
eventLogger: journald
freeLocks: 2031
hostname: localhost.localdomain
idMappings:
gidmap:
- container_id: 0
host_id: 1000
size: 1
- container_id: 1
host_id: 100000
size: 1000000
uidmap:
- container_id: 0
host_id: 502
size: 1
- container_id: 1
host_id: 100000
size: 1000000
kernel: 6.5.5-200.fc38.aarch64
linkmode: dynamic
logDriver: journald
memFree: 7869845504
memTotal: 8299720704
networkBackend: netavark
networkBackendInfo:
backend: netavark
dns:
package: aardvark-dns-1.7.0-1.fc38.aarch64
path: /usr/libexec/podman/aardvark-dns
version: aardvark-dns 1.7.0
package: netavark-1.7.0-1.fc38.aarch64
path: /usr/libexec/podman/netavark
version: netavark 1.7.0
ociRuntime:
name: crun
package: crun-1.9.2-1.fc38.aarch64
path: /usr/bin/crun
version: |-
crun version 1.9.2
commit: 35274d346d2e9ffeacb22cc11590b0266a23d634
rundir: /run/user/502/crun
spec: 1.0.0
+SYSTEMD +SELINUX +APPARMOR +CAP +SECCOMP +EBPF +CRIU +LIBKRUN +WASM:wasmedge +YAJL
os: linux
pasta:
executable: /usr/bin/pasta
package: passt-0^20230908.g05627dc-1.fc38.aarch64
version: |
pasta 0^20230908.g05627dc-1.fc38.aarch64-pasta
Copyright Red Hat
GNU General Public License, version 2 or later

This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
remoteSocket:
exists: true
path: /run/user/502/podman/podman.sock
security:
apparmorEnabled: false
capabilities: CAP_CHOWN,CAP_DAC_OVERRIDE,CAP_FOWNER,CAP_FSETID,CAP_KILL,CAP_NET_BIND_SERVICE,CAP_SETFCAP,CAP_SETGID,CAP_SETPCAP,CAP_SETUID,CAP_SYS_CHROOT
rootless: true
seccompEnabled: true
seccompProfilePath: /usr/share/containers/seccomp.json
selinuxEnabled: true
serviceIsRemote: true
slirp4netns:
executable: /usr/bin/slirp4netns
package: slirp4netns-1.2.1-1.fc38.aarch64
version: |-
slirp4netns version 1.2.1
commit: 09e31e92fa3d2a1d3ca261adaeb012c8d75a8194
libslirp: 4.7.0
SLIRP_CONFIG_VERSION_MAX: 4
libseccomp: 2.5.3
swapFree: 0
swapTotal: 0
uptime: 0h 0m 22.00s
plugins:
authorization: null
log:
- k8s-file
- none
- passthrough
- journald
network:
- bridge
- macvlan
- ipvlan
volume:
- local
registries:
search:
- docker.io
store:
configFile: /var/home/core/.config/containers/storage.conf
containerStore:
number: 0
paused: 0
running: 0
stopped: 0
graphDriverName: overlay
graphOptions: {}
graphRoot: /var/home/core/.local/share/containers/storage
graphRootAllocated: 106769133568
graphRootUsed: 7772422144
graphStatus:
Backing Filesystem: xfs
Native Overlay Diff: "true"
Supports d_type: "true"
Supports shifting: "false"
Supports volatile: "true"
Using metacopy: "false"
imageCopyTmpDir: /var/tmp
imageStore:
number: 19
runRoot: /run/user/502/containers
transientStore: false
volumePath: /var/home/core/.local/share/containers/storage/volumes
version:
APIVersion: 4.7.0
Built: 1695839065
BuiltTime: Thu Sep 28 02:24:25 2023
GitCommit: ""
GoVersion: go1.20.8
Os: linux
OsArch: linux/arm64
Version: 4.7.0
```

### Podman in a container

No

### Privileged Or Rootless

None

### Upstream Latest Release

Yes

### Additional environment details

macOS Ventura 13.5.1

Apple M1 Pro

### Additional information

Additional information like issue happens only occasionally or issue happens with a particular architecture or on a particular setting

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.