googleapis / googleapis/google-cloud-java

GraalVM aiplatform IT : Insufficient memory

未关闭
#11,120 0 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看
priority: p2 type: process
主要语言
Java
星标
2.1k
派生
1.2k
平均合并
1 天 23 小时
30 天内合并 PR
157

描述

https://btx.cloud.google.com/invocations/e8c43278-6979-4dd2-b109-ab626e94e244/targets/cloud-devrel%2Fclient-libraries%2Fjava%2Fgoogle-cloud-java%2Fnightly%2Fgraalvm-sub-jobs%2Fnative-a%2Fgraalvm-native-5;config=default/log

```
------------------------------------------------------------------------------------------------------------------------
1 experimental option(s) unlocked:
- '-H:ReflectionConfigurationResources' (origin(s): 'META-INF/native-image/io.grpc.netty.shaded.io.netty/netty-transport/native-image.properties' in 'file:///root/.m2/repository/io/grpc/grpc-netty-shaded/1.66.0/grpc-netty-shaded-1.66.0.jar')
------------------------------------------------------------------------------------------------------------------------
Build resources:
- 11.09GB of memory (75.6% of 14.68GB system memory, determined at start)
- 4 thread(s) (100.0% of 4 available processor(s), determined at start)
Sep 07, 2024 7:19:53 AM com.google.api.gax.nativeimage.NativeImageUtils registerClassForReflection
WARNING: Failed to find io.grpc.netty.shaded.io.netty.channel.ProtocolNegotiators on the classpath for reflection.
[junit-platform-native] Running in 'test listener' mode using files matching pattern [junit-platform-unique-ids*] found in folder [/tmpfs/src/github/google-cloud-java/java-aiplatform/google-cloud-aiplatform/target/test-ids] and its subfolders.
[2/8] Performing analysis... [*****] (271.7s @ 5.27GB)
29,416 reachable types (92.3% of 31,884 total)
68,889 reachable fields (68.6% of 100,475 total)
466,486 reachable methods (80.1% of 582,163 total)
16,517 types, 2,025 fields, and 331,842 methods registered for reflection
79 types, 82 fields, and 62 methods registered for JNI access
4 native libraries: dl, pthread, rt, z
[3/8] Building universe... (47.1s @ 5.46GB)
[4/8] Parsing methods... [*****] (29.0s @ 6.55GB)
[5/8] Inlining methods... [***] (17.5s @ 5.70GB)
[6/8] Compiling methods... [**************] (219.0s @ 5.45GB)
OpenJDK 64-Bit Server VM warning: INFO: os::commit_memory(0x0000000609a00000, 1508376576, 0) failed; error='Not enough space' (errno=12)
#
# There is insufficient memory for the Java Runtime Environment to continue.
# Native memory allocation (mmap) failed to map 1508376576 bytes for committing reserved memory.
# An error report file with more information is saved as:
# /tmpfs/src/github/google-cloud-java/hs_err_pid5880.log
```

贡献指南

打开贡献指南

调研方向

从链接的 GraalVM aiplatform nightly native-a 作业及其失败日志入手,重点关注 JVM 内存耗尽的 native-image 编译阶段。确定此 IT 作业为何超出可用内存,然后验证同一作业能够在不发生内存不足失败的情况下完成。

由索引模型根据 Issue 内容生成。

评估

技术栈
gcp, java
领域
build-system, ci-cd
Issue 类型
缺陷
难度
4/5
预计耗时
3-5 天
活跃度
停滞
描述清晰度
需要澄清
新手友好度
30/100

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。