googleapis / googleapis/google-cloud-java
GraalVM aiplatform IT : Insufficient memory
- 主要语言
- Java
- 星标
- 2.1k
- 派生
- 1.2k
- 平均合并
- 1 天 23 小时
- 30 天内合并 PR
- 157
描述
https://btx.cloud.google.com/invocations/e8c43278-6979-4dd2-b109-ab626e94e244/targets/cloud-devrel%2Fclient-libraries%2Fjava%2Fgoogle-cloud-java%2Fnightly%2Fgraalvm-sub-jobs%2Fnative-a%2Fgraalvm-native-5;config=default/log
```
------------------------------------------------------------------------------------------------------------------------
1 experimental option(s) unlocked:
- '-H:ReflectionConfigurationResources' (origin(s): 'META-INF/native-image/io.grpc.netty.shaded.io.netty/netty-transport/native-image.properties' in 'file:///root/.m2/repository/io/grpc/grpc-netty-shaded/1.66.0/grpc-netty-shaded-1.66.0.jar')
------------------------------------------------------------------------------------------------------------------------
Build resources:
- 11.09GB of memory (75.6% of 14.68GB system memory, determined at start)
- 4 thread(s) (100.0% of 4 available processor(s), determined at start)
Sep 07, 2024 7:19:53 AM com.google.api.gax.nativeimage.NativeImageUtils registerClassForReflection
WARNING: Failed to find io.grpc.netty.shaded.io.netty.channel.ProtocolNegotiators on the classpath for reflection.
[junit-platform-native] Running in 'test listener' mode using files matching pattern [junit-platform-unique-ids*] found in folder [/tmpfs/src/github/google-cloud-java/java-aiplatform/google-cloud-aiplatform/target/test-ids] and its subfolders.
[2/8] Performing analysis... [*****] (271.7s @ 5.27GB)
29,416 reachable types (92.3% of 31,884 total)
68,889 reachable fields (68.6% of 100,475 total)
466,486 reachable methods (80.1% of 582,163 total)
16,517 types, 2,025 fields, and 331,842 methods registered for reflection
79 types, 82 fields, and 62 methods registered for JNI access
4 native libraries: dl, pthread, rt, z
[3/8] Building universe... (47.1s @ 5.46GB)
[4/8] Parsing methods... [*****] (29.0s @ 6.55GB)
[5/8] Inlining methods... [***] (17.5s @ 5.70GB)
[6/8] Compiling methods... [**************] (219.0s @ 5.45GB)
OpenJDK 64-Bit Server VM warning: INFO: os::commit_memory(0x0000000609a00000, 1508376576, 0) failed; error='Not enough space' (errno=12)
#
# There is insufficient memory for the Java Runtime Environment to continue.
# Native memory allocation (mmap) failed to map 1508376576 bytes for committing reserved memory.
# An error report file with more information is saved as:
# /tmpfs/src/github/google-cloud-java/hs_err_pid5880.log
```
贡献指南
调研方向
从链接的 GraalVM aiplatform nightly native-a 作业及其失败日志入手,重点关注 JVM 内存耗尽的 native-image 编译阶段。确定此 IT 作业为何超出可用内存,然后验证同一作业能够在不发生内存不足失败的情况下完成。
由索引模型根据 Issue 内容生成。
评估
- 技术栈
- gcp, java
- 领域
- build-system, ci-cd
- Issue 类型
- 缺陷
- 难度
- 4/5
- 预计耗时
- 3-5 天
- 活跃度
- 停滞
- 描述清晰度
- 需要澄清
- 新手友好度
- 30/100