googleapis / googleapis/python-aiplatform

401 Client Error trying to capture Profile using Vertex AI Tensorboard

Đang mở
#3,913 1 bình luận 0 reaction 1 người được giao Được @lakeyk nhận Xem trên GitHub
api: vertex-ai
Ngôn ngữ chính
Python
Star
905
Fork
465
Merge trung bình
1 ngày 13 giờ
Pull request đã merge (30 ngày)
44

Mô tả

I am trying to use Vertex AI Tensorflow Profiler to profile my custom training job based on this [documentation](https://cloud.google.com/vertex-ai/docs/training/tensorboard-profiler).

My custom job runs successfully to completion, but I am unable to successfully capture a Profile in Vertex AI Tensorboard despite following the steps in the ["Capture a profiling session"](https://cloud.google.com/vertex-ai/docs/training/tensorboard-profiler#capture-session) section of the documentation.

When I click "Capture" in the Profile section on Vertex AI Tensorboard after following these above steps, I receive an error which looks like:

> **Failed to capture profile: 401 Client Error: Unauthorized for url: https://...-dot-europe-west4.aiplatform-training.googleusercontent.com/profile/capture_profile?service_addr=workerpool0-0&is_tpu_name=false&duration=1000&num_retry=3&worker_list=&host_tracer_level=2&device_tracer_level=1&python_tracer_level=0&delay=0 Invalid OAuth Token . For information on how to setup the profiler, please visit: https://cloud.google.com/vertex-ai/docs/experiments/tensorboard-profiler**

The documentation linked above references the **roles/storage.admin** and **roles/aiplatform.user** service account roles. Both my own service account and the service account used to run the custom training job have both of these roles.

Are there additional permissions required in order to successfully capture a profiling session? Any help/advice on solving this issue would be greatly appreciated!

#### Environment details
- `google-cloud-aiplatform` version: google-cloud-aiplatform[cloud_profiler]==1.52.0

Hướng dẫn đóng góp

Mở hướng dẫn đóng góp

Đánh giá

Issue này chưa được đánh giá.

Nhận issue mới trong hộp thư của bạn

Bản tóm tắt ngắn những issue GitHub phù hợp với người mới.