With Azure Blob Storage, I always get "No dashboards... | tensorflow/tensorboard

Environment information (required)

Diagnostics

Diagnostics output

--- check: autoidentify
INFO: diagnose_tensorboard.py version e43767ef2b648d0d5d57c00f38ccbd38390e38da

--- check: general
INFO: sys.version_info: sys.version_info(major=3, minor=8, micro=10, releaselevel='final', serial=0)
INFO: os.name: posix
INFO: os.uname(): posix.uname_result(sysname='Linux', nodename='a601721015eb', release='5.4.0-74-generic', version='#83-Ubuntu SMP Sat May 8 02:35:39 UTC 2021', machine='x86_64')
INFO: sys.getwindowsversion(): N/A

--- check: package_management
INFO: has conda-meta: False
INFO: $VIRTUAL_ENV: None

--- check: installed_packages
INFO: installed: tensorboard==2.8.0
WARNING: no installation among: ['tensorflow', 'tensorflow-gpu', 'tf-nightly', 'tf-nightly-2.0-preview', 'tf-nightly-gpu', 'tf-nightly-gpu-2.0-preview']
INFO: installed: tf-estimator-nightly==2.8.0.dev2021122109
INFO: installed: tensorboard-data-server==0.6.1

--- check: tensorboard_python_version
INFO: tensorboard.version.VERSION: '2.8.0'

--- check: tensorflow_python_version
INFO: tensorflow.__version__: '2.8.0'
INFO: tensorflow.__git_version__: 'v2.8.0-rc1-32-g3f878cff5b6'

--- check: tensorboard_data_server_version
INFO: data server binary: '/usr/local/lib/python3.8/dist-packages/tensorboard_data_server/bin/server'
INFO: data server binary version: b'rustboard 0.6.1'

--- check: tensorboard_binary_path
INFO: which tensorboard: b'/usr/local/bin/tensorboard\n'

--- check: addrinfos
socket.has_ipv6 = True
socket.AF_UNSPEC = <AddressFamily.AF_UNSPEC: 0>
socket.SOCK_STREAM = <SocketKind.SOCK_STREAM: 1>
socket.AI_ADDRCONFIG = <AddressInfo.AI_ADDRCONFIG: 32>
socket.AI_PASSIVE = <AddressInfo.AI_PASSIVE: 1>
Loopback flags: <AddressInfo.AI_ADDRCONFIG: 32>
Loopback infos: [(<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 0))]
Wildcard flags: <AddressInfo.AI_PASSIVE: 1>
Wildcard infos: [(<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('0.0.0.0', 0)), (<AddressFamily.AF_INET6: 10>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('::', 0, 0, 0))]

--- check: readable_fqdn
INFO: socket.getfqdn(): 'a601721015eb'

--- check: stat_tensorboardinfo
INFO: directory: /tmp/.tensorboard-info
INFO: os.stat(...): os.stat_result(st_mode=16895, st_ino=73738, st_dev=88, st_nlink=2, st_uid=0, st_gid=0, st_size=2, st_atime=1648610374, st_mtime=1648613527, st_ctime=1648613527)
INFO: mode: 0o40777

--- check: source_trees_without_genfiles
INFO: tensorboard_roots (1): ['/usr/local/lib/python3.8/dist-packages']; bad_roots (0): []

--- check: full_pip_freeze
INFO: pip freeze --all:
absl-py==1.0.0
astunparse==1.6.3
cachetools==5.0.0
certifi==2021.10.8
charset-normalizer==2.0.11
flatbuffers==2.0
gast==0.5.3
google-auth==2.6.0
google-auth-oauthlib==0.4.6
google-pasta==0.2.0
grpcio==1.43.0
h5py==3.6.0
idna==3.3
importlib-metadata==4.10.1
keras==2.8.0
Keras-Preprocessing==1.1.2
libclang==13.0.0
Markdown==3.3.6
numpy==1.22.1
oauthlib==3.2.0
opt-einsum==3.3.0
pip==20.2.4
protobuf==3.19.4
pyasn1==0.4.8
pyasn1-modules==0.2.8
requests==2.27.1
requests-oauthlib==1.3.1
rsa==4.8
setuptools==60.7.0
six==1.16.0
tensorboard==2.8.0
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.1
tensorflow-cpu==2.8.0
tensorflow-io==0.24.0
tensorflow-io-gcs-filesystem==0.24.0
termcolor==1.1.0
tf-estimator-nightly==2.8.0.dev2021122109
typing-extensions==4.0.1
urllib3==1.26.8
Werkzeug==2.0.2
wheel==0.34.2
wrapt==1.13.3
zipp==3.7.0

Issue description

I can get list of model ckeckpoint directory with tensorflow gfile and tensorflow-io.

tf.io.gfile.listdir('az://rndstoragesample/containersample/efficientdet-finetune/ckpt')
['best_objective.txt', 'checkpoint', 'config.yaml', 'events.out.tfevents.1648598968.my-pipeline-ckh9c-3384085500', 'events.out.tfevents.1648609048.my-pipeline-ks2sj-2126585855', 'graph.pbtxt', 'model.ckpt-0.data-00000-of-00001' ... ... ]

But When I try to set the Azure blob storage path to logdir of tensorboard, I always get "No dashboards are active for the current data set."

root@a601721015eb:~# tensorboard --logdir az://rndstoragesample/containersample/efficientdet-finetune/ckpt --bind_all
TensorBoard 2.8.0 at http://a601721015eb:6006/ (Press CTRL+C to quit)
W0330 03:53:26.889187 140443207591680 projector_plugin.py:489] Failed reading "az://rndstoragesample/containersample/efficientdet-finetune/ckpt/model.ckpt-178"

Reproduction steps

I downloaded tensorflow-io with pip and set accesskey on env var

pip install tensorflow-io
export TF_AZURE_STORAGE_KEY="<my-key>"

Then I check the connection with storage through python script.

import tensorflow_io
import tensorflow

account_name = 'rndstoragesample'
pathname = 'az://{}/aztest'.format(account_name)
tf.io.gfile.mkdir(pathname)
tf.io.gfile.listdir('az://rndstoragesample/containersample/efficientdet-finetune/ckpt')

The connection is looks good, so I try to log the blob directory with tensorboard.

tensorboard --logdir az://rndstoragesample/containersample/efficientdet-finetune/ckpt --bind_all

I got the log below, and face to "No dashboards are active for the current data set." page.

TensorBoard 2.8.0 at http://a601721015eb:6006/ (Press CTRL+C to quit)
W0330 03:53:26.889187 140443207591680 projector_plugin.py:489] Failed reading "az://rndstoragesample/containersample/efficientdet-finetune/ckpt/model.ckpt-178"

Do you guys have any idea for this problem?

Thanks in advance.

With Azure Blob Storage, I always get "No dashboards are active for the current data set."

Description

Environment information (required)

Diagnostics

Issue description

Reproduction steps

Contributor guide

First steps

Research direction

Assessment

With Azure Blob Storage, I always get "No dashboards are active for the current data set."

Description

Environment information (required)

Diagnostics

Issue description

Reproduction steps

Contributor guide

First steps

Research direction

Assessment

Get new issues in your inbox