Proposal: New UI to show GPU Details

We’re looking to extend the TensorBoard user interface to display interesting GPU details for each node in a neural network. The GPU Details that we plan to display focus on the usage of tensor cores. Tensor cores enable deep learning applications to run significantly faster.

Tensorboard GRAPHS tab: When a node is selected, and when the new ‘GPU Details’ radio button is clicked in navigator panel, a new properties panel will appear to the right called GPU details. This new panel will display GPU details for that node:

• Percentage bar showing percentage of kernels using tensor cores
• Percentage bar showing percentage of duration using tensor cores
• Detailed kernel information, including kernel name, call counts, and durations.

Please review two new user interface elements on the GRAPHS tab:

• New radio button in navigator panel on left hand side, and
• New ‘GPU Details’ properties panel on right hand side.

Notes:

• The nodes themselves will be shaded based upon the usage of tensor cores.

Question: Is this in line with your ideas on how to display GPU Details for nodes in TensorBoard? Any guidance here would be appreciated.