NVIDIA / NVIDIA/Model-Optimizer

distill.py fails with AttributeError: DistillQwen3VLModel has no attribute 'output_layer' when using Qwen3.5-0.8B as student/teacher

Open
#1,819 1 comment 0 reactions 1 assignee View on GitHub

@kevalmorabia97 is already working on this.

Since Jun 25, 2026.

feature request
Dominant language
Python
Stars
3.8k
Forks
604
Avg merge
2d 8h
Merged PRs (30d)
142

Description

branch: dkorzekwa/claude_qwen35_distill (create a few days ago from modelopt main)
container: nemo_26_06

Steps to reproduce

PYTHONPATH=/workspace/Model-Optimizer:$PYTHONPATH \
torchrun --nnodes 1 --nproc_per_node 1 \
    examples/megatron_bridge/distill.py \
    --tp_size 1 \
    --teacher_hf_path /workspace/hf_models/Qwen/Qwen3.5-0.8B \
    --student_hf_path /workspace/hf_models/Qwen/Qwen3.5-0.8B \
    --student_hf_model /workspace/hf_models/Qwen/Qwen3.5-0.8B \
    --use_mock_data \
    --seq_length 512 --mbs 1 --gbs 8 --train_iters 10 \
    --kd_loss_scale 1.0 \
    --output_dir /tmp/distill_test \
    --hf_export_path /tmp/distill_test/hf

Error
AttributeError: DistillQwen3VLModel has no attribute output_layer

Full traceback location:

  • modelopt/torch/distill/mode.py:189 → _convert_for_kd
  • modelopt/torch/distill/distillation_model.py:88 → self.get_submodule(student_layer_name)

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.