modelstudioai / modelstudioai/skills

bailian-docs-llm-wiki/raw 目录下原始文档缺失问题

Open
#67 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
57
Forks
7
Avg merge
1m
Merged PRs (30d)
30

Description

在bailian-docs-llm-wiki/raw 目录下,源站爬取时,部分层级下目录文档有缺失。当某父目录自身含有文档内容时,其子节点未被爬取,造成遗漏。
e.g.:
百炼上用户指南(模型)>模型体验>视觉理解>图像与视频理解(https://help.aliyun.com/zh/model-studio/vision)有这篇文档,
但仓库raw目录下该文档缺失。
因为这篇文档的父目录“视觉理解”自身也有内容。
希望能补上缺失的文档~

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by locating the crawler entry point that populates the raw directory, then inspect how it traverses children when a parent page also has content. Compare the result with the Model Studio vision source page and verify that the missing document and other affected child pages appear in raw after the crawl.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
documentation
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
56/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.