NanmiCoder / NanmiCoder/MediaCrawler

创意交流:是否可以引入ai去解析接口数据

Open
#885 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

enhancement
Dominant language
Python
Stars
65.3k
Forks
12.6k
PR merge metrics
No merged PRs in 30d

Description

看了一下源码,当前爬取数据应该是根据各个平台接口的返回结构写成字段映射,也就是说如果这么多平台,修改了字段结构,那就都要去维护,成本比较高;
现在有个想法,能否把这些接口信息传给ai模型组件,让ai解析数据,这样可以减少写硬文本去匹配字段,降低维护成本,可以实现吗?
因为我不太清楚这些平台更新的频率所以不太清楚有没有这个必要,但是从长期角度来说我觉得这个思路有点说法,因为我把接口信息给豆包,ds 他们的确能识别返回准确的字段信息

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

The issue names no files, tests, or entry points. First map where platform response field mappings are maintained and assess whether an AI model could replace or supplement them. Done would require a concrete scope, supported platforms, and agreed reliability, cost, and maintenance criteria.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
ai, backend
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.