NanmiCoder / NanmiCoder/MediaCrawler
创意交流:是否可以引入ai去解析接口数据
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 65.3k
- Forks
- 12.6k
- PR merge metrics
- No merged PRs in 30d
Description
看了一下源码,当前爬取数据应该是根据各个平台接口的返回结构写成字段映射,也就是说如果这么多平台,修改了字段结构,那就都要去维护,成本比较高;
现在有个想法,能否把这些接口信息传给ai模型组件,让ai解析数据,这样可以减少写硬文本去匹配字段,降低维护成本,可以实现吗?
因为我不太清楚这些平台更新的频率所以不太清楚有没有这个必要,但是从长期角度来说我觉得这个思路有点说法,因为我把接口信息给豆包,ds 他们的确能识别返回准确的字段信息
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
The issue names no files, tests, or entry points. First map where platform response field mappings are maintained and assess whether an AI model could replace or supplement them. Done would require a concrete scope, supported platforms, and agreed reliability, cost, and maintenance criteria.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- ai, backend
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100