abi / abi/screenshot-to-code

Support for uploading multiple images or provide detailed images to update the code

未关闭
#492 2 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看
主要语言
Python
星标
78.7k
派生
9.6k
PR 合并指标
30 天内没有已合并 PR

描述

Hi team, appreciate your work which is awesome!

**Is your feature request related to a problem? Please describe.**
I ran it locally and played with it using Claude Sonnet 3.5 API, I found that the quality of generated code depends on the complexity of the provided image, for example, if I provide the screenshot of the whole page, the generated code can only show main sections of the page, but if I provide a screenshot which only contains the first section of the page, there is a higher degree of restoration. I tried to update the site using different prompts, it works, but it also need a lot of efforts to find and describe the different of generated page and original page.

**Describe the solution you'd like**
So I'm thinking whether it helps or not to allow us to provide an image of a specific section of the site and update it accordingly. The whole process will be:
1. Provide the complete image and generate the basic structure of the code
2. Update the code using images of different sections to achieve higher degree of restoration.
3. Repeat step#2 until we get a satisfied version and update the page manually.

**Describe alternatives you've considered**
An alternative solution is to allow to provide multiple images to provide more information to the model, not sure which solution is better.

贡献指南

这个仓库没有索引到贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。