abi / abi/screenshot-to-code

Support for uploading multiple images or provide detailed images to update the code

オープン
#492 コメント 2 件 リアクション 0 件 担当者 0 名 GitHub で見る
主要言語
Python
スター
78.7k
フォーク
9.6k
PR マージ指標
30日以内にマージされた PR はありません

説明

Hi team, appreciate your work which is awesome!

**Is your feature request related to a problem? Please describe.**
I ran it locally and played with it using Claude Sonnet 3.5 API, I found that the quality of generated code depends on the complexity of the provided image, for example, if I provide the screenshot of the whole page, the generated code can only show main sections of the page, but if I provide a screenshot which only contains the first section of the page, there is a higher degree of restoration. I tried to update the site using different prompts, it works, but it also need a lot of efforts to find and describe the different of generated page and original page.

**Describe the solution you'd like**
So I'm thinking whether it helps or not to allow us to provide an image of a specific section of the site and update it accordingly. The whole process will be:
1. Provide the complete image and generate the basic structure of the code
2. Update the code using images of different sections to achieve higher degree of restoration.
3. Repeat step#2 until we get a satisfied version and update the page manually.

**Describe alternatives you've considered**
An alternative solution is to allow to provide multiple images to provide more information to the model, not sure which solution is better.

コントリビューションガイド

このリポジトリのコントリビューションガイドは索引されていません

評価

この issue はまだ評価されていません。

新しい issue をメールで受け取る

初心者向けの GitHub issue を短くまとめたダイジェスト。