Comfy-Org / Comfy-Org/ComfyUI_frontend
3D View align tool
- Dominant language
- TypeScript
- Stars
- 2k
- Forks
- 699
- Avg merge
- 1d 7h
- Merged PRs (30d)
- 490
Description
### Is there an existing issue for this?
- [x] I have searched the existing issues and checked the recent builds/commits
### What problem are you experiencing?
When controlling the perspective of a 3D object that I want to incorporate into a scene using inpainting, it becomes very tedious to deal with the camera.
### When does this problem occur?
Workflows related to product images, archviz, design, etc.
### How often do you encounter this problem?
Occasionally
### How much does this problem affect your workflow?
Significantly slows down my work
### Current workarounds
- Export 3D object.
- Import to Blender
- Import BG image
- Realign the cámera with perspective plotter (to get the correct field of view, camera lens, and perspective distortion)
- Export a single image render with the 3D object.
- Use inpainting with low denoise.
Although the process is simple, it is very tedious and time-consuming for something so easy. The final objective is to align the 3D object correctly with the scene, and it is almost impossible to do this with the actual tools in Comfy.
### Ideas for solutions (Optional)
1. On the one hand, I think that Preview 3D should incorporate a background image input directly instead of having to import it from the file browser.
2. On the other hand, I think it would be very interesting to implement something like Perspective Plotter, which is based on Fspy, a widely used open source add-on in Blender for aligning the camera with the view of any reference image.
[Perspective Plotter](https://superhivemarket.com/products/perspective-plotter)
[Fspy](https://fspy.io/)
### Additional context
By adding these changes to the nodes related to 3D manipulation, complete workflows for integrating objects into scenes could be developed without having to leave Comfy or integrate it internally into programs such as Blender. This, coupled with the possibility of converting any still image directly into 3D with models such as Hunyuan, Tripo, or Rodin, opens the door to a whole new range of techniques and options.
https://github.com/user-attachments/assets/88e3d6a5-5e12-497e-bc9f-656e1868d1d6
┆Issue is synchronized with this [Notion page](https://www.notion.so/Issue-5884-3D-View-align-tool-27f6d73d365081cfbe7bf5bdae247621) by [Unito](https://www.unito.io)
Contributor guide
Assessment
This issue has not been assessed yet.