It's literally Photoshop with neural network functionality. Change, add and remove any detail - and do it all through simple text prompts.
We unveil an integrated image editing system designed to support users in swiftly actualizing their creativity. This system starts with a streamlined yet functionally robust interface, enabling users to articulate their ideas (e.g., inserting elements, erasing objects, altering color, etc.) with just a few strokes. These interactions are then monitored by a multimodal large language model (MLLM) to anticipate user intentions in real time, bypassing the need for prompt entry. Finally, you have the powerful diffusion prior, enhanced by a carefully learned two-branch plug-in module, to process the editing request with precise control.
- Use the add brush to add details and elements guided by prompts - express your ideas with your own lively strokes!
- The subtract brush can remove excess details or redraw areas based on prompts. If there's anything you're not satisfied with, just subtract it away!
- The color brush can precisely color the image, matching the color of your brush.
Link: