What is instruction-based image editing?
Instruction-based image editing changes an existing picture from a written instruction such as "make the shirt blue". The original image is kept and only the named part is altered. It was introduced by the InstructPix2Pix paper in 2022, which also showed that no mask or selection is required — the model infers the region from the words.