👋 Welcome to the Image Editing Study
Please read the instructions carefully:
You will be shown an original image and an editing instruction. You will also see 3 different attempts to follow that instruction.
Please pick the "BEST" image(s) in two aspects:
Precise Instruction Following: For each task, you will see a long instruction involving multiple edits, in which some of them may have sequential dependencies (e.g., Move the apple onto the table, and add a pear next to the apple, a good results should show both apple and pear on the table).
- Carefully read the instruction and inspect every detail in the foreground and background of the image. Do not miss any instructed edits.
- Check for completeness. Choose the image that accurately completes as many instructed edits as possible.
- Check for preservation. Everything else (e.g. layout, viewpoint) in the image should remain unchanged and stays close to the original image.
Perceptual Quality: Choose the image with content presented in good visual clarity. Avoid images that look incomplete, distorted, or glitchy.
Note that the image best followed the instruction may not always have the best perceptual quality, please carefully evaluate the image from two aspects without biases.
Duration: This study consists of 15 tasks and should take about 25 minutes.
Completion: You must complete all tasks and click "Submit" at the end.
Important: Do not refresh your browser, or you will lose your progress.