In one sentence

RLHF

People compare or rate AI answers, and that feedback is used to teach the AI to produce answers people prefer.

From the offline library