Provided is a fat or oil composition having high oxidative stability even though containing large amounts of eicosapentaenoic acid and docosahexaenoic acid, and having suppressed degradation odor and unpleasant odor derived from a rosemary extract at the time of cooking. The fat or oil composition comprises the following components (A), (B), and (C):(A) a fat or oil in which a total content of eicosapentaenoic acid and docosahexaenoic acid in constituent fatty acids of the fat or oil is from 0.1 to 20 mass % with respect to total constituent fatty acids of the fat or oil; (B) a rosemary extract; and (C) a dill extract, in which a mass ratio of a content of the component (B) to a content of the component (C), [(B)/(C)], is from 2 to 200.