A combination tool allows delivery of a tool such as a packer or bridge plug with a variety of well cleanup tools that are retracted for running in. Once in the vicinity of where the plug or packer is to be set or if an internal diameter is to be targeted using clean up tools after passing a restriction, an inner mandrel can be activated such as in conjunction with a j-slot to selectively extend one or more cleaning tools against the force of a return spring out though openings in an outer housing. Circulation is established either through an open port or by opening a circulation port with mandrel movement. Just the zone near where the packer or bridge plug is to be set is cleaned. The cleaning tools retract after use with further mandrel movement. The packer or plug is picked up into position and set and the bottom hole assembly is removed. The plug or packer can be set in a variety of ways.