A packer or bridge plug has slips that bind to the surrounding tubular with an adhesive bond. The tubular wall is not penetrated but a roughening of the target location in the tubular can help the bond material to adhere to support the packer or bridge plug. A removable cover can overlay the surface to be bonded to the tubular and the cover can come off in a variety of techniques before the members to be bonded are radially extended. An acrylic adhesive can be the bonding agent. The packer or bridge plug can be made of mostly or entirely non-metallic materials to facilitate mill out.