A tubular for downhole use, the tubular including a pipe, an insulation layer surrounding the pipe, and a protective layer around the insulation layer and comprising a polymer. The protective layer can also include a compression layer adjacent to the insulation layer. There may be reinforcement material in the protective layer, for example encapsulated by the elastomer. The tubular may have bare portions at the ends for manipulation of the tubulars to form a tubing string. A sleeve may be provided using the same layer structure to insulate the bare portions which form joints of the tubing string. The sleeve can also include a base layer.