Flexible polyurethane foams are made by reacting a hydrophilic quasi-prepolymer, water and a polymer polyol in the presence of a silicone surfactant and an ethylene oxide/higher alkylene oxide block copolymer. The foams exhibit desirably low densities and compression sets, and have good thermal and moisture-wicking properties. The foams are useful in bedding and other comfort applications in which they are exposed to body heat and bear at least a portion of the weight of the user. The thermal and moisture wicking properties contribute to perceived comfort for the user.