An implantable medical device (IMD) is configured with a pressure sensor. The IMD includes a housing, a pressure sensor and a fluid filled cavity. The housing has a diaphragm that is exposed to the environment outside of the housing. The pressure sensor has a pressure sensor diaphragm that is responsive to a pressure applied to the pressure sensor diaphragm and provides a pressure sensor output signal that is representative of the pressure applied to the pressure sensor diaphragm. The fluid filled cavity is in fluid communication with both the diaphragm of the housing and the pressure sensor diaphragm of the pressure sensor. The fluid filled cavity is configured to communicate a measure related to the pressure applied by the environment to the diaphragm of the housing to the pressure sensor diaphragm of the pressure sensor.