An engine assembly may include an engine structure defining a combustion chamber, a fuel injector in fluid communication with the combustion chamber, a fuel supply and a fuel pump assembly. The fuel pump assembly may include a housing, a reciprocating member, and a solenoid valve assembly. The housing may define an inlet in fluid communication with the fuel supply, an outlet in fluid communication with the fuel injector, and a bypass passage. The reciprocating member may be located within the housing to define a compression chamber in fluid communication with the inlet, the outlet, and the bypass passage. The solenoid valve assembly may include a valve member located within the bypass passage and displaceable between open and closed positions to selectively provide fluid communication between the compression chamber and the fuel supply during a compression stroke of the reciprocating member.