Systems and methods for customer journey optimization in email marketing are described. The systems and methods may identify a plurality of messages for a first time period, wherein the plurality of messages are categorized according to a plurality of messages types, identify user information for a customer, wherein the user information includes user interaction data, determine a message type from the plurality of message types for the first time period based on the user information, wherein the message type is determined using a decision making model comprising a deep Q-learning neural network, select a message from the plurality of messages based on the determined message type, and transmit the message to the customer during the first time period based on the selection.