The invention discloses a deep theme model-based text image multi-mode retrieval method which can be used for text and image multi-mode retrieval. The method comprises the following steps of: (1) preprocessing training data and test data; (2) initializing a hyper-parameter and a share parameter of a deep theme model; (3) training the deep theme model; (4) training a classifier by using a joint feature; and (5) carrying out test by using the test data. According to the method, deep-to-shallow relation between different mode hidden layers is mined by utilizing the deep theme model, and a joint feature which comprises multi-mode information is obtained to carry out retrieval.