Techniques are presented for rule-based selection of query engines for performing data operations on a variety of datasets stored in heterogeneous data storage environments. Data statements for a subject dataset are mapped to a logical data structure representation of the subject dataset to formulate a logical plan for the data statements. The data statements are analyzed to derive a set of statement attributes associated with the data statements. Query engine attributes describing the query engines available to query various instances of the subject dataset are accessed. A set of query engine selection rules are evaluated subject to the statement attributes and/or the query engine attributes to dynamically select a target query engine for the data statements. A physical plan structured for the target query engine is generated from the logical plan. The physical plan is executed on the target query engine to perform data operations on the subject dataset.