A method for lifelong machine learning using boosting includes receiving a new task and a learning sample for the new task. A distribution of weights is learned over the learning sample using previously learned classifiers from old tasks. A set of task-specific classifiers are learned for the new task using a boosting algorithm and the distribution of weights over the learning sample, whereby the distribution of weights over the learning sample is updated using the task-specific classifiers for the new task.