A battery holding and dispensing device can hold a plurality of batteries, in a single battery size or an assortment of battery sizes. The battery holding and dispensing device includes a frame having a plurality of compartments sized and shaped to each receive a battery of a particular battery size and each having a magnetic insert for releasably retaining the battery in the compartment. A system is disclosed for inductive charging of batteries held in a caddy.