Systems and methods for using images to generate gameplay content are disclosed herein. Specifically, for example, one aspect of the present disclosure involves a method for altering a virtual world generated by a video game system. The method includes obtaining one or more images from sources external to the video game system and processing the one or more images to obtain one or more inputs. The one or more inputs are provided to a gameplay engine to alter an output of the gameplay engine.