Two dimensional data is converted into three dimensional picture data in a method that can provide a real time high quality display during conversion. Pixels of a frame of picture data are segmented to create pixel segments by applying a k-means algorithm. The k-means algorithm groups pixels based on closeness of a combined value that includes luma, chroma, and motion information. By balancing this information the algorithm collects pixels into groups that are assigned relative depths to turn the two-dimensional information into three-dimensional information for display. Another method includes determining a depth map for the different pixel segments by determining an amount of motion of one of the pixel segments between two frames of a video and scaling the three-dimensional depth of one of the pixel segments based on the amount of motion between the two frames.