Detection of various issues with plug-ins and fragments corresponding to a software product as part of an automated quality engineering investigation is provided. In order to determine whether any issues are present, information pertaining to each plug-in and fragment is analyzed. The information can be stored in a corresponding manifest for the plug-in and fragment, and can include version information and dependency information for the corresponding plug-in and fragment. The issues can include an error relating to the manifest, an error relating to the version information, an error relating to the dependency information, and/or the like.