A method is disclosed for a search engine or part of a search engine which utilizes collective intelligence, evaluation, and judgment, including web intelligence, to create and adapt the content of a generalized index hierarchy for digital resources to be searched. Digital resources to be searched can be stored and managed as a localized or distributed repository of images, video, audio, graphical or other multimedia data objects, as well as structured composite items, services, programs, modules, files, documents, systems, applications, networked peers, and agents, which may be difficult or costly to be indexed. In particular embodiments the claimed invention focuses on the indexing of semantic contents and/or pragmatic characteristics of such digital resources. By tracking and analyzing the searching behavior of users, proxies, and/or meta-search-engines, a search index can be created, tuned, improved and optimized. The claimed method in certain embodiments also incorporates an adaptive and evolution mechanism which allows relevant digital resources that may otherwise be overlooked to be found. The claimed invention can be applied to databases, web searching, personal/local search, community search, and broad-based or vertical search engines for internet, intranet, extranet or other uses.