A method of processing web requests directed to a website, the method including: (i) receiving a plurality of web requests directed to the website; (ii) for each of the plurality of web requests, identifying a source from which the web request has originated; (iii) for at least one web request identified as having originated from a given source: determining whether the source is a bot or a non-bot based on the at least one web request; if the source is determined to be a bot, using a machine learning engine to assign one of a plurality of predetermined bot categories to the source based on the at least one web request.