Disclosed are systems and methods utilizing neural contextual bandit for improving interactions with and between computers in content generating, searching, hosting and/or providing systems supported by or configured with personal computing devices, servers and/or platforms. The systems interact to make item recommendations using latent relations and latent representations, which can improve the quality of data used in processing interactions between or among processors in such systems. The disclosed systems and methods use neural network modeling in automatic selection of a number of items for recommendation to a user and using feedback in connection with the recommendation for further training of the model(s).