A chip card holding mechanism includes a support bracket defining a receiving chamber and an opening communicating with the receiving chamber; a resilient member fixed to the support bracket at an end of the support bracket opposite to the opening, and partial received in the receiving chamber; a latching assembly rotatably fixed to the support bracket and further comprising a pair of latching portions; and a tray slidably assembled to the support bracket, in which the tray comprises an accommodating space defined thereon to receive a chip card, and a pair of opposite sidewalls adjacent to the accommodating space, each sidewall defining a latching groove according to the corresponding latching portion; and the tray is received in the receiving chamber by having the latching portions of the latching assembly engaged in the latching grooves and resisting against the resilient member. An electronic device using the same is also provided.