An uneven portion is formed on a substrate extending in a linear shape stripe pattern, convex portions of an insulating film that intersects with a crystalline semiconductor film divided into island shapes are removed, and an amorphous semiconductor film is formed on the insulating film. The semiconductor film is melted and flows into concave portions of the insulating film, where it crystallizes, and the semiconductor film that remains on the convex portions of the insulating film is removed. A semiconductor film divided into island shapes is then formed from the semiconductor film formed in the concave portions, the convex portions of the insulating film are removed in portions where channel forming regions are to be formed, thus exposing side surface portions of the semiconductor film. A gate insulating film and a gate electrode contacting the side surface portions and upper surface portions of the semiconductor film are then formed.