A rail fence retractor allowing removal of a fence rail engaged with a fence post comprising a blade having a first and second end. The first end of the blade is configured for insertion into a fence post slot having a rail inserted therein. The rail has self-locking tabs which must be depressed for removal of the rail from the fence post slot. The fence rail retractor also has a handle which is attached to the second end of the blade. The handle allows the application of force against handle to fix the position of the handle against the fence post during removal of the rail from the fence post slot. The handle is also useful in carrying the rail fence retractor when not in use. The handles may be also be configured to allow a pair of rail fence retractors to fit or snap together when not in use.