Libyan rebels were forced to retreat from a key oil port Thursday in the face of a withering air and ground assault by troops loyal to leader Moammar Gadhafi.