In the early eighteenth century, pirate captain Jean Lafitte fights a rival pirate and wins a treasure and a beautiful female captive. Although the girl offers herself to Lafitte to save her English lover, Lafitte makes him walk the plank. The girl then places a curse on Lafitte and his descendants, preventing them from ever knowing the true love of woman. Two hundred years later, in the West Antilles, painter Paul Winthrop poses Joe, a pearl diver, as a pirate. Upon seeing the completed painting, each envisions the earlier situation. Later, Joe finds the buried treasure and sails to New York, where he learns that the portrait has also attracted wealthy Lily Demorest and her suitor, Robert Spurr, a "financial pirate."