Caribbean worried about losing business over passport rule