In my opinion, you have got the visa stamped on your passport, you have the permission to enter. Visa purpose is family unification, that has not changed. Always at the port of entry, answer questions to the point only, when asked any question. On your own, don't tell the story the main applicant is...