If you have a residence permit from portugal that states "family member of a european citizen" that should be all you need -- because that is indeed a article 10/20 residence permit. My case was different-- I had this type of permit from Hungary, but after 5 years I got a permanent residen...