Perhaps some of those sailors decided to drop anchor and stay in Berwick, Tweedmouth or Spittal or were stranded when their ship sailed off without them.
Perhaps one of them was your ancestor.
Also, many Scots (including one of my ancestors) went to fight as mercenaries for the King of Sweden, so perhaps they married and had a family there.
To celebrate Genealogy Day in Sweden, which is on 21 March, ArkivDigital is offering free access to Swedish records in their collection at the weekend.
Sweden is one hour ahead of us so the free period is from 11pm on 20 March to 11pm on 22 March.
You'll need to register and download the ArkivDigital program.
There's also a useful guide to Swedish Genealogical records.
If this helps you to widen your family history, please let us know.