The aspect of migration would be excuded. The four freedoms of the EU are free movement of goods, capital, people and the freedom to establish and provide services. The Brexiteers would like to uphold the first two, but limit the third one. It is not mentoined what their stand is like on the last one, but I would infer that this freedom should only apply to their citizen in their country.