The spread of languages and culture is different from the spread of genes and DNA. It is perfectly natural for one to spread without a parallel spread of the other. There is something called the ‘elite dominance’ model for the spread of languages.