I’m fairly sure that the rule behind why there is an article in that particular sentence does not apply to the Swedish language exclusively. I take it that the word that is clearly missing after “Swedish” is something like “original” or “language”. So, this would be some sort of a fixed phrase, is that right?
Yes, what you indicate is correct.