Load Languages from Wikidata

[EdJoPaTo]

currently WmLanguageCode is based on the sites. I updated the scripts to load both the sites and the languages from Wikidata. As Wikidata probably knows all the languages from other Wikimedia projects it seems like a good source of languages for me.

I also changed some code related to languages and removed the shortLang method. The shortLang reduced the options usable for methods like getEntities as you couldn’t specify de-ch earlier as it was automatically reduced to de. This seems like a bug to me but I might miss something?

All the test cases still work except one which I think was a bug: getSitelinkData().lang included _ which only sites include. The language like it’s used in URLs and the lang arguments uses the -. The getSitelinkUrl also depends on it so I think this was another bug and the test case was also wrong.

Fixes #107

Uses a helper from #106 so it should be merged first. Only the last commit is unique to this PR.

[EdJoPaTo]

hm… maybe the type Language should be named LanguageCode as it doesn't represent a Language and rather a short language code to it.

I'm not sure if the Wm… (=Wikimedia?) prefix is good.
On first thought I would remove it as its already from a library related to that.

But when thinking further this library is generic to Wikibase. The languages are specific to Wikimedia or Wikidata. So other Wikibase instances could have their independent set of languages. Which would mean that the language shouldn't be a specific type at all and rather a string? (Probably an internal type Language = string like Url is currently for easier code readability)

Exporting the list / type would still be useful. Maybe it's even a future thing to have a generic language type and wdk for example specifies it explicitly with the actual Language type. But that's probably a bigger refactoring again.

Any thoughts on this? (Maybe from @maxlath or @mshd?)

[EdJoPaTo]

wikidata-lang provides way more language information. Not sure if wikibase-sdk should contain the basic Wikidata information too?

[maxlath]

hm… maybe the type Language should be named LanguageCode as it doesn't represent a Language and rather a short language code to it.

+1 for LanguageCode

[maxlath]

Having a hard coded language shortlist was a nice to have from the time this lib was wikidata specific, but it doesn't provide that much value, from what I can gather: let's try type LanguageCode = string?

[EdJoPaTo]

superseded by #120