Comments Wanted edit
Wikipedian friends, I am experimenting with using programming way to find cross-language fact conflicts in large scale. Here is a small sample of data I was able to produce for now. I like to ask for some early feedback. Please leave comments in the talk page let me know what you think.
For now I plan to produce EN v FR, EN v DE. I post related data to the related Wikipedias too.
Comments edit
- This looks like it can be really useful for fixing Wikidata errors. How do you extract the information? Can you show us the code? Roger (Dodger67) (talk) 23:11, 15 June 2018 (UTC)
- Hi @Dodger67, Thanks for your encouragement. On a high-level, the steps are: (1) extract facts from a Wikipedia Article. (2) compare the information that should have a unique value (e.g. a personal can only be born once) across languages. (3)turn this comparison into a Map-Reduce-like large scale pipeline. (4) filter the conflicting data with constraints. Not all technologies I used are open-sourced yet, so I still need sometime to get the code to a status of release-able. Other comments, thoughts? I wonder if people will also think it helpful to fix facts on Wikipedia, too? Xinbenlv (talk) 23:31, 15 June 2018 (UTC)
- Seeking more comments Xinbenlv (talk) 01:58, 17 June 2018 (UTC)
- Xinbenlv, have you asked over at d:Wikidata:Project chat? I think this would be very useful to Wikidata editors (probably much more than Wikipedia editors), as information is routinely imported from smaller projects like the Russian Wikipedia, which might not have data as good as the English Wikipedia's. There are also probably more editors who are used to querying databases, and there are some tools (with a GUI) which I think can import entire infoboxes from groups of articles. Jc86035 (talk) 09:05, 17 June 2018 (UTC)
- Continue to seek comments Xinbenlv (talk) 02:31, 19 June 2018 (UTC)
- @Xinbenlv: Great idea. The first thing to do imho, is to find a stable home for this. VPT is a fast-moving page and this discussion will either get archived and lost, or get too big to live here. In any case, may I suggest finding a new home for it, and moving this discussion there? Ideally for starters, your data, examples and technical material could live on a new Project page, with this discussion moved to the Talk page associated with it. I can offer some suggestions if you like. Mathglot (talk) 03:21, 19 June 2018 (UTC)
- This looks great! I would love to see a review frontend for this, it would make a cool game. Thanks for sharing at 'mania :) – SJ + 08:32, 20 July 2018 (UTC) A related curiosity: Talk:Jimmy Wales/Birthdate