Deykun@kbin.social to DACH - jetzt auf feddit.org@feddit.de · 9 months agoGerman heatmap based on Wikipedia articles 🇩🇪media.kbin.socialimagemessage-square27fedilinkarrow-up194arrow-down13
arrow-up191arrow-down1imageGerman heatmap based on Wikipedia articles 🇩🇪media.kbin.socialDeykun@kbin.social to DACH - jetzt auf feddit.org@feddit.de · 9 months agomessage-square27fedilink
minus-squareDeykun@kbin.socialOPlinkfedilinkarrow-up24·edit-29 months agoTo clarify, it is not the total number of words but rather the number of unique words considered. Imho a million of unique words is okay. A bigger concern for me would be that words on Wikipedia can be overly specific.
minus-squareGBU_28@lemm.eelinkfedilinkarrow-up1·9 months agoHave you considered a similarity search approach? They would handle your oddly specific synonym issue
minus-squareDeykun@kbin.socialOPlinkfedilinkarrow-up1·9 months agoI only have a prespellechecked list of words from here: http://www.aaabbb.de/WordList/WordList_en.php
To clarify, it is not the total number of words but rather the number of unique words considered. Imho a million of unique words is okay. A bigger concern for me would be that words on Wikipedia can be overly specific.
That million words sounds like a lot.
Have you considered a similarity search approach? They would handle your oddly specific synonym issue
I only have a prespellechecked list of words from here: http://www.aaabbb.de/WordList/WordList_en.php