Comments (7)
Do you know the encoding? The dic file seems to be UTF8, but I’m not Hungarian so I can’t assert the aff file 🤷♂️ Could you help?
from dictionaries.
Yes, the encoding is UTF-8 on the files, my original post wasn't clear. I should've written, that somewhere in the encoding process, something was messed up, and the characters were encoded into UTF-8, while still being wrong.
I'm not sure what could be done, other than manually going in and correcting every line, with the proper characters. The problem with that, is that not even I'm sure what's supposed to be correct, even though I'm native Hungarian, because the characters are wrong, I'm not always sure what word is supposed to be there.
It's stated with the hun dictionary, that you used magyarispell. Maybe your code could be re-generated from that. I've checked out magyarispell, the characters look fine in that project. The Hungarian language uses the ISO-8859-2 encoding, sometimes called as Latin-2, (or Windows 1250, if using windows).
But I don't know what the code generation process was in your project, because magyarispell uses a directory structure by topics and files with different grammar usages. But maybe during generation, the initial files were read with the wrong encoding, and then using the wrong characters, it was encoded into UTF-8.
from dictionaries.
Oh I got that, sorry! You can clone the repo and do npm test
, that should provide the files in source/hungarian/
. The tarbal is from here. The script that encodes to UTF8 is here. It sets both to ISO8859-2
, but that doesn’t seem to work.
I locally tried UTF-8
for the dic file, and ISO8859-2
for the aff file, but it still seems wrong? 🤔
from dictionaries.
@alexaka1 Could you look into the encoding issue as layout out in my previous comment? I don’t know Hungarian so I can’t do it myself.
from dictionaries.
@alexaka1 Ping!
from dictionaries.
Sorry I didn't answer sooner. Partly because I was busy with school and work, and also because I gave up on spellchecking.
If you've tried it out, and didn't work again, then I really don't know what's going on. I'm not familiar with how char encoding works, just when to stop that something is wrong. Maybe the OS locale messes it up, even though it shouldn't, but I don't know.
I'll have a look at it though when I have the time.
from dictionaries.
Don’t worry, school’s more important 😉
I’ll close this for now. I can’t fix it, I need someone who knows Hungarian to come in. It would be awesome if you’d be up for it tho, or someone else!
from dictionaries.
Related Issues (20)
- arabic HOT 2
- Origin of Russian dictionaries? HOT 2
- Add type definitions HOT 1
- Convert to ESM HOT 6
- Add words to German dictionary HOT 4
- en_GB doesn't work for "misspelt" HOT 1
- Suggestion is not working for Swedish HOT 1
- [update word] Polish "przypuszczać - przypuszczający" HOT 1
- Investigate shipping `.dic`, `.aff` as JSON HOT 3
- [Question] Is there some index accross dictionaries ? HOT 1
- Simple code is not running HOT 4
- Force accents in Russian dictionary (ё) HOT 2
- Lithuanian dictionary is wrong HOT 2
- Use a newer, updated source for Russian HOT 4
- Korean returns true for all words (correct function) HOT 1
- Issue in Dictionary file - Different style apostrophes, it marks it as a misspelling HOT 2
- Add Swahili dictionaries HOT 1
- There should be no Eszett in Swiss German HOT 1
- Add index.dic and index.aff to exports HOT 7
- Html Entities found in `.aff` files. HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from dictionaries.