Comments (3)
ftyers
commented on September 27, 2024
1
I added them in 38b92b5. It seems those are non-standard diacritic marks, but we can update this if we get a different dataset.
from commonvoice-utils.
ftyers
commented on September 27, 2024
In general, according to the Wikipedia page:
In standard written Hausa, tone is not marked. In recent linguistic and pedagogical materials, tone is marked by means of diacritics.
Does the data you have mark those?
There is ΚΌ (U+02BC MODIFIER LETTER APOSTROPHE) in the alphabet, which is probably equivalent to β (U+2019 RIGHT SINGLE QUOTATION MARK). I added the normalisation in 2ed8882.
from commonvoice-utils.
JRMeyer
commented on September 27, 2024
yes, those two as are quite common in the bible text
from commonvoice-utils.
Related Issues (20)
- on the Validator HOT 5
- Add a method of checking CJK HOT 3
- Feature Request: Add Validators for languages in Biblica data HOT 3
- Get checkpoint functionality should stream file to disk not memory HOT 1
- hindi encoding issue HOT 3
- Chatino tones are written with superscript letters HOT 2
- Please add Korean support
- Adding feature to exclude group of information during export HOT 1
- Issue with encoding during setup in Windows HOT 2
- Question: Effect of changes in abbr.tsv HOT 1
- Japanese support HOT 1
- covo is not portable HOT 2
- Feature Request: Please add "hasValidator" etc HOT 4
- Turkish abbr not merged HOT 1
- pip-github version mismatch HOT 1
- Feature request: Add syllabification support HOT 2
- [FR] Make "Function not implemented" errors only valid for "covo"
- Armenian and Uigur became newly added and are not yet in the table HOT 1
- Transliterator module missing HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
π Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. πππ
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google β€οΈ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from commonvoice-utils.