Create data syllabifier

[bumbu]

A script that will take data_mined.json as input and syllabify each phrase. Expected result is a JSON file with format:

[{
  "phrase": "Post title",
  "url": "http://9vo.lt/news/post1",
  "metadata": [
    {
      "word": "Post",
      "syllables": ["post"],
      "accent_on": 0
    },
    {
      "word": "title",
      "syllables": ["ti", "tle"],
      "accent_on": 0
    }
  ]
},
{
  "phrase": "Post Timofti",
  "url": "http://9vo.lt/news/post1",
  "metadata": [
    {
      "word": "Post",
      "syllables": ["post"],
      "accent_on": 0
    },
    {
      "word": "Timofti",
      "syllables": ["Ti", "mof", "ti"],
      "accent_on": 1
    }
  ]
}]

Expected output file name is data_syllabified.json.

[idanci]

https://github.com/halostatue/text-hyphen

[bumbu]

Need to check how it works with Romanian words.

As there are always problems with Romanian some solutions might be:

• For accent use dexonline
• For syllabes use Romanian silabisitor

[bumbu]

Some JS hyphenators with Romanian language support:

• hyphenator
• hyphen pattern for romanian can be taken from previous library

[minivan]

Silabisitor gives you the accent as well and is available as a Java thingie