-
Notifications
You must be signed in to change notification settings - Fork 0
UnitSelectionVoiceCreation
Steps to create a unit selection voice:
1. Feature Extraction from Acoustic Data
2. Support for Transcription Conversion
3. Automatic Labeling
4. Label-transcription Alignment
5. Feature Vector Extraction from Text Data
6. Verify Alignment
7. Basic Data Files
8. Building acoustic models
9. Unit Selection Files
10. Adding a new unit selection voice in MARY
PraatPitchmarker
It computes pitch markers with help of Praat. You need to compile or install Praat in your machine.
It also do corrections for Pitch Marks to align near by Zero Crossing.
Configuration Settings:
command : Give absolute path of Praat Executable
(Note for Mac OS users: this should be /Applications/Praat.app/Contents/MacOS/Praat)
pmDir : Output Dir Path for Praat Pitch marks
corrPmDir : Output Dir Path for corrected pitch marks (Pitch marks tuned towards Zero Crossing)
maxPitch, minPitch : For choosing Pitch Range (Ex: Male: 50-200 | Female: 150-300)
2 MCEPMaker
It calculate MFCCs from Speech Wave files, using Edinburgh Speech Tools.
This component uses the Edinburgh Speech Tools, the path for this tool can be set on the general settings:
estDir : /your/path/to/Festival/speech_tool
Festvox2MaryTranscripts (optional)
This Component converts Festvox Transcription format (ex: txt.done.data) into MARY format, that is one transcription file per sentence.
Configuration Settings:
transcriptFile : Festvox format transcription file (Absolute path)
The output of this component is a text directory in your voice building directory, containing one transcription file per sentence.
AllophonesExtractor
Creates the prompt_allophones directory required in the next step. Note: This component requires the MARY server
EHMMlabeler
EHMM Labeler is a labeling tool, which generates label files with help of Wave files and corresponding Transcriptions. EHMM basic tool is available with Festvox Recent Version. For running EHMM Labeler under MARY environment you need to compile EHMM tool in your machine. It may take long time depending on the size of the data and system configuration.
LabelPauseDeleter
It may be necessary to run the LabelPauseDeleter after the label files have been created by EHMM, to avoid problems with subsequent voice building components.
LabelledFilesInspector
It allows to browse through aligned labels and listen to the corresponding wave file. It is useful for perceptual manual verification on alignment.
PhoneUnitLabelComputer
Converts the label files into the label files used by Mary: phone labels (phonelab directory)
HalfPhoneUnitLabelComputer
Converts the label files into the label files used by Mary: halfphone labels (halfphonelab directory)
TranscriptionAligner
This component will create the allophones directory.
FeatureSelection
Allows you to select context features for building the voice. Note: This component requires the MARY server
The selected context feature names are saved in your voice building directory in: mary/features.txt
PhoneUnitfeatureComputer
Computes Phone feature vectors for Unit Selection Voice building process. Note: This component requires the MARY server
You can connect to a different server by altering the settings. See the settings help for more information on this.
HalfPhoneUnitfeatureComputer
Computes half phone level feature vectors.
PhoneLabelfeatureAlignment
It tries to align the labels and the feature vectors. If the alignment fails, you can start the automatic pause correction.
This works as follows:
- pauses, that are in the label file but not in the feature file are deleted in the label file, and the durations of the previous and next labels are stretched.
- pauses that are in the feature file but not in the label file are inserted into the label file with length zero.
If there are still errors after the pause correction, you are prompted for each error. You can skip the error or remove the corresponding file from the basename list (the list of files that are used for your voice). "skip all" and "remove all" does this for all problematic files. "Edit unit labels" allows you to edit the label file. "Edit RAWMARYXML" let you edit the maryxml that is the input for computing the features. You have to have a Maryserver running in order to recompute the features from the maryxml. You can alter the host and port settings for the server by altering the settings for the UnitFeatureComputer.
HalfPhoneLabelfeatureAlignment
It works like the previous component.
WaveTimelineMaker
The WaveTimelineMaker split the waveforms as datagrams to be stored in a timeline in Mary format. It produces a binary file, which contains all wave files.
BasenameTimelineMaker
The BasenameTimelineMaker takes a database root directory and a list of basenames, and associates the basenames with absolute times in a timeline in Mary format.
MCepTimelineMaker
The MCepTimelineMaker takes a database root directory and a list of basenames, and converts the related wav files into a mcep timeline in Mary format.
PhoneUnitfileWriter
It produces a file containing all phone sized units.
PhoneFeatureFileWriter
It produces a file containing all the target cost features for the phone sized units. The module needs a file defining which features are to be used and what weights are given to them. They must be the same features as the ones that the PhoneFeatureComputer used. If you do not have a feature definition, the module tries to create one.
DurationCARTTrainer
It builds an acoustic model of durations in the database using the program "wagon" from the Edinburgh Speech tools.
F0CARTTrainer
It builds acoustic models of F0 like DurationCARTTrainer. It uses "wagon" and the files produced by PhoneUnitfileWriter and PhoneFeatureFileWriter.
HalfPhoneUnitfileWriter
It produces a file containing all halfphone sized units.
HalfPhoneFeatureFileWriter
It produces a file containing all the target cost features for the phone sized units. The module needs a file defining which features are to be used and what weights are given to them. They must be the same features as the ones that the HalfPhoneFeatureComputer used. If you do not have a feature definition, the module tries to create one.
AcousticFeatureFileWriter
It produces a file containing all the target cost features plus two acoustic target cost features for the halfphone sized units. Also produces a feature definition containing those features.
JoinCostFileMaker
It produces a file containing all the join cost features for the halfphone sized units.
CARTBuilder
It builds a preselection tree for the target cost features using "wagon" (CART) from the Edinburgh Speech tools.
Additionally, the user needs to specify either a feature sequence or a top level tree. They are used to built a basic tree that is extended by wagon. This way, wagon runs several times on smaller subsets of units rather than the whole set. It might still take some time to run this module.
Feature sequence: A file containing a list of features for which to build the tree.
Top level tree: A file containing the basic tree.
If you give the CARTBuilder neither a feature sequence nor a top level tree file, a default feature sequence is created which only contains "mary_phoneme" as feature. If the basic tree contains leaves that contain more units than the maximum number of units allowed, the leaves are pruned and a warning message is printed. It is recommended that you make sure that there are no leaves that are too big.
VoiceCompiler
Compiles the voice to be used in MARY TTS. The default setting values of this component are already fixed.
Once the voice is compiled, follow the instructions in Publishing-a-MARY-TTS-Voice to install the voice.