libsent/src/voca/voca_load_htkdict.c

HTK形式の単語辞書データの読み込み [詳細]

#include <sent/stddefs.h>
#include <sent/vocabulary.h>
#include <sent/htk_hmm.h>

ソースコードを見る。

マクロ定義
#define	PHONEMELEN_STEP   30
	Memory allocation step for phoneme sequence.
関数
char *	cycle_triphone (char *p)
	Return string of triphone name composed from last 3 call.
char *	cycle_triphone_flush ()
	Flush the triphone buffer and return the last biphone.
static void	add_to_error (WORD_INFO *winfo, char *name)
	Add a triphone name to the missing error list in WORD_INFO.
static void	callback_list_error (void *x)
	Traverse callback function to output a error phone.
static void	list_error (WORD_INFO *winfo)
	Output all error phones appeared while readin a word dictionary.
void	voca_set_stats (WORD_INFO *winfo)
	Parse a word dictionary and set the maximum state length per word.
void	voca_load_start (WORD_INFO *winfo, HTK_HMM_INFO *hmminfo, boolean ignore_tri_conv)
	Start loading a dictionary.
boolean	voca_load_line (char *buf, WORD_INFO *winfo, HTK_HMM_INFO *hmminfo)
	Load a line from buffer and set parameters to the dictionary.
boolean	voca_load_end (WORD_INFO *winfo)
	End loading dictionary entries.
boolean	voca_load_htkdict (FILE *fp, WORD_INFO *winfo, HTK_HMM_INFO *hmminfo, boolean ignore_tri_conv)
	Top function to read word dictionary via file pointer (gzip enabled)
boolean	voca_load_htkdict_fp (FILE *fp, WORD_INFO *winfo, HTK_HMM_INFO *hmminfo, boolean ignore_tri_conv)
	Top function to read word dictionary via normal file pointer.
boolean	voca_append_htkdict (char *entry, WORD_INFO *winfo, HTK_HMM_INFO *hmminfo, boolean ignore_tri_conv)
	Append a single entry to the existing word dictionary.
boolean	voca_load_htkdict_line (char *buf, WORD_ID *vnum_p, int linenum, WORD_INFO *winfo, HTK_HMM_INFO *hmminfo, boolean do_conv, boolean *ok_flag)
	Sub function to Add a dictionary entry line to the word dictionary.
boolean	voca_mono2tri (WORD_INFO *winfo, HTK_HMM_INFO *hmminfo)
	Convert whole words in word dictionary to word-internal triphone.
boolean	voca_append (WORD_INFO *dstinfo, WORD_INFO *srcinfo, int coffset, int woffset)
	Append one word dictionary to other, for multiple grammar handling.
変数
static char	buf [MAXLINELEN]
	Local work area for input text processing.
static char	bufbak [MAXLINELEN]
	Local work area for debug message.
static char	trbuf [3][20]
	Local buffer for triphone convertion.
static char	chbuf [30]
	Another local buffer for triphone convertion.
static char	nophone [1]
	Local buffer to indicate 'no phone'.
static int	trp_l
	Triphone cycle index.
static int	trp
	Triphone cycle index.
static int	trp_r
	Triphone cycle index.

---

説明

HTK形式の単語辞書データの読み込み

トライフォンモデルを用いる場合，モノフォン表記からトライフォンへの 変換およびモデルの存在チェックはこの辞書読み込み時に行なわれます．

作者:

Akinobu LEE

日付:

Fri Feb 18 19:43:06 2005

Revision:

1.10

voca_load_htkdict.c で定義されています。

---

関数

char* cycle_triphone

(

char *

p

)

Return string of triphone name composed from last 3 call.

引数:

p	[in] next phone string

戻り値:

the composed triphone name, or NULL on end.

voca_load_htkdict.c の 80 行で定義されています。

参照元 cycle_triphone_flush(), new_str2phseq(), voca_load_htkdict_line(), voca_load_wordlist_line(), と voca_mono2tri().

char* cycle_triphone_flush

(

)

Flush the triphone buffer and return the last biphone.

戻り値:

the composed last bi-phone name.

voca_load_htkdict.c の 126 行で定義されています。

参照元 new_str2phseq(), voca_load_htkdict_line(), voca_load_wordlist_line(), と voca_mono2tri().

static void add_to_error	(	WORD_INFO *	winfo,
		char *	name
	)		[static]

Add a triphone name to the missing error list in WORD_INFO.

引数:

winfo	[i/o] word dictionary to add the error phone to error list
name	[in] phone name to be added

voca_load_htkdict.c の 138 行で定義されています。

参照元 voca_load_htkdict_line().

static void callback_list_error

(

void *

x

)

[static]

Traverse callback function to output a error phone.

引数:

x	[in] error phone string of the node

voca_load_htkdict.c の 161 行で定義されています。

参照元 list_error().

static void list_error

(

WORD_INFO *

winfo

)

[static]

Output all error phones appeared while readin a word dictionary.

引数:

winfo

[in] word dictionary data

voca_load_htkdict.c の 173 行で定義されています。

参照元 voca_load_end().

void voca_set_stats

(

WORD_INFO *

winfo

)

Parse a word dictionary and set the maximum state length per word.

引数:

winfo

[i/o]

voca_load_htkdict.c の 186 行で定義されています。

参照元 voca_append(), と voca_load_end().

void voca_load_start	(	WORD_INFO *	winfo,
		HTK_HMM_INFO *	hmminfo,
		boolean	ignore_tri_conv
	)

Start loading a dictionary.

See voca_load_htkdict() for an example of using this function.

引数:

winfo	[i/o] dictionary data where the data will be loaded
hmminfo	[in] phoneme HMM definition
ignore_tri_conv	[in] if TRUE, skip triphone conversion while loading

voca_load_htkdict.c の 228 行で定義されています。

参照元 voca_load_htkdict(), voca_load_htkdict_fp(), voca_load_wordlist(), と voca_load_wordlist_fp().

boolean voca_load_line	(	char *	buf,
		WORD_INFO *	winfo,
		HTK_HMM_INFO *	hmminfo
	)

Load a line from buffer and set parameters to the dictionary.

See voca_load_htkdict() for an example of using this function.

引数:

buf	[in] input buffer containing a word entry
winfo	[i/o] word dictionary to append the entry
hmminfo	[in] phoneme HMM definition

戻り値:

TRUE when successfully read, or FALSE on encountered end of dictionary. When an error occurs, this function will set winfo->ok_flag to FALSE.

voca_load_htkdict.c の 255 行で定義されています。

参照元 initialize_dict(), voca_append_htkdict(), voca_load_htkdict(), と voca_load_htkdict_fp().

boolean voca_load_end

(

WORD_INFO *

winfo

)

End loading dictionary entries.

It calculates some statistics for the read entries, outputs errors if encountered while the last loading, and returns with status whether an error occured while loading.

引数:

winfo

[i/o] word dictionary just read by voca_load_line() calls

戻り値:

TRUE when no error has been occured during loading, or FALSE if an error occured.

voca_load_htkdict.c の 284 行で定義されています。

参照元 initialize_dict(), voca_append_htkdict(), voca_load_htkdict(), voca_load_htkdict_fp(), voca_load_wordlist(), と voca_load_wordlist_fp().

boolean voca_load_htkdict	(	FILE *	fp,
		WORD_INFO *	winfo,
		HTK_HMM_INFO *	hmminfo,
		boolean	ignore_tri_conv
	)

Top function to read word dictionary via file pointer (gzip enabled)

引数:

fp	[in] file pointer
winfo	[out] pointer to word dictionary to store the read data.
hmminfo	[in] HTK HMM definition data. if NULL, phonemes are ignored.
ignore_tri_conv	[in] TRUE if triphone conversion is ignored

戻り値:

TRUE on success, FALSE on any error word.

voca_load_htkdict.c の 305 行で定義されています。

参照元 init_voca().

boolean voca_load_htkdict_fp	(	FILE *	fp,
		WORD_INFO *	winfo,
		HTK_HMM_INFO *	hmminfo,
		boolean	ignore_tri_conv
	)

Top function to read word dictionary via normal file pointer.

引数:

fp	[in] file pointer
winfo	[out] pointer to word dictionary to store the read data.
hmminfo	[in] HTK HMM definition data. if NULL, phonemes are ignored.
ignore_tri_conv	[in] TRUE if triphone conversion is ignored

戻り値:

TRUE on success, FALSE on any error word.

voca_load_htkdict.c の 330 行で定義されています。

boolean voca_append_htkdict	(	char *	entry,
		WORD_INFO *	winfo,
		HTK_HMM_INFO *	hmminfo,
		boolean	ignore_tri_conv
	)

Append a single entry to the existing word dictionary.

引数:

entry	[in] dictionary entry string to be appended.
winfo	[out] pointer to word dictionary to append the data.
hmminfo	[in] HTK HMM definition data. if NULL, phonemes are ignored.
ignore_tri_conv	[in] TRUE if triphone conversion is ignored

戻り値:

TRUE on success, FALSE on any error word.

voca_load_htkdict.c の 354 行で定義されています。

参照元 initialize_dict().

boolean voca_load_htkdict_line	(	char *	buf,
		WORD_ID *	vnum_p,
		int	linenum,
		WORD_INFO *	winfo,
		HTK_HMM_INFO *	hmminfo,
		boolean	do_conv,
		boolean *	ok_flag
	)

Sub function to Add a dictionary entry line to the word dictionary.

引数:

buf	[i/o] buffer to hold the input string, will be modified in this function
vnum_p	[in] current number of words in winfo
linenum	[in] current line number of the input
winfo	[out] pointer to word dictionary to append the data.
hmminfo	[in] HTK HMM definition data. if NULL, phonemes are ignored.
do_conv	[in] TRUE if performing triphone conversion
ok_flag	[out] will be set to FALSE if an error occured for this input.

戻り値:

FALSE if buf == "DICEND", else TRUE will be returned.

voca_load_htkdict.c の 374 行で定義されています。

参照元 voca_load_line().

boolean voca_mono2tri	(	WORD_INFO *	winfo,
		HTK_HMM_INFO *	hmminfo
	)

Convert whole words in word dictionary to word-internal triphone.

Normally triphone conversion will be performed directly when reading dictionary file. This function is for post conversion only.

引数:

winfo	[i/o] word dictionary information
hmminfo	[in] HTK HMM definition

戻り値:

TRUE on success, FALSE on failure.

voca_load_htkdict.c の 603 行で定義されています。

boolean voca_append	(	WORD_INFO *	dstinfo,
		WORD_INFO *	srcinfo,
		int	coffset,
		int	woffset
	)

Append one word dictionary to other, for multiple grammar handling.

Assumes that the same HMM definition is used on both word dictionary.

引数:

dstinfo	[i/o] word dictionary
srcinfo	[in] word dictionary to be appended to dst
coffset	[in] category id offset in dst where the new data should be stored
woffset	[in] word id offset in dst where the new data should be stored

voca_load_htkdict.c の 644 行で定義されています。

参照元 multigram_add_words_to_grammar(), multigram_append_to_global(), と multigram_update().