Front-end Specification of XISL

Transcription

1 Front-end Specification of XISL Input Modalities The attributes of <input> element are,, and so on. The attribute specifies the of input, and the attribute specifies the input. Input mode is written in the element contained in the <input> element. mode dtmf push digit,character speech recognize command, data, speaker, emotion, pointing l_click, r_click, kyeboard press DTMF target match return dtmf push Specify a DTMF grammar Specify a path to an available grammar rule Variables to hold DTMF s Recognition modes The author can specify one of the following two modes. digit mode character mode Example: <input = dtmf = push target= grammar.gxml match= /grammar/goods_select return= number > <param ="mode">digit </param> </input> In this example, the number pushed by a user is assigned to the variable number.

2 Speech target match return speech recognize Specify a speech grammar Specify a path to an available grammar rule Variables to hold speech contents Recognition modes The author can specify one of the following four modes. command data speaker emotion Mode can be selected (changed) in the element contained in the <input> element. Example: <input = speech = recognize target= grammar.gxml match= /grammar/goods return= goods_ > <param ="mode"> data </param> </input> In this example, the speech word (the of the goods) is assigned to the variable goods_. Keyboard target match return keyboard press Specify a displayed XML file Specify a path to the root node of the XML file Variables to hold pressed key

3 Pointing target match return l_click r_click Three variables to hold: ld_click 1. of the target rd_click 2. abscissa of the point pointing over out l_drag Specify an XML file containing target element Specify a path to the target element of the XML file 3. ordinate of the point Six variables to hold: 1. of the target 2. of the element on the destination point 3. abscissa of start point r_drag 4. ordinate of start point 5. abscissa of destination point 6. ordinate of destination point

4 Output Modalities mode window open, close, speech play, stop, TTS, rec_speech, video play, stop, audio play, stop, agent move, speak, Window window_ of the window window_ of the window ( normal or modal ) open URI of the displayed page position position of the window (see move ) width width of the window height height of the window navigate window_ of the window URI of the newly displayed page window close maximize minimize window_ of the window restore window_ of the window resize width width of the resized window height height of the resized window window_ of the window move position position of the window ( center, left-top, right-top, left-bottom, right-bottom )

5 Speech TTS mode mode TTS speech_text Spoken text alphabet_flag true : Read as word false : Read as characters speech num_flag true : Read as digits false : Read as a number speed 0 (slow) to 23 (fast) volume 0 (quiet) to (loud) speaker speaker ( man, woman, ) emotion emotion ( normal, angry, ) rec_speech mode speech mode volume rec_speech URI of the speech file 0 (quiet) to (loud)

6 Video open_file video ID URI of the video file video video ID Audio open_file audio ID URI of the audio file audio audio ID

7 Anthropomorphic Agent create agent_file agent file to display show hide delete move (1) ax ay object abscissa of the destination point ordinate of the destination point path to the destination XML element agent (2) position move to center, left, or right of the XML element action action_ action balloon balloon_text text to display in the balloon speak speech_text spoken text change_voice voice of the character (e.g. boy, girl, robot, )