Mm. So  So  Yeah. So , my uh presentation is about trend-watching. Uh , I did some trend-watching. It's very important to uh keep up with latest trends.  'Cause if you don't , you won't sell. So , well how we did do that ? Uh , well we made an investigation of the market , by Trendwatchers. They uh watch in uh cities like uh Paris and Milan. Of course , well known for their uh trend  uh trends. And well , uh what did you find ? Uh , we have two groups , young and trendy , and the old and rich. Well th and the young and trendy , they uh they starting to like uh fruit and vegetables uh as a theme for n uh clothes , shoes , and also uh products. And um , material ? That should feel  have uh a spongy feeling. And to get a feeling for what it is , uh here is an image of it. Then the old and rich. They like uh dark colours , and simple , recognisable shapes.

And um , they also like uh familiar material , uh especially wood. Now , another picture.

To get a feeling for this. Well , uh then already come to my personal preferences. We uh aim at the younger market. So , we should also be uh look at their uh trends. However , with trends it's always if there's  it's now. It it it might last one year , and next year it be  uh can be totally different. And I think we want to sell our product for longer than one year. So , we m must not just only look at what the trend is now , as it might be totally different next year. So , that's uh one thing to keep in mind.


And um , they also like uh familiar material , uh especially wood. Now , another picture.

To get a feeling for this. Well , uh then already come to my personal preferences. We uh aim at the younger market. So , we should also be uh look at their uh trends. However , with trends it's always if there's  it's now. It it it might last one year , and next year it be  uh can be totally different. And I think we want to sell our product for longer than one year. So , we m must not just only look at what the trend is now , as it might be totally different next year. So , that's uh one thing to keep in mind.


To get a feeling for this. Well , uh then already come to my personal preferences. We uh aim at the younger market. So , we should also be uh look at their uh trends. However , with trends it's always if there's  it's now. It it it might last one year , and next year it be  uh can be totally different. And I think we want to sell our product for longer than one year. So , we m must not just only look at what the trend is now , as it might be totally different next year. So , that's uh one thing to keep in mind.


So now , it's uh   Ah , let's see. Now , w we have to decide  Well , we have to decide on the concept. So , we have to look at  'S next. Components and user interface concept. So  Now , we have to make some concept. Maybe one of you can paint it on the board. First , uh user interface.


So now , it's uh   Ah , let's see. Now , w we have to decide  Well , we have to decide on the concept. So , we have to look at  'S next. Components and user interface concept. So  Now , we have to make some concept. Maybe one of you can paint it on the board. First , uh user interface.

Uh , uh-uh. How w how we how we make it ? Uh


Uh , uh-uh. How w how we how we make it ? Uh

Shouldn't we first discuss about like what w we all


Shouldn't we first discuss about like what w we all


Shouldn't we first discuss about like what w we all

Yeah , but maybe we can paint it. Uh , what do we want ?


Yeah , but maybe we can paint it. Uh , what do we want ?


Something like this ? Or  Shapes or  What do we need ?


We have this , and we had the idea of an um a more uh uh uh like sh in the shape of your hand.


M like  Yeah I can't dr I can't draw it.


I'm not a designer. It's more  three D_. Like , um when you have a part here. This is the remote control. And then you have something like th this under it. So , it's easier to get it like this.


Buttons on top of it. And here. The scrolling. You can do it with your thumb.


Buttons on top of it. And here. The scrolling. You can do it with your thumb.

But but i that's the only scroll uh button on it then ?


Buttons on top of it. And here. The scrolling. You can do it with your thumb.

But but i that's the only scroll uh button on it then ?

But now we use one scroll button and the other one is here. One till uh uh zero till nine.


But but i that's the only scroll uh button on it then ?

But now we use one scroll button and the other one is here. One till uh uh zero till nine.


But but i that's the only scroll uh button on it then ?

But now we use one scroll button and the other one is here. One till uh uh zero till nine.

But , well there one for the sound and one for the channels.


But now we use one scroll button and the other one is here. One till uh uh zero till nine.

But , well there one for the sound and one for the channels.


But , well there one for the sound and one for the channels.


If uh  'Kay c If we do  If we use one , then we'll have just a switch on it , and you'll just switch it , and now it's the sound to switch back


If we have a menu , uh how do we uh choose other options ?


If we have a menu , uh how do we uh choose other options ?

with the menu uh button. And then you also can scroll uh scroll in it. Just not like all the other ones , with uh this thing , and uh here an arrow , here an arrow , here an arrow , here an arrow.


If we have a menu , uh how do we uh choose other options ?

with the menu uh button. And then you also can scroll uh scroll in it. Just not like all the other ones , with uh this thing , and uh here an arrow , here an arrow , here an arrow , here an arrow.

Because uh , from h hundred uh  remote controls , ninety nine have it.


with the menu uh button. And then you also can scroll uh scroll in it. Just not like all the other ones , with uh this thing , and uh here an arrow , here an arrow , here an arrow , here an arrow.

Because uh , from h hundred uh  remote controls , ninety nine have it.

But if we don't have a L_C_D_ we don't have a menu.


Because uh , from h hundred uh  remote controls , ninety nine have it.

But if we don't have a L_C_D_ we don't have a menu.


Because uh , from h hundred uh  remote controls , ninety nine have it.

But if we don't have a L_C_D_ we don't have a menu.

Uh , then we have it on the T_V_ , the menu.


But if we don't have a L_C_D_ we don't have a menu.

Uh , then we have it on the T_V_ , the menu.


Uh , then we have it on the T_V_ , the menu.

Yeah , but  again maybe th How do we know the T_V_ can handle it ?


Yeah , but  again maybe th How do we know the T_V_ can handle it ?

I don't know. It's like some sort of uh teletext option , but we don't have teletext.


I don't know. It's like some sort of uh teletext option , but we don't have teletext.

And if we put an L_C_D_ thing on it , then the costs will uh be much higher.


I don't know. It's like some sort of uh teletext option , but we don't have teletext.

And if we put an L_C_D_ thing on it , then the costs will uh be much higher.

Okay , we make two concepts. One with L_C_D_. One without L_C_D_.


And if we put an L_C_D_ thing on it , then the costs will uh be much higher.

Okay , we make two concepts. One with L_C_D_. One without L_C_D_.

'Kay. But you all like this kind of thing. Uh


Okay , we make two concepts. One with L_C_D_. One without L_C_D_.

'Kay. But you all like this kind of thing. Uh


'Kay. But you all like this kind of thing. Uh


And this has to be harder , because when it falls , it mu mu must not burst. Or some kind of rubber around it.


And this has to be harder , because when it falls , it mu mu must not burst. Or some kind of rubber around it.

And you can and you can uh make the the power button as a trigger.


And you can and you can uh make the the power button as a trigger.


No.  But when you handle it , you put it on and off.


Now , second concept. One with L_C_D_ , one without L_C_D_. Then uh  Paint it.


Now , second concept. One with L_C_D_ , one without L_C_D_. Then uh  Paint it.

One with two scroll buttons and one with without. Yeah. Uh , one with a with a menu , and one without a menu.


One with two scroll buttons and one with without. Yeah. Uh , one with a with a menu , and one without a menu.


One with two scroll buttons and one with without. Yeah. Uh , one with a with a menu , and one without a menu.

And the one with with a menu has an L_C_D_.


And the one with with a menu has an L_C_D_.


And the one with with a menu has an L_C_D_.

Do I have to do everything. Blank. You have   Not so difficult.


Do I have to do everything. Blank. You have   Not so difficult.


Do I have to do everything. Blank. You have   Not so difficult.

But if you put  push the the menu button


Do I have to do everything. Blank. You have   Not so difficult.

But if you put  push the the menu button

Uh , that's the menu. There for the L_C_D_ screen.


But if you put  push the the menu button

Uh , that's the menu. There for the L_C_D_ screen.

Yeah , wh what  Yes , but you don't know which of the scroll buttons you have to choose.


Uh , that's the menu. There for the L_C_D_ screen.

Yeah , wh what  Yes , but you don't know which of the scroll buttons you have to choose.


Yeah , wh what  Yes , but you don't know which of the scroll buttons you have to choose.

Mm-hmm. One that way. And one that way. So  Then it depends on the cost. S On and off.


Mm-hmm. One that way. And one that way. So  Then it depends on the cost. S On and off.

But is it easy to use ? When you have it on your left side , and


Mm-hmm. One that way. And one that way. So  Then it depends on the cost. S On and off.

But is it easy to use ? When you have it on your left side , and

When it's not too big. Just like a a phone.


But is it easy to use ? When you have it on your left side , and

When it's not too big. Just like a a phone.

M uh yeah , maybe it's better if the uh scroll-wheels are um


When it's not too big. Just like a a phone.

M uh yeah , maybe it's better if the uh scroll-wheels are um


M uh yeah , maybe it's better if the uh scroll-wheels are um


Like , you have the menu button in between uh


Like , you have the menu button in between uh

Yeah. On the left a scroll button , and on the right a scroll button. But would it be easy to use then ? If it's like   you have a big uh


Like , you have the menu button in between uh

Yeah. On the left a scroll button , and on the right a scroll button. But would it be easy to use then ? If it's like   you have a big uh

Very good. Is it better ? When you uh  the menu , you have to go there there there there.


Like , you have the menu button in between uh

Yeah. On the left a scroll button , and on the right a scroll button. But would it be easy to use then ? If it's like   you have a big uh

Very good. Is it better ? When you uh  the menu , you have to go there there there there.

I also think this concept is not what the young people were looking for.


Yeah. On the left a scroll button , and on the right a scroll button. But would it be easy to use then ? If it's like   you have a big uh

Very good. Is it better ? When you uh  the menu , you have to go there there there there.

I also think this concept is not what the young people were looking for.


Very good. Is it better ? When you uh  the menu , you have to go there there there there.

I also think this concept is not what the young people were looking for.

They were like round curves , uh different uh


I also think this concept is not what the young people were looking for.

They were like round curves , uh different uh

Yeah , okay. That's that's the outside. But now the


They were like round curves , uh different uh

Yeah , okay. That's that's the outside. But now the


Yeah , okay. That's that's the outside. But now the


Think we have we have now two buttons missing. The uh um  The mute button.


Think we have we have now two buttons missing. The uh um  The mute button.

We have two buttons missing. The mute button. And um , the  to to uh  have to uh  numbers


We have two buttons missing. The mute button. And um , the  to to uh  have to uh  numbers


Personally , I think two scroll buttons uh aren't easy to handle.


Personally , I think two scroll buttons uh aren't easy to handle.

Yeah but on the menu that's not uh easy.


Yeah but on the menu that's not uh easy.


Yeah but on the menu that's not uh easy.

Then you go down , you switch , you go into the right , you switch , you go down.


Then you go down , you switch , you go into the right , you switch , you go down.


Then you go down , you switch , you go into the right , you switch , you go down.

Uh , then you can also have like uh th um


Uh , then you can also have like uh th um


Uh , then you can also have like uh th um

Yeah. But is it uh  Does that break , a joystick ? Or a small one just like in a laptop.


Yeah. But is it uh  Does that break , a joystick ? Or a small one just like in a laptop.

Yeah like in a laptop , s uh s some sort of thing. A little bit bigger , with easier thi


Yeah. But is it uh  Does that break , a joystick ? Or a small one just like in a laptop.

Yeah like in a laptop , s uh s some sort of thing. A little bit bigger , with easier thi

Mean , it's better. But how expensive it is ?


Yeah like in a laptop , s uh s some sort of thing. A little bit bigger , with easier thi

Mean , it's better. But how expensive it is ?


Mean , it's better. But how expensive it is ?


Or no scroll uh things. Just a shape. And   No , no. It won't work.


Or no scroll uh things. Just a shape. And   No , no. It won't work.

For the young peoples I think scroll button's good.


For the young peoples I think scroll button's good.


Yeah , but is it  That's not expensive than uh  Joystick is better. A small one.


Yeah , but is it  That's not expensive than uh  Joystick is better. A small one.

A small one like this , like a Nintendo uh k


A small one like this , like a Nintendo uh k


No , no , no. I mean the the shape of the remote control.


No , no , no. I mean the the shape of the remote control.

So  Maybe , if it's possible ,  it's not too expensive , I think a joystick is better.


So  Maybe , if it's possible ,  it's not too expensive , I think a joystick is better.


So  Maybe , if it's possible ,  it's not too expensive , I think a joystick is better.

And on the L_C_D_ , how much it costs ? Uh , it costs extra ?


And on the L_C_D_ , how much it costs ? Uh , it costs extra ?


And on the L_C_D_ , how much it costs ? Uh , it costs extra ?

It's more expensive or less expensive , huh ?


And on the L_C_D_ , how much it costs ? Uh , it costs extra ?

It's more expensive or less expensive , huh ?

Yeah we  I think you get it. So , after this meeting you have half an hour to uh fix it.


It's more expensive or less expensive , huh ?

Yeah we  I think you get it. So , after this meeting you have half an hour to uh fix it.


Yeah we  I think you get it. So , after this meeting you have half an hour to uh fix it.

I got my personal costs. I I don't I don't know the costs.


I got my personal costs. I I don't I don't know the costs.


I got my personal costs. I I don't I don't know the costs.

Okay. So , do we have other concepts ? Then for the components , we use a normal battery. Then it's  Ch cheapest way , I think.


Okay. So , do we have other concepts ? Then for the components , we use a normal battery. Then it's  Ch cheapest way , I think.


Okay. So , do we have other concepts ? Then for the components , we use a normal battery. Then it's  Ch cheapest way , I think.

Yeah , or the or the kinetic uh with normal battery.


Okay. So , do we have other concepts ? Then for the components , we use a normal battery. Then it's  Ch cheapest way , I think.

Yeah , or the or the kinetic uh with normal battery.

No , no kinetic. Kinetic is uh ch makes it more expensive.


Yeah , or the or the kinetic uh with normal battery.

No , no kinetic. Kinetic is uh ch makes it more expensive.

Yeah , I think it's uh , yeah , more expensive. Yeah.


No , no kinetic. Kinetic is uh ch makes it more expensive.

Yeah , I think it's uh , yeah , more expensive. Yeah.


Yeah , I think it's uh , yeah , more expensive. Yeah.


If we use a scroll , then we have the uh regular chip. If we don't use a scroll , then we can use the simple chip.


If we use a scroll , then we have the uh regular chip. If we don't use a scroll , then we can use the simple chip.

And uh , we  If you use the L_C_D_ , we have to


And uh , we  If you use the L_C_D_ , we have to


So , depends on the L_C_D_ and the scroll.


So , depends on the L_C_D_ and the scroll.

If we  No okay scroll-wheel. So , I have this. So , it will be uh the advanced chip , or the uh regu uh or the regular chip.


If we  No okay scroll-wheel. So , I have this. So , it will be uh the advanced chip , or the uh regu uh or the regular chip.

Okay. So , uh the shapes of the design depends on the L_C_D_ and  But , it has to be small. I think.


If we  No okay scroll-wheel. So , I have this. So , it will be uh the advanced chip , or the uh regu uh or the regular chip.

Okay. So , uh the shapes of the design depends on the L_C_D_ and  But , it has to be small. I think.

Or shall we just put it on the pistol thing ? And then just put also on L_C_D_ on it ?


If we  No okay scroll-wheel. So , I have this. So , it will be uh the advanced chip , or the uh regu uh or the regular chip.

Okay. So , uh the shapes of the design depends on the L_C_D_ and  But , it has to be small. I think.

Or shall we just put it on the pistol thing ? And then just put also on L_C_D_ on it ?

If you have pistol , it  L_C_D_'s not easy. Y y  Yeah but


Okay. So , uh the shapes of the design depends on the L_C_D_ and  But , it has to be small. I think.

Or shall we just put it on the pistol thing ? And then just put also on L_C_D_ on it ?

If you have pistol , it  L_C_D_'s not easy. Y y  Yeah but


Or shall we just put it on the pistol thing ? And then just put also on L_C_D_ on it ?

If you have pistol , it  L_C_D_'s not easy. Y y  Yeah but


If you have pistol , it  L_C_D_'s not easy. Y y  Yeah but


k Yeah , but but then you have it. Like , th if you have pistol , you have it so. And the screen is


k Yeah , but but then you have it. Like , th if you have pistol , you have it so. And the screen is

Well , then you have to keep it this way to look at the screen.


k Yeah , but but then you have it. Like , th if you have pistol , you have it so. And the screen is

Well , then you have to keep it this way to look at the screen.

If you have a joystick on  No , if you have like uh an uh uh a ni a uh Playstation uh game controller.


Well , then you have to keep it this way to look at the screen.

If you have a joystick on  No , if you have like uh an uh uh a ni a uh Playstation uh game controller.


Well , then you have to keep it this way to look at the screen.

If you have a joystick on  No , if you have like uh an uh uh a ni a uh Playstation uh game controller.

And you move up , f forward , down , left. Then you have uh just , yeah , a little bit curved. It's not just uh  straight.


If you have a joystick on  No , if you have like uh an uh uh a ni a uh Playstation uh game controller.

And you move up , f forward , down , left. Then you have uh just , yeah , a little bit curved. It's not just uh  straight.


And you move up , f forward , down , left. Then you have uh just , yeah , a little bit curved. It's not just uh  straight.

That's how we use it. That's why they make joysticks like that , I think.


That's how we use it. That's why they make joysticks like that , I think.


If we have uh then something standing here , with the L_C_D_.


Hard plastic , uh the shape , and around it hard uh around it rubber. And the uh the hand shape is also rubber.


uh , th the ease of use wasn't uh the most important uh aspect of it.


Okay. Then this is the design. And the buttons are on the next page. So , depends on the cost. So ,


Yeah , we had a long discussion about how much w how easy we want to make it for people to bleep things out. So  Morgan wants to make it hard.

Did  did  did it  ? I didn't even check yesterday whether it was moving.


Did  did  did it  ? I didn't even check yesterday whether it was moving.

It didn't move yesterday either when I started it.


Did  did  did it  ? I didn't even check yesterday whether it was moving.

It didn't move yesterday either when I started it.

So I don't know if it doesn't like both of us


It didn't move yesterday either when I started it.

So I don't know if it doesn't like both of us


So I don't know if it doesn't like both of us

You know , I discovered something yesterday on these , um , wireless ones.


You know , I discovered something yesterday on these , um , wireless ones.


You know , I discovered something yesterday on these , um , wireless ones.

You can tell if it 's picking up  breath noise and stuff.


You can tell if it 's picking up  breath noise and stuff.

Yeah , it has a little indicator on it  on the AF.


You can tell if it 's picking up  breath noise and stuff.

Yeah , it has a little indicator on it  on the AF.

Mm - hmm. So if you  yeah , if you breathe under  breathe and then you see AF go off , then you know  it 's p picking up your mouth noise.


You can tell if it 's picking up  breath noise and stuff.

Yeah , it has a little indicator on it  on the AF.

Mm - hmm. So if you  yeah , if you breathe under  breathe and then you see AF go off , then you know  it 's p picking up your mouth noise.

Oh , that 's good. Cuz we have a lot of breath noises.


Yeah , it has a little indicator on it  on the AF.

Mm - hmm. So if you  yeah , if you breathe under  breathe and then you see AF go off , then you know  it 's p picking up your mouth noise.

Oh , that 's good. Cuz we have a lot of breath noises.


Mm - hmm. So if you  yeah , if you breathe under  breathe and then you see AF go off , then you know  it 's p picking up your mouth noise.

Oh , that 's good. Cuz we have a lot of breath noises.

In fact , if you listen to just the channels of people not talking , it 's like " @ @ ". It 's very disgust


Oh , that 's good. Cuz we have a lot of breath noises.

In fact , if you listen to just the channels of people not talking , it 's like " @ @ ". It 's very disgust

What ? Did you see Hannibal recently or something ?


In fact , if you listen to just the channels of people not talking , it 's like " @ @ ". It 's very disgust

What ? Did you see Hannibal recently or something ?

Sorry. Exactly. It 's very disconcerting. OK. So , um ,


In fact , if you listen to just the channels of people not talking , it 's like " @ @ ". It 's very disgust

What ? Did you see Hannibal recently or something ?

Sorry. Exactly. It 's very disconcerting. OK. So , um ,

I was gonna try to get out of here , like , in half an hour , um , cuz I really appreciate people coming , and  the main thing that I was gonna ask people to help with today is  to give input on what kinds of database format we should  use in starting to link up things like word transcripts and annotations of word transcripts , so anything that transcribers or discourse coders or whatever put in the signal ,  with time - marks for , like , words and phone boundaries and all the stuff we get out of the forced alignments and the recognizer. So , we have this , um  I think a starting point is clearly the  the channelized  output of Dave Gelbart 's program , which Don brought a copy of ,


What ? Did you see Hannibal recently or something ?

Sorry. Exactly. It 's very disconcerting. OK. So , um ,

I was gonna try to get out of here , like , in half an hour , um , cuz I really appreciate people coming , and  the main thing that I was gonna ask people to help with today is  to give input on what kinds of database format we should  use in starting to link up things like word transcripts and annotations of word transcripts , so anything that transcribers or discourse coders or whatever put in the signal ,  with time - marks for , like , words and phone boundaries and all the stuff we get out of the forced alignments and the recognizer. So , we have this , um  I think a starting point is clearly the  the channelized  output of Dave Gelbart 's program , which Don brought a copy of ,

Yeah. Yeah , I 'm  I 'm familiar with that. I mean , we  I sort of already have developed an XML format for this sort of stuff.


Sorry. Exactly. It 's very disconcerting. OK. So , um ,

I was gonna try to get out of here , like , in half an hour , um , cuz I really appreciate people coming , and  the main thing that I was gonna ask people to help with today is  to give input on what kinds of database format we should  use in starting to link up things like word transcripts and annotations of word transcripts , so anything that transcribers or discourse coders or whatever put in the signal ,  with time - marks for , like , words and phone boundaries and all the stuff we get out of the forced alignments and the recognizer. So , we have this , um  I think a starting point is clearly the  the channelized  output of Dave Gelbart 's program , which Don brought a copy of ,

Yeah. Yeah , I 'm  I 'm familiar with that. I mean , we  I sort of already have developed an XML format for this sort of stuff.


I was gonna try to get out of here , like , in half an hour , um , cuz I really appreciate people coming , and  the main thing that I was gonna ask people to help with today is  to give input on what kinds of database format we should  use in starting to link up things like word transcripts and annotations of word transcripts , so anything that transcribers or discourse coders or whatever put in the signal ,  with time - marks for , like , words and phone boundaries and all the stuff we get out of the forced alignments and the recognizer. So , we have this , um  I think a starting point is clearly the  the channelized  output of Dave Gelbart 's program , which Don brought a copy of ,

Yeah. Yeah , I 'm  I 'm familiar with that. I mean , we  I sort of already have developed an XML format for this sort of stuff.


Yeah. Yeah , I 'm  I 'm familiar with that. I mean , we  I sort of already have developed an XML format for this sort of stuff.

And so the only question  is it the sort of thing that you want to use or not ? Have you looked at that ? I mean , I had a web page up.


And so the only question  is it the sort of thing that you want to use or not ? Have you looked at that ? I mean , I had a web page up.


And so the only question  is it the sort of thing that you want to use or not ? Have you looked at that ? I mean , I had a web page up.

I actually mostly need to be able to link up , or  I it 's  it 's a question both of what the representation is and


I actually mostly need to be able to link up , or  I it 's  it 's a question both of what the representation is and

You mean , this  I guess I am gonna be standing up and drawing on the board.


I actually mostly need to be able to link up , or  I it 's  it 's a question both of what the representation is and

You mean , this  I guess I am gonna be standing up and drawing on the board.

Um , so  so it definitely had that as a concept. So tha it has a single time - line ,


You mean , this  I guess I am gonna be standing up and drawing on the board.

Um , so  so it definitely had that as a concept. So tha it has a single time - line ,


Um , so  so it definitely had that as a concept. So tha it has a single time - line ,

and then you can have lots of different sections , each of which have I Ds attached to it , and then you can refer from other sections to those I Ds , if you want to. So that , um  so that you start with  with a time - line tag. " Time - line ". And then you have a bunch of times. I don't e I don't remember exactly what my notation was ,


Um , so  so it definitely had that as a concept. So tha it has a single time - line ,

and then you can have lots of different sections , each of which have I Ds attached to it , and then you can refer from other sections to those I Ds , if you want to. So that , um  so that you start with  with a time - line tag. " Time - line ". And then you have a bunch of times. I don't e I don't remember exactly what my notation was ,

Oh , I remember seeing an example of this.


and then you can have lots of different sections , each of which have I Ds attached to it , and then you can refer from other sections to those I Ds , if you want to. So that , um  so that you start with  with a time - line tag. " Time - line ". And then you have a bunch of times. I don't e I don't remember exactly what my notation was ,

Oh , I remember seeing an example of this.


Oh , I remember seeing an example of this.


Yeah , " T equals one point three two " , uh  And then I  I also had optional things like accuracy , and then " ID equals T one , uh , one seven ". And then ,  I also wanted to  to be i to be able to not specify specifically what the time was and just have a stamp.


Yeah , " T equals one point three two " , uh  And then I  I also had optional things like accuracy , and then " ID equals T one , uh , one seven ". And then ,  I also wanted to  to be i to be able to not specify specifically what the time was and just have a stamp.

Yeah , so these are arbitrary , assigned by a program , not  not by a user. So you have a whole bunch of those. And then somewhere la further down you might have something like an utterance tag which has " start equals T - seventeen , end equals T - eighteen ". So what that 's saying is , we know it starts at this particular time. We don't know when it ends.


Yeah , so these are arbitrary , assigned by a program , not  not by a user. So you have a whole bunch of those. And then somewhere la further down you might have something like an utterance tag which has " start equals T - seventeen , end equals T - eighteen ". So what that 's saying is , we know it starts at this particular time. We don't know when it ends.

Right ? But it ends at this T - eighteen , which may be somewhere else. We say there 's another utterance. We don't know what the t time actually is but we know that it 's the same time as this end time.


Right ? But it ends at this T - eighteen , which may be somewhere else. We say there 's another utterance. We don't know what the t time actually is but we know that it 's the same time as this end time.

You know , thirty - eight , whatever you want.


Right ? But it ends at this T - eighteen , which may be somewhere else. We say there 's another utterance. We don't know what the t time actually is but we know that it 's the same time as this end time.

You know , thirty - eight , whatever you want.

So you 're essentially defining a lattice.


You know , thirty - eight , whatever you want.

So you 're essentially defining a lattice.


So you 're essentially defining a lattice.

And then , uh  and then these also have I Ds. Right ? So you could  you could have some sort of other  other tag later in the file that would be something like , um , oh , I don't know ,  uh ,  " noise - type equals  door - slam ". You know ? And then , uh ,  you could either say " time equals a particular time - mark " or you could do other sorts of references. So  or  or you might have a prosody  " Prosody " right ? D ? T ? D ? T ? T ?


And then , uh  and then these also have I Ds. Right ? So you could  you could have some sort of other  other tag later in the file that would be something like , um , oh , I don't know ,  uh ,  " noise - type equals  door - slam ". You know ? And then , uh ,  you could either say " time equals a particular time - mark " or you could do other sorts of references. So  or  or you might have a prosody  " Prosody " right ? D ? T ? D ? T ? T ?

It 's an O instead of an I , but the D is good.


It 's an O instead of an I , but the D is good.

Um , you know , so you could have some sort of type here , and then you could have , um  the utterance that it 's referring to could be U - seventeen or something like that.


Um , you know , so you could have some sort of type here , and then you could have , um  the utterance that it 's referring to could be U - seventeen or something like that.

OK. So , I mean , that seems  that seems g great for all of the encoding of things with time and ,


Um , you know , so you could have some sort of type here , and then you could have , um  the utterance that it 's referring to could be U - seventeen or something like that.

OK. So , I mean , that seems  that seems g great for all of the encoding of things with time and ,

um  I  I guess my question is more , uh , what d what do you do with , say , a forced alignment ?


OK. So , I mean , that seems  that seems g great for all of the encoding of things with time and ,

um  I  I guess my question is more , uh , what d what do you do with , say , a forced alignment ?


um  I  I guess my question is more , uh , what d what do you do with , say , a forced alignment ?

I mean you 've got all these phone labels , and what do you do if you  just conceptually , if you get , um , transcriptions where the words are staying but the time boundaries are changing , cuz you 've got a new recognition output , or s sort of  what 's the , um , sequence of going from the waveforms that stay the same , the transcripts that may or may not change , and then the utterance which  where the time boundaries that may or may not change  ?


um  I  I guess my question is more , uh , what d what do you do with , say , a forced alignment ?

I mean you 've got all these phone labels , and what do you do if you  just conceptually , if you get , um , transcriptions where the words are staying but the time boundaries are changing , cuz you 've got a new recognition output , or s sort of  what 's the , um , sequence of going from the waveforms that stay the same , the transcripts that may or may not change , and then the utterance which  where the time boundaries that may or may not change  ?

Oh , that 's  That 's actually very nicely handled here because you could  you could  all you 'd have to change is the ,  um , time - stamps in the time - line without  without , uh , changing the I Ds.


I mean you 've got all these phone labels , and what do you do if you  just conceptually , if you get , um , transcriptions where the words are staying but the time boundaries are changing , cuz you 've got a new recognition output , or s sort of  what 's the , um , sequence of going from the waveforms that stay the same , the transcripts that may or may not change , and then the utterance which  where the time boundaries that may or may not change  ?

Oh , that 's  That 's actually very nicely handled here because you could  you could  all you 'd have to change is the ,  um , time - stamps in the time - line without  without , uh , changing the I Ds.

Um. And you 'd be able to propagate all of the  the information ?


I mean you 've got all these phone labels , and what do you do if you  just conceptually , if you get , um , transcriptions where the words are staying but the time boundaries are changing , cuz you 've got a new recognition output , or s sort of  what 's the , um , sequence of going from the waveforms that stay the same , the transcripts that may or may not change , and then the utterance which  where the time boundaries that may or may not change  ?

Oh , that 's  That 's actually very nicely handled here because you could  you could  all you 'd have to change is the ,  um , time - stamps in the time - line without  without , uh , changing the I Ds.

Um. And you 'd be able to propagate all of the  the information ?

Right. That 's , the who that 's why you do that extra level of indirection. So that you can just change the time - line.


Oh , that 's  That 's actually very nicely handled here because you could  you could  all you 'd have to change is the ,  um , time - stamps in the time - line without  without , uh , changing the I Ds.

Um. And you 'd be able to propagate all of the  the information ?

Right. That 's , the who that 's why you do that extra level of indirection. So that you can just change the time - line.

Except the time - line is gonna be huge. If you say


Um. And you 'd be able to propagate all of the  the information ?

Right. That 's , the who that 's why you do that extra level of indirection. So that you can just change the time - line.

Except the time - line is gonna be huge. If you say


Right. That 's , the who that 's why you do that extra level of indirection. So that you can just change the time - line.

Except the time - line is gonna be huge. If you say


Except the time - line is gonna be huge. If you say

suppose you have a phone - level alignment.


suppose you have a phone - level alignment.


suppose you have a phone - level alignment.

The  we  we have phone - level backtraces.


The  we  we have phone - level backtraces.

Yeah , this  I don't think I would do this for phone - level. I think for phone - level you want to use some sort of binary representation


Yeah , this  I don't think I would do this for phone - level. I think for phone - level you want to use some sort of binary representation

OK. So , if you were doing that and you had this sort of companion , uh , thing that gets called up for phone - level , uh , what would that look like ?


OK. So , if you were doing that and you had this sort of companion , uh , thing that gets called up for phone - level , uh , what would that look like ?


OK. So , if you were doing that and you had this sort of companion , uh , thing that gets called up for phone - level , uh , what would that look like ?

I would use just an existing  an existing way of doing it.


I would use just an existing  an existing way of doing it.

Mmm. But  but why not use it for phone - level ?


Mmm. But  but why not use it for phone - level ?

It 's just a matter of  it 's just a matter of it being bigger. But if you have  you know , barring memory limitations , or uh  I w I mean this is still the m


Mmm. But  but why not use it for phone - level ?

It 's just a matter of  it 's just a matter of it being bigger. But if you have  you know , barring memory limitations , or uh  I w I mean this is still the m

It 's parsing limitations. I don't want to have this text file that you have to read in the whole thing to do something very simple for.


It 's just a matter of  it 's just a matter of it being bigger. But if you have  you know , barring memory limitations , or uh  I w I mean this is still the m

It 's parsing limitations. I don't want to have this text file that you have to read in the whole thing to do something very simple for.

Oh , no. You would use it only  for  purposes where you actually want the phone - level information , I 'd imagine.


It 's just a matter of  it 's just a matter of it being bigger. But if you have  you know , barring memory limitations , or uh  I w I mean this is still the m

It 's parsing limitations. I don't want to have this text file that you have to read in the whole thing to do something very simple for.

Oh , no. You would use it only  for  purposes where you actually want the phone - level information , I 'd imagine.

So you could have some file that configures how much information you want in your  in your XML or something.


It 's parsing limitations. I don't want to have this text file that you have to read in the whole thing to do something very simple for.

Oh , no. You would use it only  for  purposes where you actually want the phone - level information , I 'd imagine.

So you could have some file that configures how much information you want in your  in your XML or something.


Oh , no. You would use it only  for  purposes where you actually want the phone - level information , I 'd imagine.

So you could have some file that configures how much information you want in your  in your XML or something.


So you could have some file that configures how much information you want in your  in your XML or something.


I  I am imagining you 'd have multiple versions of this depending on the information that you want.


I  I am imagining you 'd have multiple versions of this depending on the information that you want.

cuz th it does get very bush with  Right.


I  I am imagining you 'd have multiple versions of this depending on the information that you want.

cuz th it does get very bush with  Right.

Um , I 'm just  what I 'm wondering is whether  I think for word - level , this would be OK.


cuz th it does get very bush with  Right.

Um , I 'm just  what I 'm wondering is whether  I think for word - level , this would be OK.


Um , I 'm just  what I 'm wondering is whether  I think for word - level , this would be OK.


For lower than word - level , you 're talking about so much data that I just  I don't know. I don't know if that


For lower than word - level , you 're talking about so much data that I just  I don't know. I don't know if that

I mean , we actually have  So , one thing that Don is doing , is we 're  we 're running  For every frame , you get a pitch value ,


For lower than word - level , you 're talking about so much data that I just  I don't know. I don't know if that

I mean , we actually have  So , one thing that Don is doing , is we 're  we 're running  For every frame , you get a pitch value ,

and not only one pitch value but different kinds of pitch values


I mean , we actually have  So , one thing that Don is doing , is we 're  we 're running  For every frame , you get a pitch value ,

and not only one pitch value but different kinds of pitch values

Yeah , I mean , for something like that I would use P - file


and not only one pitch value but different kinds of pitch values

Yeah , I mean , for something like that I would use P - file


and not only one pitch value but different kinds of pitch values

Yeah , I mean , for something like that I would use P - file

or  or any frame - level stuff I would use P - file.


Yeah , I mean , for something like that I would use P - file

or  or any frame - level stuff I would use P - file.


or  or any frame - level stuff I would use P - file.

Uh , that 's a  well , or something like it. It 's ICS uh , ICSI has a format for frame - level representation of features. Um.


or  or any frame - level stuff I would use P - file.

Uh , that 's a  well , or something like it. It 's ICS uh , ICSI has a format for frame - level representation of features. Um.

OK. That you could call  that you would tie into this representation with like an ID.


Uh , that 's a  well , or something like it. It 's ICS uh , ICSI has a format for frame - level representation of features. Um.

OK. That you could call  that you would tie into this representation with like an ID.

Right. Right. Or  or there 's a  there 's a particular way in XML to refer to external resources.


OK. That you could call  that you would tie into this representation with like an ID.

Right. Right. Or  or there 's a  there 's a particular way in XML to refer to external resources.

So you would say " refer to this external file ". Um , so that external file wouldn't be in


Right. Right. Or  or there 's a  there 's a particular way in XML to refer to external resources.

So you would say " refer to this external file ". Um , so that external file wouldn't be in


So you would say " refer to this external file ". Um , so that external file wouldn't be in

But what  what 's the advantage of doing that versus just putting it into this format ?


So you would say " refer to this external file ". Um , so that external file wouldn't be in

But what  what 's the advantage of doing that versus just putting it into this format ?

More compact , which I think is  is better.


But what  what 's the advantage of doing that versus just putting it into this format ?

More compact , which I think is  is better.


More compact , which I think is  is better.

I mean these are long meetings and with  for every frame ,


I mean these are long meetings and with  for every frame ,

You don't want to do it with that  Anything at frame - level you had better encode binary


You don't want to do it with that  Anything at frame - level you had better encode binary

Or you just compre I mean , I like text formats. Um , b you can always , uh , G - zip them , and , um , you know , c decompress them on the fly if y if space is really a concern.


Or you just compre I mean , I like text formats. Um , b you can always , uh , G - zip them , and , um , you know , c decompress them on the fly if y if space is really a concern.

Yeah , I was thi I was thinking the advantage is that we can share this with other people.


Or you just compre I mean , I like text formats. Um , b you can always , uh , G - zip them , and , um , you know , c decompress them on the fly if y if space is really a concern.

Yeah , I was thi I was thinking the advantage is that we can share this with other people.

Well , but if you 're talking about one per frame , you 're talking about gigabyte - size files. You 're gonna actually run out of space in your filesystem for one file.


Or you just compre I mean , I like text formats. Um , b you can always , uh , G - zip them , and , um , you know , c decompress them on the fly if y if space is really a concern.

Yeah , I was thi I was thinking the advantage is that we can share this with other people.

Well , but if you 're talking about one per frame , you 're talking about gigabyte - size files. You 're gonna actually run out of space in your filesystem for one file.

These are big files. These are really  I mean


Yeah , I was thi I was thinking the advantage is that we can share this with other people.

Well , but if you 're talking about one per frame , you 're talking about gigabyte - size files. You 're gonna actually run out of space in your filesystem for one file.

These are big files. These are really  I mean

Right ? Because you have a two - gigabyte limit on most O Ss.


Well , but if you 're talking about one per frame , you 're talking about gigabyte - size files. You 're gonna actually run out of space in your filesystem for one file.

These are big files. These are really  I mean

Right ? Because you have a two - gigabyte limit on most O Ss.

Right , OK. I would say  OK , so frame - level is probably not a good idea. But for phone - level stuff it 's perfectly


These are big files. These are really  I mean

Right ? Because you have a two - gigabyte limit on most O Ss.

Right , OK. I would say  OK , so frame - level is probably not a good idea. But for phone - level stuff it 's perfectly


Right ? Because you have a two - gigabyte limit on most O Ss.

Right , OK. I would say  OK , so frame - level is probably not a good idea. But for phone - level stuff it 's perfectly

Like phones , or syllables , or anything like that.


Right , OK. I would say  OK , so frame - level is probably not a good idea. But for phone - level stuff it 's perfectly

Like phones , or syllables , or anything like that.

Phones are every five frames though , so. Or something like that.


Like phones , or syllables , or anything like that.

Phones are every five frames though , so. Or something like that.

But  but  but most of the frames are actually not speech. So , you know , people don't  v Look at it , words times the average  The average number of phones in an English word is , I don't know ,  five maybe ?


Phones are every five frames though , so. Or something like that.

But  but  but most of the frames are actually not speech. So , you know , people don't  v Look at it , words times the average  The average number of phones in an English word is , I don't know ,  five maybe ?

So , look at it , t number of words times five. That 's not  that not


But  but  but most of the frames are actually not speech. So , you know , people don't  v Look at it , words times the average  The average number of phones in an English word is , I don't know ,  five maybe ?

So , look at it , t number of words times five. That 's not  that not

Oh , so you mean pause phones take up a lot of the  long pause phones.


So , look at it , t number of words times five. That 's not  that not

Oh , so you mean pause phones take up a lot of the  long pause phones.


Oh , so you mean pause phones take up a lot of the  long pause phones.


Yeah. OK. That 's true. But you do have to keep them in there. Y yeah.


Yeah. OK. That 's true. But you do have to keep them in there. Y yeah.

So I think it  it 's debatable whether you want to do phone - level in the same thing.


Yeah. OK. That 's true. But you do have to keep them in there. Y yeah.

So I think it  it 's debatable whether you want to do phone - level in the same thing.

But I think , a anything at frame - level , even P - file , is too verbose.


So I think it  it 's debatable whether you want to do phone - level in the same thing.

But I think , a anything at frame - level , even P - file , is too verbose.


But I think , a anything at frame - level , even P - file , is too verbose.

I would use something tighter than P - files.


I would use something tighter than P - files.


But , wait a minute , P - file for each frame is storing a vector of cepstral or PLP values ,


But , wait a minute , P - file for each frame is storing a vector of cepstral or PLP values ,

So that  what 's nice about the P - file  It  i Built into it is the concept of  frames , utterances , sentences , that sort of thing , that structure. And then also attached to it is an arbitrary vector of values. And it can take different types.


So that  what 's nice about the P - file  It  i Built into it is the concept of  frames , utterances , sentences , that sort of thing , that structure. And then also attached to it is an arbitrary vector of values. And it can take different types.


So that  what 's nice about the P - file  It  i Built into it is the concept of  frames , utterances , sentences , that sort of thing , that structure. And then also attached to it is an arbitrary vector of values. And it can take different types.

So it  th they don't all have to be floats. You know , you can have integers and you can have doubles , and all that sort of stuff.


So that  what 's nice about the P - file  It  i Built into it is the concept of  frames , utterances , sentences , that sort of thing , that structure. And then also attached to it is an arbitrary vector of values. And it can take different types.

So it  th they don't all have to be floats. You know , you can have integers and you can have doubles , and all that sort of stuff.

So that  that sounds  that sounds about what I w


So it  th they don't all have to be floats. You know , you can have integers and you can have doubles , and all that sort of stuff.

So that  that sounds  that sounds about what I w

Um. Right ? And it has a header  it has a header format that  describes it  to some extent. So , the only problem with it is it 's actually storing the  utterance numbers and the  frame numbers in the file , even though they 're always sequential. And so it does waste a lot of space.


So that  that sounds  that sounds about what I w

Um. Right ? And it has a header  it has a header format that  describes it  to some extent. So , the only problem with it is it 's actually storing the  utterance numbers and the  frame numbers in the file , even though they 're always sequential. And so it does waste a lot of space.

But it 's still a lot tighter than  than ASCII. And we have a lot of tools already to deal with it.


Um. Right ? And it has a header  it has a header format that  describes it  to some extent. So , the only problem with it is it 's actually storing the  utterance numbers and the  frame numbers in the file , even though they 're always sequential. And so it does waste a lot of space.

But it 's still a lot tighter than  than ASCII. And we have a lot of tools already to deal with it.

You do ? OK. Is there some documentation on this somewhere ?


But it 's still a lot tighter than  than ASCII. And we have a lot of tools already to deal with it.

You do ? OK. Is there some documentation on this somewhere ?

Yeah , there 's a ton of it. Man - pages and , uh , source code , and me.


But it 's still a lot tighter than  than ASCII. And we have a lot of tools already to deal with it.

You do ? OK. Is there some documentation on this somewhere ?

Yeah , there 's a ton of it. Man - pages and , uh , source code , and me.

OK , great. So , I mean , that sounds good. I  I was just looking for something  I 'm not a database person , but something sort of standard enough that , you know , if we start using this we can give it out , other people can work on it ,


You do ? OK. Is there some documentation on this somewhere ?

Yeah , there 's a ton of it. Man - pages and , uh , source code , and me.

OK , great. So , I mean , that sounds good. I  I was just looking for something  I 'm not a database person , but something sort of standard enough that , you know , if we start using this we can give it out , other people can work on it ,


Yeah , there 's a ton of it. Man - pages and , uh , source code , and me.

OK , great. So , I mean , that sounds good. I  I was just looking for something  I 'm not a database person , but something sort of standard enough that , you know , if we start using this we can give it out , other people can work on it ,


OK , great. So , I mean , that sounds good. I  I was just looking for something  I 'm not a database person , but something sort of standard enough that , you know , if we start using this we can give it out , other people can work on it ,

I mean , it 's something that we developed at ICSI. But , uh


I mean , it 's something that we developed at ICSI. But , uh


and  and , you know , we have a  well - configured system that you can distribute for free , and


and  and , you know , we have a  well - configured system that you can distribute for free , and

I mean , it must be the equivalent of whatever you guys used to store feat your computed features in , right ?


and  and , you know , we have a  well - configured system that you can distribute for free , and

I mean , it must be the equivalent of whatever you guys used to store feat your computed features in , right ?

Yeah , th we have  Actually , we  we use a generalization of the  the Sphere format.


I mean , it must be the equivalent of whatever you guys used to store feat your computed features in , right ?

Yeah , th we have  Actually , we  we use a generalization of the  the Sphere format.


Yeah , th we have  Actually , we  we use a generalization of the  the Sphere format.

Um , but  Yeah , so there is something like that but it 's , um , probably not as sophist


Yeah , th we have  Actually , we  we use a generalization of the  the Sphere format.

Um , but  Yeah , so there is something like that but it 's , um , probably not as sophist

Well , what does H T K do for features ?


Um , but  Yeah , so there is something like that but it 's , um , probably not as sophist

Well , what does H T K do for features ?


Um , but  Yeah , so there is something like that but it 's , um , probably not as sophist

Well , what does H T K do for features ?

Or does it even have a concept of features ?


Well , what does H T K do for features ?

Or does it even have a concept of features ?

They ha it has its own  I mean , Entropic has their own feature format that 's called , like , S - SD or some so SF or something like that.


Or does it even have a concept of features ?

They ha it has its own  I mean , Entropic has their own feature format that 's called , like , S - SD or some so SF or something like that.


Or does it even have a concept of features ?

They ha it has its own  I mean , Entropic has their own feature format that 's called , like , S - SD or some so SF or something like that.

I 'm just wondering , would it be worth while to use that instead ?


They ha it has its own  I mean , Entropic has their own feature format that 's called , like , S - SD or some so SF or something like that.

I 'm just wondering , would it be worth while to use that instead ?


I 'm just wondering , would it be worth while to use that instead ?


I 'm just wondering , would it be worth while to use that instead ?

Yeah. Th - this is exactly the kind of decision  It 's just whatever


Yeah. Th - this is exactly the kind of decision  It 's just whatever

But , I mean , people don't typically share this kind of stuff , right ?


But , I mean , people don't typically share this kind of stuff , right ?


Actually , I  I just  you know , we  we 've done this stuff on prosodics and three or four places have asked for those prosodic files , and we just have an ASCII , uh , output of frame - by - frame.


Actually , I  I just  you know , we  we 've done this stuff on prosodics and three or four places have asked for those prosodic files , and we just have an ASCII , uh , output of frame - by - frame.

Which is fine , but it gets unwieldy to go in and  and query these files with really huge files.


Which is fine , but it gets unwieldy to go in and  and query these files with really huge files.

I mean , we could do it. I was just thinking if there 's something that  where all the frame values are


Which is fine , but it gets unwieldy to go in and  and query these files with really huge files.

I mean , we could do it. I was just thinking if there 's something that  where all the frame values are

And a and again , if you have a  if you have a two - hour - long meeting , that 's gonna


I mean , we could do it. I was just thinking if there 's something that  where all the frame values are

And a and again , if you have a  if you have a two - hour - long meeting , that 's gonna

Hmm ? They 're  they 're fair they 're quite large.


I mean , we could do it. I was just thinking if there 's something that  where all the frame values are

And a and again , if you have a  if you have a two - hour - long meeting , that 's gonna

Hmm ? They 're  they 're fair they 're quite large.

Yeah , I mean , they 'd be emo enormous.


And a and again , if you have a  if you have a two - hour - long meeting , that 's gonna

Hmm ? They 're  they 're fair they 're quite large.

Yeah , I mean , they 'd be emo enormous.

And these are for ten - minute Switchboard conversations ,


Hmm ? They 're  they 're fair they 're quite large.

Yeah , I mean , they 'd be emo enormous.

And these are for ten - minute Switchboard conversations ,


Yeah , I mean , they 'd be emo enormous.

And these are for ten - minute Switchboard conversations ,

and  So it 's doable , it 's just that you can only store a feature vector at frame - by - frame and it doesn't have any kind of ,


And these are for ten - minute Switchboard conversations ,

and  So it 's doable , it 's just that you can only store a feature vector at frame - by - frame and it doesn't have any kind of ,

Is  is the sharing part of this a pretty important  consideration


and  So it 's doable , it 's just that you can only store a feature vector at frame - by - frame and it doesn't have any kind of ,

Is  is the sharing part of this a pretty important  consideration


and  So it 's doable , it 's just that you can only store a feature vector at frame - by - frame and it doesn't have any kind of ,

Is  is the sharing part of this a pretty important  consideration

or does that just sort of , uh  a nice thing to have ?


Is  is the sharing part of this a pretty important  consideration

or does that just sort of , uh  a nice thing to have ?

I  I don't know enough about what we 're gonna do with the data. But I thought it would be good to get something that we can  that other people can use or adopt for their own kinds of encoding. And just , I mean we have to use some we have to make some decision about what to do.


or does that just sort of , uh  a nice thing to have ?

I  I don't know enough about what we 're gonna do with the data. But I thought it would be good to get something that we can  that other people can use or adopt for their own kinds of encoding. And just , I mean we have to use some we have to make some decision about what to do.


or does that just sort of , uh  a nice thing to have ?

I  I don't know enough about what we 're gonna do with the data. But I thought it would be good to get something that we can  that other people can use or adopt for their own kinds of encoding. And just , I mean we have to use some we have to make some decision about what to do.

And especially for the prosody work , what  what it ends up being is you get features from the signal , and of course those change every time your alignments change. So you re - run a recognizer , you want to recompute your features , um , and then keep the database up to date.


I  I don't know enough about what we 're gonna do with the data. But I thought it would be good to get something that we can  that other people can use or adopt for their own kinds of encoding. And just , I mean we have to use some we have to make some decision about what to do.

And especially for the prosody work , what  what it ends up being is you get features from the signal , and of course those change every time your alignments change. So you re - run a recognizer , you want to recompute your features , um , and then keep the database up to date.


And especially for the prosody work , what  what it ends up being is you get features from the signal , and of course those change every time your alignments change. So you re - run a recognizer , you want to recompute your features , um , and then keep the database up to date.

Or you change a word , or you change a  utterance boundary segment , which is gonna happen a lot. And so I wanted something where  all of this can be done in a elegant way and that if somebody wants to try something or compute something else , that it can be done flexibly. Um , it doesn't have to be pretty , it just has to be , you know , easy to use , and


And especially for the prosody work , what  what it ends up being is you get features from the signal , and of course those change every time your alignments change. So you re - run a recognizer , you want to recompute your features , um , and then keep the database up to date.

Or you change a word , or you change a  utterance boundary segment , which is gonna happen a lot. And so I wanted something where  all of this can be done in a elegant way and that if somebody wants to try something or compute something else , that it can be done flexibly. Um , it doesn't have to be pretty , it just has to be , you know , easy to use , and

Yeah , the other thing  We should look at ATLAS , the NIST thing ,


Or you change a word , or you change a  utterance boundary segment , which is gonna happen a lot. And so I wanted something where  all of this can be done in a elegant way and that if somebody wants to try something or compute something else , that it can be done flexibly. Um , it doesn't have to be pretty , it just has to be , you know , easy to use , and

Yeah , the other thing  We should look at ATLAS , the NIST thing ,


Yeah , the other thing  We should look at ATLAS , the NIST thing ,

and see if they have anything at that level.


and see if they have anything at that level.


and see if they have anything at that level.

I mean , I 'm not sure what to do about this with ATLAS , because they chose a different route. I chose something that  Th - there are sort of two choices. Your  your file format can know about  know that you 're talking about language  and speech , which is what I chose , and time , or your file format can just be a graph representation. And then the application has to impose the structure on top. So what it looked like ATLAS chose is , they chose the other way , which was their file format is just nodes and links , and you have to interpret what they mean yourself.


and see if they have anything at that level.

I mean , I 'm not sure what to do about this with ATLAS , because they chose a different route. I chose something that  Th - there are sort of two choices. Your  your file format can know about  know that you 're talking about language  and speech , which is what I chose , and time , or your file format can just be a graph representation. And then the application has to impose the structure on top. So what it looked like ATLAS chose is , they chose the other way , which was their file format is just nodes and links , and you have to interpret what they mean yourself.

And why did you not choose that type of approach ?


I mean , I 'm not sure what to do about this with ATLAS , because they chose a different route. I chose something that  Th - there are sort of two choices. Your  your file format can know about  know that you 're talking about language  and speech , which is what I chose , and time , or your file format can just be a graph representation. And then the application has to impose the structure on top. So what it looked like ATLAS chose is , they chose the other way , which was their file format is just nodes and links , and you have to interpret what they mean yourself.

And why did you not choose that type of approach ?

Uh , because I knew that we were doing speech , and I thought it was better if you 're looking at a raw file to be  t for the tags to say " it 's an utterance " , as opposed to the tag to say " it 's a link ".


And why did you not choose that type of approach ?

Uh , because I knew that we were doing speech , and I thought it was better if you 're looking at a raw file to be  t for the tags to say " it 's an utterance " , as opposed to the tag to say " it 's a link ".


Uh , because I knew that we were doing speech , and I thought it was better if you 're looking at a raw file to be  t for the tags to say " it 's an utterance " , as opposed to the tag to say " it 's a link ".

But other than that , are they compatible ? I mean , you could sort of


But other than that , are they compatible ? I mean , you could sort of


But other than that , are they compatible ? I mean , you could sort of

You could probably translate between them.


You could probably translate between them.


You could probably translate between them.

So , well , the other thing is if we choose to use ATLAS , which maybe we should just do , we should just throw this out before we invest a lot of time in it.


So , well , the other thing is if we choose to use ATLAS , which maybe we should just do , we should just throw this out before we invest a lot of time in it.

OK. I don't  So this is what the meeting 's about ,


So , well , the other thing is if we choose to use ATLAS , which maybe we should just do , we should just throw this out before we invest a lot of time in it.

OK. I don't  So this is what the meeting 's about ,

just sort of how to  Um , cuz we need to come up with a database like this just to do our work. And I actually don't care , as long as it 's something useful to other people , what we choose.


OK. I don't  So this is what the meeting 's about ,

just sort of how to  Um , cuz we need to come up with a database like this just to do our work. And I actually don't care , as long as it 's something useful to other people , what we choose.


just sort of how to  Um , cuz we need to come up with a database like this just to do our work. And I actually don't care , as long as it 's something useful to other people , what we choose.

So maybe it 's  maybe oth you know , if  if you have any idea of how to choose , cuz I don't.


So maybe it 's  maybe oth you know , if  if you have any idea of how to choose , cuz I don't.


So maybe it 's  maybe oth you know , if  if you have any idea of how to choose , cuz I don't.

I mean , I  I chose this for a couple reasons. One of them is that it 's easy to parse. You don't need a full XML parser. It 's very easy to just write a Perl script  to parse it.


I mean , I  I chose this for a couple reasons. One of them is that it 's easy to parse. You don't need a full XML parser. It 's very easy to just write a Perl script  to parse it.


I mean , I  I chose this for a couple reasons. One of them is that it 's easy to parse. You don't need a full XML parser. It 's very easy to just write a Perl script  to parse it.

And you can have as much information in the tag as you want , right ?


And you can have as much information in the tag as you want , right ?

Well , I have it structured. Right ? So each type tag has only particular items that it can take.


And you can have as much information in the tag as you want , right ?

Well , I have it structured. Right ? So each type tag has only particular items that it can take.

Can you  But you can add to those structures if you


And you can have as much information in the tag as you want , right ?

Well , I have it structured. Right ? So each type tag has only particular items that it can take.

Can you  But you can add to those structures if you

Sure. If you have more information. So what  What NIST would say is that instead of doing this , you would say something like " link  start equals , um , you know , some node ID ,


Well , I have it structured. Right ? So each type tag has only particular items that it can take.

Can you  But you can add to those structures if you

Sure. If you have more information. So what  What NIST would say is that instead of doing this , you would say something like " link  start equals , um , you know , some node ID ,


Can you  But you can add to those structures if you

Sure. If you have more information. So what  What NIST would say is that instead of doing this , you would say something like " link  start equals , um , you know , some node ID ,

end equals some other node ID " , and then " type " would be " utterance ".


Sure. If you have more information. So what  What NIST would say is that instead of doing this , you would say something like " link  start equals , um , you know , some node ID ,

end equals some other node ID " , and then " type " would be " utterance ".


end equals some other node ID " , and then " type " would be " utterance ".


end equals some other node ID " , and then " type " would be " utterance ".

So why would it be a  a waste to do it this way if it 's similar enough that we can always translate it ?


So why would it be a  a waste to do it this way if it 's similar enough that we can always translate it ?

It probably wouldn't be a waste. It would mean that at some point if we wanted to switch , we 'd just have to translate everything.


So why would it be a  a waste to do it this way if it 's similar enough that we can always translate it ?

It probably wouldn't be a waste. It would mean that at some point if we wanted to switch , we 'd just have to translate everything.

Write a translator. But it se Since they are developing a big


It probably wouldn't be a waste. It would mean that at some point if we wanted to switch , we 'd just have to translate everything.

Write a translator. But it se Since they are developing a big

But that 's  I don't think that 's a big deal.


Write a translator. But it se Since they are developing a big

But that 's  I don't think that 's a big deal.


But that 's  I don't think that 's a big deal.

they 're developing a big infrastructure. And so it seems to me that if  if we want to use that , we might as well go directly to what they 're doing , rather than


But that 's  I don't think that 's a big deal.

they 're developing a big infrastructure. And so it seems to me that if  if we want to use that , we might as well go directly to what they 're doing , rather than

If we want to  Do they already have something that 's  that would be useful for us in place ?


they 're developing a big infrastructure. And so it seems to me that if  if we want to use that , we might as well go directly to what they 're doing , rather than

If we want to  Do they already have something that 's  that would be useful for us in place ?

Yeah. See , that 's the question. I mean , how stable is their  Are they ready to go ,


If we want to  Do they already have something that 's  that would be useful for us in place ?

Yeah. See , that 's the question. I mean , how stable is their  Are they ready to go ,


Yeah. See , that 's the question. I mean , how stable is their  Are they ready to go ,

The last time I looked at it was a while ago , probably a year ago , uh , when we first started talking about this.


The last time I looked at it was a while ago , probably a year ago , uh , when we first started talking about this.


The last time I looked at it was a while ago , probably a year ago , uh , when we first started talking about this.

And at that time at least  it was still not very  complete. And so , specifically they didn't have any external format representation at that time. They just had the sort of conceptual  node  uh , annotated transcription graph , which I really liked. And that 's exactly what this stuff is based on. Since then , they 've developed their own external file format , which is , uh , you know , this sort of s this sort of thing. Um , and apparently they 've also developed a lot of tools , but I haven't looked at them. Maybe I should.


And at that time at least  it was still not very  complete. And so , specifically they didn't have any external format representation at that time. They just had the sort of conceptual  node  uh , annotated transcription graph , which I really liked. And that 's exactly what this stuff is based on. Since then , they 've developed their own external file format , which is , uh , you know , this sort of s this sort of thing. Um , and apparently they 've also developed a lot of tools , but I haven't looked at them. Maybe I should.

I mean , would the tools  would the tools run on something like this , if you can translate them anyway ?


And at that time at least  it was still not very  complete. And so , specifically they didn't have any external format representation at that time. They just had the sort of conceptual  node  uh , annotated transcription graph , which I really liked. And that 's exactly what this stuff is based on. Since then , they 've developed their own external file format , which is , uh , you know , this sort of s this sort of thing. Um , and apparently they 've also developed a lot of tools , but I haven't looked at them. Maybe I should.

I mean , would the tools  would the tools run on something like this , if you can translate them anyway ?

Um , th what would  would  would  what would worry me is that maybe we might miss a little detail


I mean , would the tools  would the tools run on something like this , if you can translate them anyway ?

Um , th what would  would  would  what would worry me is that maybe we might miss a little detail


I mean , would the tools  would the tools run on something like this , if you can translate them anyway ?

Um , th what would  would  would  what would worry me is that maybe we might miss a little detail

I mean , that  I guess it 's a question that


Um , th what would  would  would  what would worry me is that maybe we might miss a little detail

I mean , that  I guess it 's a question that


I mean , that  I guess it 's a question that


I mean , that  I guess it 's a question that

that would make it very difficult to translate from one to the other.


that would make it very difficult to translate from one to the other.


that would make it very difficult to translate from one to the other.

I  I think if it 's conceptually close , and they already have or will have tools that everybody else will be using , I mean ,  it would be crazy to do something s you know , separate that


I  I think if it 's conceptually close , and they already have or will have tools that everybody else will be using , I mean ,  it would be crazy to do something s you know , separate that


So I 'll  I 'll take a closer look at it.


So I 'll  I 'll take a closer look at it.

Actually , so it 's  that  that would really be the question , is just what you would feel is in the long run the best thing.


So I 'll  I 'll take a closer look at it.

Actually , so it 's  that  that would really be the question , is just what you would feel is in the long run the best thing.

Cuz  once we start , sort of , doing this I don't  we don't actually have enough time to probably have to rehash it out again


Actually , so it 's  that  that would really be the question , is just what you would feel is in the long run the best thing.

Cuz  once we start , sort of , doing this I don't  we don't actually have enough time to probably have to rehash it out again

The  Yep. The other thing  the other way that I sort of established this was as easy translation to and from the Transcriber format.


Cuz  once we start , sort of , doing this I don't  we don't actually have enough time to probably have to rehash it out again

The  Yep. The other thing  the other way that I sort of established this was as easy translation to and from the Transcriber format.


The  Yep. The other thing  the other way that I sort of established this was as easy translation to and from the Transcriber format.


I mean , I like this. This is sort of intuitively easy to actually r read ,


I mean , I like this. This is sort of intuitively easy to actually r read ,

as easy it could  as it could be. But , I suppose that  as long as they have a type here that specifies " utt " , um ,


as easy it could  as it could be. But , I suppose that  as long as they have a type here that specifies " utt " , um ,


as easy it could  as it could be. But , I suppose that  as long as they have a type here that specifies " utt " , um ,

The  the  the  the point is  with this , though , is that you can't really add any supplementary information. Right ? So if you suddenly decide that you want


The  the  the  the point is  with this , though , is that you can't really add any supplementary information. Right ? So if you suddenly decide that you want


The  the  the  the point is  with this , though , is that you can't really add any supplementary information. Right ? So if you suddenly decide that you want

Yeah. You 'd have to make a different type.


The  the  the  the point is  with this , though , is that you can't really add any supplementary information. Right ? So if you suddenly decide that you want

Yeah. You 'd have to make a different type.

So  Well , if you look at it and  Um , I guess in my mind I don't know enough  Jane would know better ,  about the  types of annotations and  and  But I imagine that those are things that would  well , you guys mentioned this ,  that could span any  it could be in its own channel , it could span time boundaries of any type ,


Yeah. You 'd have to make a different type.

So  Well , if you look at it and  Um , I guess in my mind I don't know enough  Jane would know better ,  about the  types of annotations and  and  But I imagine that those are things that would  well , you guys mentioned this ,  that could span any  it could be in its own channel , it could span time boundaries of any type ,


Yeah. You 'd have to make a different type.

So  Well , if you look at it and  Um , I guess in my mind I don't know enough  Jane would know better ,  about the  types of annotations and  and  But I imagine that those are things that would  well , you guys mentioned this ,  that could span any  it could be in its own channel , it could span time boundaries of any type ,

it could be instantaneous , things like that. Um , and then from the recognition side we have backtraces at the phone - level.


So  Well , if you look at it and  Um , I guess in my mind I don't know enough  Jane would know better ,  about the  types of annotations and  and  But I imagine that those are things that would  well , you guys mentioned this ,  that could span any  it could be in its own channel , it could span time boundaries of any type ,

it could be instantaneous , things like that. Um , and then from the recognition side we have backtraces at the phone - level.


it could be instantaneous , things like that. Um , and then from the recognition side we have backtraces at the phone - level.

If  if it can handle that , it could handle states or whatever. And then at the prosody - level we have frame  sort of like cepstral feature files ,


If  if it can handle that , it could handle states or whatever. And then at the prosody - level we have frame  sort of like cepstral feature files ,

uh , like these P - files or anything like that. And that 's sort of the world of things that I  And then we have the aligned channels , of course ,


uh , like these P - files or anything like that. And that 's sort of the world of things that I  And then we have the aligned channels , of course ,

It seems to me you want to keep the frame - level stuff separate.


It seems to me you want to keep the frame - level stuff separate.


It seems to me you want to keep the frame - level stuff separate.

I  I definitely agree and I wanted to find actually a f a nicer format or a  maybe a more compact format than what we used before.


I  I definitely agree and I wanted to find actually a f a nicer format or a  maybe a more compact format than what we used before.


I  I definitely agree and I wanted to find actually a f a nicer format or a  maybe a more compact format than what we used before.

Just cuz you 've got  ten channels or whatever and two hours of a meeting. It 's  it 's a lot of


Just cuz you 've got  ten channels or whatever and two hours of a meeting. It 's  it 's a lot of

Now  now how would you  how would you represent , um , multiple speakers in this framework ? Were  You would just represent them as


Now  now how would you  how would you represent , um , multiple speakers in this framework ? Were  You would just represent them as

You would have like a speaker tag or something ?


Now  now how would you  how would you represent , um , multiple speakers in this framework ? Were  You would just represent them as

You would have like a speaker tag or something ?

there 's a spea speaker tag up at the top which identifies them and then each utt the way I had it is each turn or each utterance ,  I don't even remember now , had a speaker ID tag attached to it.


You would have like a speaker tag or something ?

there 's a spea speaker tag up at the top which identifies them and then each utt the way I had it is each turn or each utterance ,  I don't even remember now , had a speaker ID tag attached to it.


You would have like a speaker tag or something ?

there 's a spea speaker tag up at the top which identifies them and then each utt the way I had it is each turn or each utterance ,  I don't even remember now , had a speaker ID tag attached to it.

And in this format you would have a different tag , which  which would , uh , be linked to the link. So  so somewhere else you would have another thing  that would be ,


there 's a spea speaker tag up at the top which identifies them and then each utt the way I had it is each turn or each utterance ,  I don't even remember now , had a speaker ID tag attached to it.

And in this format you would have a different tag , which  which would , uh , be linked to the link. So  so somewhere else you would have another thing  that would be ,


And in this format you would have a different tag , which  which would , uh , be linked to the link. So  so somewhere else you would have another thing  that would be ,

um  Let 's see , would it be a node or a link ? Um  And so  so this one would have , um , an ID is link   link seventy - four or something like that.


um  Let 's see , would it be a node or a link ? Um  And so  so this one would have , um , an ID is link   link seventy - four or something like that.

And then somewhere up here you would have a link that  that , uh , you know , was referencing L - seventy - four and had speaker Adam.


And then somewhere up here you would have a link that  that , uh , you know , was referencing L - seventy - four and had speaker Adam.


And then somewhere up here you would have a link that  that , uh , you know , was referencing L - seventy - four and had speaker Adam.

Actually , it 's the channel , I think , that


Actually , it 's the channel , I think , that


Actually , it 's the channel , I think , that

I mean , w yeah , channel is what the channelized output out


I mean , w yeah , channel is what the channelized output out


But  but  so how in the NIST format do we express  a hierarchical relationship between , um , say , an utterance and the words within it ? So how do you  tell  that  these are the words that belong to that utterance ?


But  but  so how in the NIST format do we express  a hierarchical relationship between , um , say , an utterance and the words within it ? So how do you  tell  that  these are the words that belong to that utterance ?

Um , you would have another structure lower down than this that would be saying they 're all belonging to this ID.


But  but  so how in the NIST format do we express  a hierarchical relationship between , um , say , an utterance and the words within it ? So how do you  tell  that  these are the words that belong to that utterance ?

Um , you would have another structure lower down than this that would be saying they 're all belonging to this ID.

So each thing refers to the  utterance that it belongs to.


Um , you would have another structure lower down than this that would be saying they 're all belonging to this ID.

So each thing refers to the  utterance that it belongs to.

Right. And then each utterance could refer to a turn ,


So each thing refers to the  utterance that it belongs to.

Right. And then each utterance could refer to a turn ,

So it 's  it 's not hi it 's sort of bottom - up.


So each thing refers to the  utterance that it belongs to.

Right. And then each utterance could refer to a turn ,

So it 's  it 's not hi it 's sort of bottom - up.

and each turn could refer to something higher up.


Right. And then each utterance could refer to a turn ,

So it 's  it 's not hi it 's sort of bottom - up.

and each turn could refer to something higher up.

And what if you actually have  So right now what you have as utterance , um , the closest thing that comes out of the channelized is the stuff between the segment boundaries that the transcribers put in or that Thilo put in , which may or may not actually be , like , a s it 's usually not  um , the beginning and end of a sentence , say.


So it 's  it 's not hi it 's sort of bottom - up.

and each turn could refer to something higher up.

And what if you actually have  So right now what you have as utterance , um , the closest thing that comes out of the channelized is the stuff between the segment boundaries that the transcribers put in or that Thilo put in , which may or may not actually be , like , a s it 's usually not  um , the beginning and end of a sentence , say.

Well , that 's why I didn't call it " sentence ".


and each turn could refer to something higher up.

And what if you actually have  So right now what you have as utterance , um , the closest thing that comes out of the channelized is the stuff between the segment boundaries that the transcribers put in or that Thilo put in , which may or may not actually be , like , a s it 's usually not  um , the beginning and end of a sentence , say.

Well , that 's why I didn't call it " sentence ".

So , right. Um , so it 's like a segment or something.


And what if you actually have  So right now what you have as utterance , um , the closest thing that comes out of the channelized is the stuff between the segment boundaries that the transcribers put in or that Thilo put in , which may or may not actually be , like , a s it 's usually not  um , the beginning and end of a sentence , say.

Well , that 's why I didn't call it " sentence ".

So , right. Um , so it 's like a segment or something.


Well , that 's why I didn't call it " sentence ".

So , right. Um , so it 's like a segment or something.

So , I mean , I assume this is possible , that if you have  someone annotates the punctuation or whatever when they transcribe , you can say , you know , from  for  from the c beginning of the sentence to the end of the sentence , from the annotations , this is a unit , even though it never actually  i It 's only a unit by virtue of the annotations  at the word - level.


So , right. Um , so it 's like a segment or something.

So , I mean , I assume this is possible , that if you have  someone annotates the punctuation or whatever when they transcribe , you can say , you know , from  for  from the c beginning of the sentence to the end of the sentence , from the annotations , this is a unit , even though it never actually  i It 's only a unit by virtue of the annotations  at the word - level.

Sure. I mean , so you would  you would have yet another tag.


So , I mean , I assume this is possible , that if you have  someone annotates the punctuation or whatever when they transcribe , you can say , you know , from  for  from the c beginning of the sentence to the end of the sentence , from the annotations , this is a unit , even though it never actually  i It 's only a unit by virtue of the annotations  at the word - level.

Sure. I mean , so you would  you would have yet another tag.


So , I mean , I assume this is possible , that if you have  someone annotates the punctuation or whatever when they transcribe , you can say , you know , from  for  from the c beginning of the sentence to the end of the sentence , from the annotations , this is a unit , even though it never actually  i It 's only a unit by virtue of the annotations  at the word - level.

Sure. I mean , so you would  you would have yet another tag.

You 'd have another tag which says this is of type " sentence ".


Sure. I mean , so you would  you would have yet another tag.

You 'd have another tag which says this is of type " sentence ".


You 'd have another tag which says this is of type " sentence ".


I think that should be  possible as long as the  But , uh , what I don't understand is where the  where in this type of file  that would be expressed.


I think that should be  possible as long as the  But , uh , what I don't understand is where the  where in this type of file  that would be expressed.

Right. You would have another tag somewhere. It 's  well , there 're two ways of doing it.


I think that should be  possible as long as the  But , uh , what I don't understand is where the  where in this type of file  that would be expressed.

Right. You would have another tag somewhere. It 's  well , there 're two ways of doing it.

S so it would just be floating before the sentence or floating after the sentence without a time - mark.


I think that should be  possible as long as the  But , uh , what I don't understand is where the  where in this type of file  that would be expressed.

Right. You would have another tag somewhere. It 's  well , there 're two ways of doing it.

S so it would just be floating before the sentence or floating after the sentence without a time - mark.

You could have some sort of link type  type equals " sentence " , and ID is " S - whatever ". And then lower down you could have an utterance. So the type is " utterance "  equals " utt ". And you could either say that  No. I don't know


Right. You would have another tag somewhere. It 's  well , there 're two ways of doing it.

S so it would just be floating before the sentence or floating after the sentence without a time - mark.

You could have some sort of link type  type equals " sentence " , and ID is " S - whatever ". And then lower down you could have an utterance. So the type is " utterance "  equals " utt ". And you could either say that  No. I don't know


S so it would just be floating before the sentence or floating after the sentence without a time - mark.

You could have some sort of link type  type equals " sentence " , and ID is " S - whatever ". And then lower down you could have an utterance. So the type is " utterance "  equals " utt ". And you could either say that  No. I don't know


You could have some sort of link type  type equals " sentence " , and ID is " S - whatever ". And then lower down you could have an utterance. So the type is " utterance "  equals " utt ". And you could either say that  No. I don't know


Can you  can you say that this is part of this ,


or do you say this is part of this ? I think


they 're actually overlapping each other , sort of.


they 're actually overlapping each other , sort of.

the thing is that some something may be a part of one thing for one purpose and another thing of another purpose.


the thing is that some something may be a part of one thing for one purpose and another thing of another purpose.


the thing is that some something may be a part of one thing for one purpose and another thing of another purpose.

You have to have another type then , I guess.


You have to have another type then , I guess.

s Um , well , s let 's  let 's ta so let 's


You have to have another type then , I guess.

s Um , well , s let 's  let 's ta so let 's

Well , I think I 'm  I think w I had better look at it again


s Um , well , s let 's  let 's ta so let 's

Well , I think I 'm  I think w I had better look at it again


Well , I think I 'm  I think w I had better look at it again


There 's one level  there 's one more level of indirection that I 'm forgetting.


There 's one level  there 's one more level of indirection that I 'm forgetting.

Suppose you have a word sequence and you have two different segmentations of that same word sequence. f Say , one segmentation is in terms of , um , you know , uh , sentences. And another segmentation is in terms of , um ,  I don't know ,  prosodic phrases. And let 's say that they don't  nest. So , you know , a prosodic phrase may cross two sentences or something.


There 's one level  there 's one more level of indirection that I 'm forgetting.

Suppose you have a word sequence and you have two different segmentations of that same word sequence. f Say , one segmentation is in terms of , um , you know , uh , sentences. And another segmentation is in terms of , um ,  I don't know ,  prosodic phrases. And let 's say that they don't  nest. So , you know , a prosodic phrase may cross two sentences or something.

I don't know if that 's true or not but  let 's as


Suppose you have a word sequence and you have two different segmentations of that same word sequence. f Say , one segmentation is in terms of , um , you know , uh , sentences. And another segmentation is in terms of , um ,  I don't know ,  prosodic phrases. And let 's say that they don't  nest. So , you know , a prosodic phrase may cross two sentences or something.

I don't know if that 's true or not but  let 's as

Well , it 's definitely true with the segment.


I don't know if that 's true or not but  let 's as

Well , it 's definitely true with the segment.


I don't know if that 's true or not but  let 's as

Well , it 's definitely true with the segment.

That 's what I  exactly what I meant by the utterances versus the sentence could be sort of


Well , it 's definitely true with the segment.

That 's what I  exactly what I meant by the utterances versus the sentence could be sort of

Yeah. So , you want to be s you want to say this  this word is part of that sentence and this prosodic phrase.


That 's what I  exactly what I meant by the utterances versus the sentence could be sort of

Yeah. So , you want to be s you want to say this  this word is part of that sentence and this prosodic phrase.


That 's what I  exactly what I meant by the utterances versus the sentence could be sort of

Yeah. So , you want to be s you want to say this  this word is part of that sentence and this prosodic phrase.

But the phrase is not part of the sentence


Yeah. So , you want to be s you want to say this  this word is part of that sentence and this prosodic phrase.

But the phrase is not part of the sentence


But the phrase is not part of the sentence

and neither is the sentence part of the phrase.


and neither is the sentence part of the phrase.

I I 'm pretty sure that you can do that , but I 'm forgetting the exact level of nesting.


and neither is the sentence part of the phrase.

I I 'm pretty sure that you can do that , but I 'm forgetting the exact level of nesting.

So , you would have to have  two different pointers from the word up  one level up , one to the sent


I I 'm pretty sure that you can do that , but I 'm forgetting the exact level of nesting.

So , you would have to have  two different pointers from the word up  one level up , one to the sent

So  so what you would end up having is a tag saying " here 's a word , and it starts here and it ends here ".


So , you would have to have  two different pointers from the word up  one level up , one to the sent

So  so what you would end up having is a tag saying " here 's a word , and it starts here and it ends here ".

And then lower down you would say " here 's a prosodic boundary and it has these words in it ". And lower down you 'd have " here 's a sentence ,


So  so what you would end up having is a tag saying " here 's a word , and it starts here and it ends here ".

And then lower down you would say " here 's a prosodic boundary and it has these words in it ". And lower down you 'd have " here 's a sentence ,


And then lower down you would say " here 's a prosodic boundary and it has these words in it ". And lower down you 'd have " here 's a sentence ,


So you would be able to go in and say , you know , " give me all the words in the bound in the prosodic phrase


So you would be able to go in and say , you know , " give me all the words in the bound in the prosodic phrase

and give me all the words in the  " Yeah.


and give me all the words in the  " Yeah.


Mm - hmm. The  the o the other issue that you had was , how do you actually efficiently extract , um  find and extract information in a structure of this type ?


Well , uh , and , I mean , you guys might  I don't know if this is premature because I suppose once you get the representation you can do this , but the kinds of things I was worried about is ,


Well , uh , and , I mean , you guys might  I don't know if this is premature because I suppose once you get the representation you can do this , but the kinds of things I was worried about is ,

I mean , yeah , you c sure you can do it ,


I mean , yeah , you c sure you can do it ,


I mean , yeah , you c sure you can do it ,

but can you do it sort of l l you know , it


I mean , yeah , you c sure you can do it ,

but can you do it sort of l l you know , it

I I mean , I can't do it , but I can  um ,


but can you do it sort of l l you know , it

I I mean , I can't do it , but I can  um ,

y y you gotta  you gotta do this  you  you 're gonna want to do this very quickly


I I mean , I can't do it , but I can  um ,

y y you gotta  you gotta do this  you  you 're gonna want to do this very quickly

or else you 'll spend all your time sort of searching through very  complex data structures