Is height. Yeah. This  this is the idea  the idea I  I  I had to  to compare the  the ratio of the   the energy of the harmonics with the  eh , with the , eh , total energy in the spectrum and try to get a ratio to  to distinguish between overlapping and speech. Mmm.

But you 're looking a y you 're looking at  Let 's take a second with this. Uh , uh , you 're looking at f at the phase derivative , um , in  in , uh , what domain ? I mean this is  this is in  in  in  in bands ? Or  or


But you 're looking a y you 're looking at  Let 's take a second with this. Uh , uh , you 're looking at f at the phase derivative , um , in  in , uh , what domain ? I mean this is  this is in  in  in  in bands ? Or  or

It 's a  it 's a  o i w the band  the band is , eh , from zero to  to four kilohertz. And I  I ot I


It 's a  it 's a  o i w the band  the band is , eh , from zero to  to four kilohertz. And I  I ot I

And you just take the instantaneous frequency ?


It 's a  it 's a  o i w the band  the band is , eh , from zero to  to four kilohertz. And I  I ot I

And you just take the instantaneous frequency ?

Yeah. I u m t I  I used two m two method  two methods. Eh , one , eh , based on the F  eh , FTT. to FFT to  to obtain the  or to study the harmonics from  from the spectrum directly ,


And you just take the instantaneous frequency ?

Yeah. I u m t I  I used two m two method  two methods. Eh , one , eh , based on the F  eh , FTT. to FFT to  to obtain the  or to study the harmonics from  from the spectrum directly ,

and to study the energy and the multiples of


Yeah. I u m t I  I used two m two method  two methods. Eh , one , eh , based on the F  eh , FTT. to FFT to  to obtain the  or to study the harmonics from  from the spectrum directly ,

and to study the energy and the multiples of


and to study the energy and the multiples of

frequency. And another  another algorithm I have is the  in the  instantaneous frequency , based on  on  on the FFT to  to  to calculate the  the phase derivate in the time. Eh , uh n the d I mean I  I have two  two algorithms.


frequency. And another  another algorithm I have is the  in the  instantaneous frequency , based on  on  on the FFT to  to  to calculate the  the phase derivate in the time. Eh , uh n the d I mean I  I have two  two algorithms.

But , eh , in m  i in my opinion the  the  the instantaneous frequency , the  the  the behavior , eh , was  th it was very interesting. Because I  I saw  eh , how the spectrum  concentrate , eh ,


But , eh , in m  i in my opinion the  the  the instantaneous frequency , the  the  the behavior , eh , was  th it was very interesting. Because I  I saw  eh , how the spectrum  concentrate , eh ,

around the  the harmonic. But then when I apply the  the rule , eh , of the  in the   the instantaneous frequency of the ne of the continuous filter in the  the near filter , the  the rule that , eh , people propose in the paper doesn't work. And I don't know why.


But , eh , in m  i in my opinion the  the  the instantaneous frequency , the  the  the behavior , eh , was  th it was very interesting. Because I  I saw  eh , how the spectrum  concentrate , eh ,

around the  the harmonic. But then when I apply the  the rule , eh , of the  in the   the instantaneous frequency of the ne of the continuous filter in the  the near filter , the  the rule that , eh , people propose in the paper doesn't work. And I don't know why.

But the instantaneous frequency , wouldn't that give you something more like the central frequency of the  you know , of the  where most of the energy is ? I mean , I think if you  Does i does it  Why would it correspond to pitch ?


around the  the harmonic. But then when I apply the  the rule , eh , of the  in the   the instantaneous frequency of the ne of the continuous filter in the  the near filter , the  the rule that , eh , people propose in the paper doesn't work. And I don't know why.

But the instantaneous frequency , wouldn't that give you something more like the central frequency of the  you know , of the  where most of the energy is ? I mean , I think if you  Does i does it  Why would it correspond to pitch ?

Yeah. I  I  I not sure. I  I  I try to  to


But the instantaneous frequency , wouldn't that give you something more like the central frequency of the  you know , of the  where most of the energy is ? I mean , I think if you  Does i does it  Why would it correspond to pitch ?

Yeah. I  I  I not sure. I  I  I try to  to

When  first I    I calculate , eh , using the FFT ,


Yeah. I  I  I not sure. I  I  I try to  to

When  first I    I calculate , eh , using the FFT ,


When  first I    I calculate , eh , using the FFT ,


And  when ou I obtained the instantaneous frequency. And I change  the  the  the @ @ , using the instantaneous frequency , here.


And  when ou I obtained the instantaneous frequency. And I change  the  the  the @ @ , using the instantaneous frequency , here.

Oh , so you scale  you s you do a  a scaling along that axis according to instantaneous


Oh , so you scale  you s you do a  a scaling along that axis according to instantaneous


eh , when i I  I use these  these frequency , eh , the range is different , and the resolution is different.


eh , when i I  I use these  these frequency , eh , the range is different , and the resolution is different.

And I observe more  more or less , thing like this. And the paper said that , eh , these frequencies are probably , eh , harmonics.


And I observe more  more or less , thing like this. And the paper said that , eh , these frequencies are probably , eh , harmonics.

But , eh , they used , eh , a rule , eh , based in the  in the  because to  to calculate the instantaneous frequency , they use a Hanning window.


But , eh , they used , eh , a rule , eh , based in the  in the  because to  to calculate the instantaneous frequency , they use a Hanning window.

And , they said that , eh , if  these  peak are , eh , harmonics , the f instantaneous frequency , of the contiguous , eh  w eh eh , filters are very near , or have to be very near. But , eh , phh ! I don't  I  I  I  I don I I  and I don't know what is the  what is the distance. And I tried to  to put different distance , eh , to put difference , eh  eh , length of the window , eh , different front sieve , Pfff ! and I  I not sure what happened.


But , eh , they used , eh , a rule , eh , based in the  in the  because to  to calculate the instantaneous frequency , they use a Hanning window.

And , they said that , eh , if  these  peak are , eh , harmonics , the f instantaneous frequency , of the contiguous , eh  w eh eh , filters are very near , or have to be very near. But , eh , phh ! I don't  I  I  I  I don I I  and I don't know what is the  what is the distance. And I tried to  to put different distance , eh , to put difference , eh  eh , length of the window , eh , different front sieve , Pfff ! and I  I not sure what happened.

OK , yeah well I  I guess I 'm not following it enough. I 'll  probably gonna hafta look at the paper , but  which I 'm not gonna have time to do in the next few days , but   but I 'm  I 'm curious about it.


And , they said that , eh , if  these  peak are , eh , harmonics , the f instantaneous frequency , of the contiguous , eh  w eh eh , filters are very near , or have to be very near. But , eh , phh ! I don't  I  I  I  I don I I  and I don't know what is the  what is the distance. And I tried to  to put different distance , eh , to put difference , eh  eh , length of the window , eh , different front sieve , Pfff ! and I  I not sure what happened.

OK , yeah well I  I guess I 'm not following it enough. I 'll  probably gonna hafta look at the paper , but  which I 'm not gonna have time to do in the next few days , but   but I 'm  I 'm curious about it.


OK , yeah well I  I guess I 'm not following it enough. I 'll  probably gonna hafta look at the paper , but  which I 'm not gonna have time to do in the next few days , but   but I 'm  I 'm curious about it.

I I did i it did occur to me that this is  uh , the return to the transcription , that there 's one third thing I wanted to  to ex raise as a to as an issue which is , um , how to handle breaths. So , I wanted to raise the question of whether people in speech recognition want to know where the breaths are. And the reason I ask the question is , um , aside from the fact that they 're obviously very time - consuming to encode , uh , the fact that there was some  I had the indication from Dan Ellis in the email that I sent to you ,


I I did i it did occur to me that this is  uh , the return to the transcription , that there 's one third thing I wanted to  to ex raise as a to as an issue which is , um , how to handle breaths. So , I wanted to raise the question of whether people in speech recognition want to know where the breaths are. And the reason I ask the question is , um , aside from the fact that they 're obviously very time - consuming to encode , uh , the fact that there was some  I had the indication from Dan Ellis in the email that I sent to you ,


I I did i it did occur to me that this is  uh , the return to the transcription , that there 's one third thing I wanted to  to ex raise as a to as an issue which is , um , how to handle breaths. So , I wanted to raise the question of whether people in speech recognition want to know where the breaths are. And the reason I ask the question is , um , aside from the fact that they 're obviously very time - consuming to encode , uh , the fact that there was some  I had the indication from Dan Ellis in the email that I sent to you ,

and you know about , that in principle we might be able to , um , handle breaths by accessi by using cross - talk from the other things , be able that  in principle , maybe we could get rid of them , so maybe  And I was  I  I don't know , I mean we had this an and I didn't  couldn't get back to you ,


and you know about , that in principle we might be able to , um , handle breaths by accessi by using cross - talk from the other things , be able that  in principle , maybe we could get rid of them , so maybe  And I was  I  I don't know , I mean we had this an and I didn't  couldn't get back to you ,

but the question of whether it 'd be possible to eliminate them from the audio signal , which would be the ideal situation ,


but the question of whether it 'd be possible to eliminate them from the audio signal , which would be the ideal situation ,


We - See , we 're  we 're dealing with real speech and we 're trying to have it be as real as possible


We - See , we 're  we 're dealing with real speech and we 're trying to have it be as real as possible

Well , except that these are really truly  I mean , ther there 's a segment in o the one I did  n the first one that I did for  i for this ,


Well , except that these are really truly  I mean , ther there 's a segment in o the one I did  n the first one that I did for  i for this ,


Well , except that these are really truly  I mean , ther there 's a segment in o the one I did  n the first one that I did for  i for this ,

where truly w we 're hearing you breathing like  as if we 're  you 're in our ear , you know , and it 's like  it 's like


where truly w we 're hearing you breathing like  as if we 're  you 're in our ear , you know , and it 's like  it 's like

I y i I mean , breath is natural , but not


I y i I mean , breath is natural , but not


I y i I mean , breath is natural , but not

Except that we 're  we 're trying to mimic  Oh , I see what you 're saying. You 're saying that the PDA application would have  uh , have to cope with breath.


Except that we 're  we 're trying to mimic  Oh , I see what you 're saying. You 're saying that the PDA application would have  uh , have to cope with breath.


but more people than just PDA users are interested in this corpus.


but more people than just PDA users are interested in this corpus.

OK , then the  then  I have two questions.


OK , then the  then  I have two questions.


OK , then the  then  I have two questions.

but I  I think  we don't wanna w remove it from the corpus ,  in terms of delivering it because the  people will want it in there.


but I  I think  we don't wanna w remove it from the corpus ,  in terms of delivering it because the  people will want it in there.


but I  I think  we don't wanna w remove it from the corpus ,  in terms of delivering it because the  people will want it in there.

OK , so maybe the question is notating it. Yeah ?


but I  I think  we don't wanna w remove it from the corpus ,  in terms of delivering it because the  people will want it in there.

OK , so maybe the question is notating it. Yeah ?

Yeah  i Right. If  if it gets in the way of what somebody is doing with it then you might wanna have some method which will allow you to block it , but you  it 's real data. You don't wanna b but you don't


OK , so maybe the question is notating it. Yeah ?

Yeah  i Right. If  if it gets in the way of what somebody is doing with it then you might wanna have some method which will allow you to block it , but you  it 's real data. You don't wanna b but you don't


OK , so maybe the question is notating it. Yeah ?

Yeah  i Right. If  if it gets in the way of what somebody is doing with it then you might wanna have some method which will allow you to block it , but you  it 's real data. You don't wanna b but you don't

If s you know , if there 's a little bit of noise out there , and somebody is  is talking about something they 're doing , that 's part of what we accept as part of a real meeting , even  And we have the f uh  the uh  the  the fan and the  in the projector up there , and , uh , this is  it 's  this is actual stuff that we  we wanna work with.


Yeah  i Right. If  if it gets in the way of what somebody is doing with it then you might wanna have some method which will allow you to block it , but you  it 's real data. You don't wanna b but you don't

If s you know , if there 's a little bit of noise out there , and somebody is  is talking about something they 're doing , that 's part of what we accept as part of a real meeting , even  And we have the f uh  the uh  the  the fan and the  in the projector up there , and , uh , this is  it 's  this is actual stuff that we  we wanna work with.


If s you know , if there 's a little bit of noise out there , and somebody is  is talking about something they 're doing , that 's part of what we accept as part of a real meeting , even  And we have the f uh  the uh  the  the fan and the  in the projector up there , and , uh , this is  it 's  this is actual stuff that we  we wanna work with.


If s you know , if there 's a little bit of noise out there , and somebody is  is talking about something they 're doing , that 's part of what we accept as part of a real meeting , even  And we have the f uh  the uh  the  the fan and the  in the projector up there , and , uh , this is  it 's  this is actual stuff that we  we wanna work with.

because i it basically has a i it shows very clearly the contrast between , uh , speech recognition research and discourse research because in  in discourse and linguistic research , what counts is what 's communit communicative.


because i it basically has a i it shows very clearly the contrast between , uh , speech recognition research and discourse research because in  in discourse and linguistic research , what counts is what 's communit communicative.


because i it basically has a i it shows very clearly the contrast between , uh , speech recognition research and discourse research because in  in discourse and linguistic research , what counts is what 's communit communicative.

And  breath , you know , everyone breathes , they breathe all the time. And once in a while breath is communicative , but r very rarely. OK , so now , I had a discussion with Chuck about the data structure


And  breath , you know , everyone breathes , they breathe all the time. And once in a while breath is communicative , but r very rarely. OK , so now , I had a discussion with Chuck about the data structure

and the idea is that the transcripts will  that  get stored as a master there 'll be a master transcript which has in it everything that 's needed for both of these uses.


and the idea is that the transcripts will  that  get stored as a master there 'll be a master transcript which has in it everything that 's needed for both of these uses.

And the one that 's used for speech recognition will be processed via scripts. You know , like , Don 's been writing scripts


And the one that 's used for speech recognition will be processed via scripts. You know , like , Don 's been writing scripts

and  and , uh , to process it for the speech recognition side. Discourse side will  have this  this side over he the  we we 'll have a s ch Sorry , not being very fluent here. But , um , this  the discourse side will have a script which will stri strip away the things which are non - communicative. OK. So then the  then  let 's  let 's think about the practicalities of how we get to that master copy with reference to breaths. So what I would  r r what I would wonder is would it be possible to encode those automatically ? Could we get a breath detector ?


And the one that 's used for speech recognition will be processed via scripts. You know , like , Don 's been writing scripts

and  and , uh , to process it for the speech recognition side. Discourse side will  have this  this side over he the  we we 'll have a s ch Sorry , not being very fluent here. But , um , this  the discourse side will have a script which will stri strip away the things which are non - communicative. OK. So then the  then  let 's  let 's think about the practicalities of how we get to that master copy with reference to breaths. So what I would  r r what I would wonder is would it be possible to encode those automatically ? Could we get a breath detector ?

Oh , just to save the transcribers time.


and  and , uh , to process it for the speech recognition side. Discourse side will  have this  this side over he the  we we 'll have a s ch Sorry , not being very fluent here. But , um , this  the discourse side will have a script which will stri strip away the things which are non - communicative. OK. So then the  then  let 's  let 's think about the practicalities of how we get to that master copy with reference to breaths. So what I would  r r what I would wonder is would it be possible to encode those automatically ? Could we get a breath detector ?

Oh , just to save the transcribers time.

Well , I mean , you just have no idea. I mean , if you 're getting a breath several times every minute ,


Oh , just to save the transcribers time.

Well , I mean , you just have no idea. I mean , if you 're getting a breath several times every minute ,

and just simply the keystrokes it takes to negotiate , to put the boundaries in , to  to type it in , i it 's just a huge amount of time.


Well , I mean , you just have no idea. I mean , if you 're getting a breath several times every minute ,

and just simply the keystrokes it takes to negotiate , to put the boundaries in , to  to type it in , i it 's just a huge amount of time.


and just simply the keystrokes it takes to negotiate , to put the boundaries in , to  to type it in , i it 's just a huge amount of time.


And you wanna be sure it 's used , and you wanna be sure it 's done as efficiently as possible , and if it can be done automatically , that would be ideal.


And you wanna be sure it 's used , and you wanna be sure it 's done as efficiently as possible , and if it can be done automatically , that would be ideal.

what if you put it in but didn't put the boundaries ?


And you wanna be sure it 's used , and you wanna be sure it 's done as efficiently as possible , and if it can be done automatically , that would be ideal.

what if you put it in but didn't put the boundaries ?

So you just know it 's between these other things ,


what if you put it in but didn't put the boundaries ?

So you just know it 's between these other things ,

Well , OK. So now there 's  there 's another  another possibility


So you just know it 's between these other things ,

Well , OK. So now there 's  there 's another  another possibility


So you just know it 's between these other things ,

Well , OK. So now there 's  there 's another  another possibility

which is , um , the time boundaries could mark off words  from nonwords. And that would be extremely time - effective , if that 's sufficient.


Well , OK. So now there 's  there 's another  another possibility

which is , um , the time boundaries could mark off words  from nonwords. And that would be extremely time - effective , if that 's sufficient.

Yeah I mean I 'm think if it 's too  if it 's too hard for us to annotate the breaths per se ,  we are gonna be building up models for these things and these things are somewhat self - aligning , so if  so ,  we  i i if we say there is some kind of a thing which we call a " breath " or a " breath - in " or " breath - out " ,  the models will learn that sort of thing. Uh , so  but you  but you do want them to point them at some region where  where the breaths really are. So


which is , um , the time boundaries could mark off words  from nonwords. And that would be extremely time - effective , if that 's sufficient.

Yeah I mean I 'm think if it 's too  if it 's too hard for us to annotate the breaths per se ,  we are gonna be building up models for these things and these things are somewhat self - aligning , so if  so ,  we  i i if we say there is some kind of a thing which we call a " breath " or a " breath - in " or " breath - out " ,  the models will learn that sort of thing. Uh , so  but you  but you do want them to point them at some region where  where the breaths really are. So

OK. But that would maybe include a pause as well ,


Yeah I mean I 'm think if it 's too  if it 's too hard for us to annotate the breaths per se ,  we are gonna be building up models for these things and these things are somewhat self - aligning , so if  so ,  we  i i if we say there is some kind of a thing which we call a " breath " or a " breath - in " or " breath - out " ,  the models will learn that sort of thing. Uh , so  but you  but you do want them to point them at some region where  where the breaths really are. So

OK. But that would maybe include a pause as well ,

and that wouldn't be a problem to have it , uh , pause plus breath plus laugh plus sneeze ?


OK. But that would maybe include a pause as well ,

and that wouldn't be a problem to have it , uh , pause plus breath plus laugh plus sneeze ?

Yeah , i You know there is  there 's this dynamic tension between  between marking absolutely everything , as you know , and  and  and marking just a little bit and counting on the statistical methods. Basically the more we can mark the better. But if there seems to be a lot of effort for a small amount of reward in some area , and this might be one like this  Although I  I  I 'd be interested to h get  get input from Liz and Andreas on this to see if they  Cuz they 've - they 've got lots of experience with the breaths in  in , uh , uh , their transcripts.


and that wouldn't be a problem to have it , uh , pause plus breath plus laugh plus sneeze ?

Yeah , i You know there is  there 's this dynamic tension between  between marking absolutely everything , as you know , and  and  and marking just a little bit and counting on the statistical methods. Basically the more we can mark the better. But if there seems to be a lot of effort for a small amount of reward in some area , and this might be one like this  Although I  I  I 'd be interested to h get  get input from Liz and Andreas on this to see if they  Cuz they 've - they 've got lots of experience with the breaths in  in , uh , uh , their transcripts.

They have lots of experience with breathing ?


and that wouldn't be a problem to have it , uh , pause plus breath plus laugh plus sneeze ?

Yeah , i You know there is  there 's this dynamic tension between  between marking absolutely everything , as you know , and  and  and marking just a little bit and counting on the statistical methods. Basically the more we can mark the better. But if there seems to be a lot of effort for a small amount of reward in some area , and this might be one like this  Although I  I  I 'd be interested to h get  get input from Liz and Andreas on this to see if they  Cuz they 've - they 've got lots of experience with the breaths in  in , uh , uh , their transcripts.

They have lots of experience with breathing ?

Actually  Well ,  yes they do , but we   we can handle that without them here. But  but  but , uh , you were gonna say something about


Yeah , i You know there is  there 's this dynamic tension between  between marking absolutely everything , as you know , and  and  and marking just a little bit and counting on the statistical methods. Basically the more we can mark the better. But if there seems to be a lot of effort for a small amount of reward in some area , and this might be one like this  Although I  I  I 'd be interested to h get  get input from Liz and Andreas on this to see if they  Cuz they 've - they 've got lots of experience with the breaths in  in , uh , uh , their transcripts.

They have lots of experience with breathing ?

Actually  Well ,  yes they do , but we   we can handle that without them here. But  but  but , uh , you were gonna say something about

Yeah , I  I think , um , one possible way that we could handle it is that , um , you know , as the transcribers are going through , and if they get a hunk of speech that they 're gonna transcribe , u th they 're gonna transcribe it because there 's words in there or whatnot. If there 's a breath in there , they could transcribe that.


They have lots of experience with breathing ?

Actually  Well ,  yes they do , but we   we can handle that without them here. But  but  but , uh , you were gonna say something about

Yeah , I  I think , um , one possible way that we could handle it is that , um , you know , as the transcribers are going through , and if they get a hunk of speech that they 're gonna transcribe , u th they 're gonna transcribe it because there 's words in there or whatnot. If there 's a breath in there , they could transcribe that.


Actually  Well ,  yes they do , but we   we can handle that without them here. But  but  but , uh , you were gonna say something about

Yeah , I  I think , um , one possible way that we could handle it is that , um , you know , as the transcribers are going through , and if they get a hunk of speech that they 're gonna transcribe , u th they 're gonna transcribe it because there 's words in there or whatnot. If there 's a breath in there , they could transcribe that.

That 's what they 've been doing. So , within an overlap segment , they  they do this.


Yeah , I  I think , um , one possible way that we could handle it is that , um , you know , as the transcribers are going through , and if they get a hunk of speech that they 're gonna transcribe , u th they 're gonna transcribe it because there 's words in there or whatnot. If there 's a breath in there , they could transcribe that.

That 's what they 've been doing. So , within an overlap segment , they  they do this.

Right. But  Right. But if there 's a big hunk of speech , let 's say on Morgan 's mike where he 's not talking at all , um , don't  don't worry about that.


That 's what they 've been doing. So , within an overlap segment , they  they do this.

Right. But  Right. But if there 's a big hunk of speech , let 's say on Morgan 's mike where he 's not talking at all , um , don't  don't worry about that.


That 's what they 've been doing. So , within an overlap segment , they  they do this.

Right. But  Right. But if there 's a big hunk of speech , let 's say on Morgan 's mike where he 's not talking at all , um , don't  don't worry about that.

So what we 're saying is , there 's no guarantee that , um  So for the chunks that are transcribed , everything 's transcribed. But outside of those boundaries , there could have been stuff that wasn't transcribed. So you just  somebody can't rely on that data and say " that 's perfectly clean data ". Uh  do you see what I 'm saying ?


Right. But  Right. But if there 's a big hunk of speech , let 's say on Morgan 's mike where he 's not talking at all , um , don't  don't worry about that.

So what we 're saying is , there 's no guarantee that , um  So for the chunks that are transcribed , everything 's transcribed. But outside of those boundaries , there could have been stuff that wasn't transcribed. So you just  somebody can't rely on that data and say " that 's perfectly clean data ". Uh  do you see what I 'm saying ?

Yeah , you 're saying it 's  uncharted territory.


So what we 're saying is , there 's no guarantee that , um  So for the chunks that are transcribed , everything 's transcribed. But outside of those boundaries , there could have been stuff that wasn't transcribed. So you just  somebody can't rely on that data and say " that 's perfectly clean data ". Uh  do you see what I 'm saying ?

Yeah , you 're saying it 's  uncharted territory.

So I would say don't tell them to transcribe anything that 's outside of a grouping of words.


So what we 're saying is , there 's no guarantee that , um  So for the chunks that are transcribed , everything 's transcribed. But outside of those boundaries , there could have been stuff that wasn't transcribed. So you just  somebody can't rely on that data and say " that 's perfectly clean data ". Uh  do you see what I 'm saying ?

Yeah , you 're saying it 's  uncharted territory.

So I would say don't tell them to transcribe anything that 's outside of a grouping of words.

That sounds like a reasonable  reasonable compromise.


Yeah , you 're saying it 's  uncharted territory.

So I would say don't tell them to transcribe anything that 's outside of a grouping of words.

That sounds like a reasonable  reasonable compromise.

Yeah , and that 's  that  that quite co corresponds to the way I  I try to train the speech - nonspeech detector , as I really try to  not to detect those breaths which are not within a speech chunk but with  which are just in  in a silence region.


So I would say don't tell them to transcribe anything that 's outside of a grouping of words.

That sounds like a reasonable  reasonable compromise.

Yeah , and that 's  that  that quite co corresponds to the way I  I try to train the speech - nonspeech detector , as I really try to  not to detect those breaths which are not within a speech chunk but with  which are just in  in a silence region.


That sounds like a reasonable  reasonable compromise.

Yeah , and that 's  that  that quite co corresponds to the way I  I try to train the speech - nonspeech detector , as I really try to  not to detect those breaths which are not within a speech chunk but with  which are just in  in a silence region.

And they  so they hopefully won't be marked in  in those channel - specific files.


Yeah , and that 's  that  that quite co corresponds to the way I  I try to train the speech - nonspeech detector , as I really try to  not to detect those breaths which are not within a speech chunk but with  which are just in  in a silence region.

And they  so they hopefully won't be marked in  in those channel - specific files.

u I  I wanted to comment a little more just for clarification about this business about the different purposes.


And they  so they hopefully won't be marked in  in those channel - specific files.

u I  I wanted to comment a little more just for clarification about this business about the different purposes.


u I  I wanted to comment a little more just for clarification about this business about the different purposes.


See , in a  in a way this is a really key point , that for speech recognition , uh , research , uh , um , e a  it 's not just a minor part. In fact , the  I think I would say the core thing that we 're trying to do is to recognize the actual , meaningful components in the midst of other things that are not meaningful. So it 's critical  it 's not just incidental it 's critical for us to get these other components that are not meaningful. Because that 's what we 're trying to pull the other out of. That 's our problem. If we had nothing


See , in a  in a way this is a really key point , that for speech recognition , uh , research , uh , um , e a  it 's not just a minor part. In fact , the  I think I would say the core thing that we 're trying to do is to recognize the actual , meaningful components in the midst of other things that are not meaningful. So it 's critical  it 's not just incidental it 's critical for us to get these other components that are not meaningful. Because that 's what we 're trying to pull the other out of. That 's our problem. If we had nothing

if we had only linguistically - relevant things  if  if we only had changes in the spectrum that were associated with words , with different spectral components , and , uh , we  we didn't have noise , we didn't have convolutional errors , we didn't have extraneous , uh , behaviors , and so forth , and  moving your head and all these sorts of things , then , actually speech recognition i i isn't that bad right now. I mean you can you know it 's   it 's  the technology 's come along pretty well.


if we had only linguistically - relevant things  if  if we only had changes in the spectrum that were associated with words , with different spectral components , and , uh , we  we didn't have noise , we didn't have convolutional errors , we didn't have extraneous , uh , behaviors , and so forth , and  moving your head and all these sorts of things , then , actually speech recognition i i isn't that bad right now. I mean you can you know it 's   it 's  the technology 's come along pretty well.

The  the  the reason we still complain about it is because is  when  when you have more realistic conditions then  then things fall apart.


if we had only linguistically - relevant things  if  if we only had changes in the spectrum that were associated with words , with different spectral components , and , uh , we  we didn't have noise , we didn't have convolutional errors , we didn't have extraneous , uh , behaviors , and so forth , and  moving your head and all these sorts of things , then , actually speech recognition i i isn't that bad right now. I mean you can you know it 's   it 's  the technology 's come along pretty well.

The  the  the reason we still complain about it is because is  when  when you have more realistic conditions then  then things fall apart.

OK , fair enough. I guess , um , I  uh , what I was wondering is what  what  at what level does the breathing aspect enter into the problem ? Because if it were likely that a PDA would be able to be built which would get rid of the breathing , so it wouldn't even have to be processed at thi at this computational le well , let me see , it 'd have to be computationally processed to get rid of it , but if there were , uh , like likely on the frontier , a good breath extractor then , um , and then you 'd have to


The  the  the reason we still complain about it is because is  when  when you have more realistic conditions then  then things fall apart.

OK , fair enough. I guess , um , I  uh , what I was wondering is what  what  at what level does the breathing aspect enter into the problem ? Because if it were likely that a PDA would be able to be built which would get rid of the breathing , so it wouldn't even have to be processed at thi at this computational le well , let me see , it 'd have to be computationally processed to get rid of it , but if there were , uh , like likely on the frontier , a good breath extractor then , um , and then you 'd have to

But that 's a research question , you know ? And so


The  the  the reason we still complain about it is because is  when  when you have more realistic conditions then  then things fall apart.

OK , fair enough. I guess , um , I  uh , what I was wondering is what  what  at what level does the breathing aspect enter into the problem ? Because if it were likely that a PDA would be able to be built which would get rid of the breathing , so it wouldn't even have to be processed at thi at this computational le well , let me see , it 'd have to be computationally processed to get rid of it , but if there were , uh , like likely on the frontier , a good breath extractor then , um , and then you 'd have to

But that 's a research question , you know ? And so

Yeah , well , see and that 's what I wouldn't know.


OK , fair enough. I guess , um , I  uh , what I was wondering is what  what  at what level does the breathing aspect enter into the problem ? Because if it were likely that a PDA would be able to be built which would get rid of the breathing , so it wouldn't even have to be processed at thi at this computational le well , let me see , it 'd have to be computationally processed to get rid of it , but if there were , uh , like likely on the frontier , a good breath extractor then , um , and then you 'd have to

But that 's a research question , you know ? And so

Yeah , well , see and that 's what I wouldn't know.

that  And we don't either. I mean so  so the thing is it 's  it  right now it 's just raw d it 's just data that we 're collecting , and so  we don't wanna presuppose that people will be able to get rid of particular degradations because that 's actually the research that we 're trying to feed. So , you know , an and maybe  maybe in five years it 'll work really well ,


But that 's a research question , you know ? And so

Yeah , well , see and that 's what I wouldn't know.

that  And we don't either. I mean so  so the thing is it 's  it  right now it 's just raw d it 's just data that we 're collecting , and so  we don't wanna presuppose that people will be able to get rid of particular degradations because that 's actually the research that we 're trying to feed. So , you know , an and maybe  maybe in five years it 'll work really well ,


Yeah , well , see and that 's what I wouldn't know.

that  And we don't either. I mean so  so the thing is it 's  it  right now it 's just raw d it 's just data that we 're collecting , and so  we don't wanna presuppose that people will be able to get rid of particular degradations because that 's actually the research that we 're trying to feed. So , you know , an and maybe  maybe in five years it 'll work really well ,

and  and it 'll only mess - up ten percent of the time , but then we would still want to account for that ten percent , so.


that  And we don't either. I mean so  so the thing is it 's  it  right now it 's just raw d it 's just data that we 're collecting , and so  we don't wanna presuppose that people will be able to get rid of particular degradations because that 's actually the research that we 're trying to feed. So , you know , an and maybe  maybe in five years it 'll work really well ,

and  and it 'll only mess - up ten percent of the time , but then we would still want to account for that ten percent , so.

I guess there 's another aspect which is that as we 've improved our microphone technique , we have a lot less breath in the  in the more recent , uh , recordings , so it 's  in a way it 's an artifact that there 's so much on the  on the earlier ones.


and  and it 'll only mess - up ten percent of the time , but then we would still want to account for that ten percent , so.

I guess there 's another aspect which is that as we 've improved our microphone technique , we have a lot less breath in the  in the more recent , uh , recordings , so it 's  in a way it 's an artifact that there 's so much on the  on the earlier ones.


and  and it 'll only mess - up ten percent of the time , but then we would still want to account for that ten percent , so.

I guess there 's another aspect which is that as we 've improved our microphone technique , we have a lot less breath in the  in the more recent , uh , recordings , so it 's  in a way it 's an artifact that there 's so much on the  on the earlier ones.

One of the  um , just to add to this  one of the ways that we will be able to get rid of breath is by having models for them. I mean , that 's what a lot of people do nowadays.


I guess there 's another aspect which is that as we 've improved our microphone technique , we have a lot less breath in the  in the more recent , uh , recordings , so it 's  in a way it 's an artifact that there 's so much on the  on the earlier ones.

One of the  um , just to add to this  one of the ways that we will be able to get rid of breath is by having models for them. I mean , that 's what a lot of people do nowadays.


One of the  um , just to add to this  one of the ways that we will be able to get rid of breath is by having models for them. I mean , that 's what a lot of people do nowadays.


And so in order to build the model you need to have some amount of it marked , so that you know where the boundaries are.


And so in order to build the model you need to have some amount of it marked , so that you know where the boundaries are.

So  I mean , I don't think we need to worry a lot about breaths that are happening outside of a , you know , conversation. We don't have to go and search for them to  to mark them at all , but , I mean , if they 're there while they 're transcribing some hunk of words , I 'd say put them in if possible.


So  I mean , I don't think we need to worry a lot about breaths that are happening outside of a , you know , conversation. We don't have to go and search for them to  to mark them at all , but , I mean , if they 're there while they 're transcribing some hunk of words , I 'd say put them in if possible.

OK , and it 's also the fact that they differ a lot from one channel to the other because of the way the microphone 's adjusted.


OK , and it 's also the fact that they differ a lot from one channel to the other because of the way the microphone 's adjusted.


And ,  somewhere is my agenda. I think the most important thing is Morgan wanted to talk about , uh , the ARPA  demo.


And ,  somewhere is my agenda. I think the most important thing is Morgan wanted to talk about , uh , the ARPA  demo.

Well , so , here 's the thing. Um , why don't we s again start off with  with , uh , Yeah , I 'll get it. I 'll get the door. Um , I think we want to start off with the agenda. And then , given that , uh , Liz and Andreas are gonna be  ten , fifteen minutes late , we can try to figure out what we can do most effectively without them here. So   So  so , one thing is , yeah , talk about demo ,


And ,  somewhere is my agenda. I think the most important thing is Morgan wanted to talk about , uh , the ARPA  demo.

Well , so , here 's the thing. Um , why don't we s again start off with  with , uh , Yeah , I 'll get it. I 'll get the door. Um , I think we want to start off with the agenda. And then , given that , uh , Liz and Andreas are gonna be  ten , fifteen minutes late , we can try to figure out what we can do most effectively without them here. So   So  so , one thing is , yeah , talk about demo ,

OK. So , uh  uh , IBM transcription status ,


Well , so , here 's the thing. Um , why don't we s again start off with  with , uh , Yeah , I 'll get it. I 'll get the door. Um , I think we want to start off with the agenda. And then , given that , uh , Liz and Andreas are gonna be  ten , fifteen minutes late , we can try to figure out what we can do most effectively without them here. So   So  so , one thing is , yeah , talk about demo ,

OK. So , uh  uh , IBM transcription status ,


OK. So , uh  uh , IBM transcription status ,

Uh , we wanna talk about if w if we wanna add the data to the mar Meeting Recorder corpus.


Uh , we wanna talk about if w if we wanna add the data to the mar Meeting Recorder corpus.

The data. The data which we are collecting here.


Uh , we wanna talk about if w if we wanna add the data to the mar Meeting Recorder corpus.

The data. The data which we are collecting here.

What  what  what are we collecting here ?


The data. The data which we are collecting here.

What  what  what are we collecting here ?

So why don't we have that on the agenda and we 'll  we 'll get to it and talk about it ?


What  what  what are we collecting here ?

So why don't we have that on the agenda and we 'll  we 'll get to it and talk about it ?


So why don't we have that on the agenda and we 'll  we 'll get to it and talk about it ?


Yep. Uh - huh. Absinthe , which is the multiprocessor UNIX  Linux. I think it was  Andreas wanted to talk about segmentation and recognition , and update on SRI recognition experiments.


Yep. Uh - huh. Absinthe , which is the multiprocessor UNIX  Linux. I think it was  Andreas wanted to talk about segmentation and recognition , and update on SRI recognition experiments.

And then if ti if there 's time I wanted to talk about digits , but it looked like we were pretty full , so I can wait till next week.


Yep. Uh - huh. Absinthe , which is the multiprocessor UNIX  Linux. I think it was  Andreas wanted to talk about segmentation and recognition , and update on SRI recognition experiments.

And then if ti if there 's time I wanted to talk about digits , but it looked like we were pretty full , so I can wait till next week.

Right. OK. Well , let 's see. I think the a certainly the segmentation and recognition we wanna maybe focus on when An - Andreas is here since that was particularly his thing.


And then if ti if there 's time I wanted to talk about digits , but it looked like we were pretty full , so I can wait till next week.

Right. OK. Well , let 's see. I think the a certainly the segmentation and recognition we wanna maybe focus on when An - Andreas is here since that was particularly his thing.


And then if ti if there 's time I wanted to talk about digits , but it looked like we were pretty full , so I can wait till next week.

Right. OK. Well , let 's see. I think the a certainly the segmentation and recognition we wanna maybe focus on when An - Andreas is here since that was particularly his thing.

SmartKom also , Andreas. Absinthe , I think also he has sort of been involved in a lot of those things.


Right. OK. Well , let 's see. I think the a certainly the segmentation and recognition we wanna maybe focus on when An - Andreas is here since that was particularly his thing.

SmartKom also , Andreas. Absinthe , I think also he has sort of been involved in a lot of those things.


SmartKom also , Andreas. Absinthe , I think also he has sort of been involved in a lot of those things.


SmartKom also , Andreas. Absinthe , I think also he has sort of been involved in a lot of those things.

yeah , he 'll t he 'll probably be interested.


yeah , he 'll t he 'll probably be interested.


yeah , he 'll t he 'll probably be interested.

Um So , I mean , I think they 'll be inter I 'll be interested in all this , but  but , uh , probably , if we had to pick something  that we would talk on for ten minutes or so while they 're coming here. Or I guess it would be , you think , reorganization status , or  ?


Um So , I mean , I think they 'll be inter I 'll be interested in all this , but  but , uh , probably , if we had to pick something  that we would talk on for ten minutes or so while they 're coming here. Or I guess it would be , you think , reorganization status , or  ?

Yeah. I mean , I think , Chuck was the one who added out the agenda item. I don't really have anything to say other than that we still haven't done it.


Um So , I mean , I think they 'll be inter I 'll be interested in all this , but  but , uh , probably , if we had to pick something  that we would talk on for ten minutes or so while they 're coming here. Or I guess it would be , you think , reorganization status , or  ?

Yeah. I mean , I think , Chuck was the one who added out the agenda item. I don't really have anything to say other than that we still haven't done it.

Well , I mean , I uh   just basically that


Yeah. I mean , I think , Chuck was the one who added out the agenda item. I don't really have anything to say other than that we still haven't done it.

Well , I mean , I uh   just basically that

maybe I said  maybe we said this before  just that we met and we talked about it and we sort of have a plan for getting things organized and


Well , I mean , I uh   just basically that

maybe I said  maybe we said this before  just that we met and we talked about it and we sort of have a plan for getting things organized and

And I  and I think a crucial part of that is the idea of  of not wanting to do it until right before the next level zero back - up so that there won't be huge number of  of added ,


maybe I said  maybe we said this before  just that we met and we talked about it and we sort of have a plan for getting things organized and

And I  and I think a crucial part of that is the idea of  of not wanting to do it until right before the next level zero back - up so that there won't be huge number of  of added ,


And I  and I think a crucial part of that is the idea of  of not wanting to do it until right before the next level zero back - up so that there won't be huge number of  of added ,


That  that was basically it. Not  not much @ @


That  that was basically it. Not  not much @ @

Although Dave basically said that if we wanna do it , just tell him and he 'll do a d level zero then.


Although Dave basically said that if we wanna do it , just tell him and he 'll do a d level zero then.


Oh , so maybe we should just go ahead and get everything ready , and


Oh , so maybe we should just go ahead and get everything ready , and

Yep. So , I think we do need to talk a little bit about  Well , we don't need to do it during this meeting.


Oh , so maybe we should just go ahead and get everything ready , and

Yep. So , I think we do need to talk a little bit about  Well , we don't need to do it during this meeting.

We have a little more to discuss. But , uh , we 're  we 're basically ready to do it. And , uh , I have some web pages on ts  more of the background. So , naming conventions and things like that , that I 've been trying to keep actually up to date. So. And I 've been sharing them with U - d UW folks also.


Yep. So , I think we do need to talk a little bit about  Well , we don't need to do it during this meeting.

We have a little more to discuss. But , uh , we 're  we 're basically ready to do it. And , uh , I have some web pages on ts  more of the background. So , naming conventions and things like that , that I 've been trying to keep actually up to date. So. And I 've been sharing them with U - d UW folks also.

I 'm sorry , you 've been what ? Showing them ?


We have a little more to discuss. But , uh , we 're  we 're basically ready to do it. And , uh , I have some web pages on ts  more of the background. So , naming conventions and things like that , that I 've been trying to keep actually up to date. So. And I 've been sharing them with U - d UW folks also.

I 'm sorry , you 've been what ? Showing them ?


I 'm sorry , you 've been what ? Showing them ?


OK. Well , maybe uh , since that  that was a pretty short one , maybe we should talk about the IBM transcription status. Someone can  fill in Liz and Andreas later. Uh


OK. Well , maybe uh , since that  that was a pretty short one , maybe we should talk about the IBM transcription status. Someone can  fill in Liz and Andreas later. Uh

OK. So , we , uh  we did another version of the beeps , where we separated each beeps with a spoken digit. Chuck came up here and recorded some di himself speaking some digits , and so it just goes " beep one beep " and then the phrase , and then " beep two beep " and then the phrase. And that seems pretty good. Um , I think they 'll have a b easier time keeping track of where they are in the file.


OK. Well , maybe uh , since that  that was a pretty short one , maybe we should talk about the IBM transcription status. Someone can  fill in Liz and Andreas later. Uh

OK. So , we , uh  we did another version of the beeps , where we separated each beeps with a spoken digit. Chuck came up here and recorded some di himself speaking some digits , and so it just goes " beep one beep " and then the phrase , and then " beep two beep " and then the phrase. And that seems pretty good. Um , I think they 'll have a b easier time keeping track of where they are in the file.

And we have done that on the  automatic segmentations.


OK. Well , maybe uh , since that  that was a pretty short one , maybe we should talk about the IBM transcription status. Someone can  fill in Liz and Andreas later. Uh

OK. So , we , uh  we did another version of the beeps , where we separated each beeps with a spoken digit. Chuck came up here and recorded some di himself speaking some digits , and so it just goes " beep one beep " and then the phrase , and then " beep two beep " and then the phrase. And that seems pretty good. Um , I think they 'll have a b easier time keeping track of where they are in the file.

And we have done that on the  automatic segmentations.

And we did it with the automatic segmentation , and I don't think  We ne we didn't look at it in detail. We just sent it to IBM. We  we sorta spot - checked it.


OK. So , we , uh  we did another version of the beeps , where we separated each beeps with a spoken digit. Chuck came up here and recorded some di himself speaking some digits , and so it just goes " beep one beep " and then the phrase , and then " beep two beep " and then the phrase. And that seems pretty good. Um , I think they 'll have a b easier time keeping track of where they are in the file.

And we have done that on the  automatic segmentations.

And we did it with the automatic segmentation , and I don't think  We ne we didn't look at it in detail. We just sent it to IBM. We  we sorta spot - checked it.

I listened to  probably , uh , five or ten minutes of it from the beginning.


And we have done that on the  automatic segmentations.

And we did it with the automatic segmentation , and I don't think  We ne we didn't look at it in detail. We just sent it to IBM. We  we sorta spot - checked it.

I listened to  probably , uh , five or ten minutes of it from the beginning.


And we did it with the automatic segmentation , and I don't think  We ne we didn't look at it in detail. We just sent it to IBM. We  we sorta spot - checked it.

I listened to  probably , uh , five or ten minutes of it from the beginning.


I listened to  probably , uh , five or ten minutes of it from the beginning.


I sorta spot - checked here and there and it sounded pretty good. So. I think it 'll work.


I sorta spot - checked here and there and it sounded pretty good. So. I think it 'll work.

And , uh , we 'll just hafta see what we get back from them. Uh


I sorta spot - checked here and there and it sounded pretty good. So. I think it 'll work.

And , uh , we 'll just hafta see what we get back from them. Uh

And the main thing will be if we can align what they give us with what we sent them. I mean , that 's the crucial part.


And , uh , we 'll just hafta see what we get back from them. Uh

And the main thing will be if we can align what they give us with what we sent them. I mean , that 's the crucial part.


And , uh , we 'll just hafta see what we get back from them. Uh

And the main thing will be if we can align what they give us with what we sent them. I mean , that 's the crucial part.

And I think we 'll be able to do that at  with this new beep format.


And the main thing will be if we can align what they give us with what we sent them. I mean , that 's the crucial part.

And I think we 'll be able to do that at  with this new beep format.

Yep. Well , I think it 's also they are much less likely to d have errors.


And I think we 'll be able to do that at  with this new beep format.

Yep. Well , I think it 's also they are much less likely to d have errors.


And I think we 'll be able to do that at  with this new beep format.

Yep. Well , I think it 's also they are much less likely to d have errors.

I mean , so the problem wi last time is that there were errors in the transcripts where they put beeps where there weren't any , or  and they put in extraneous beeps.


Yep. Well , I think it 's also they are much less likely to d have errors.

I mean , so the problem wi last time is that there were errors in the transcripts where they put beeps where there weren't any , or  and they put in extraneous beeps.


I mean , so the problem wi last time is that there were errors in the transcripts where they put beeps where there weren't any , or  and they put in extraneous beeps.

And with the numbers there , it 's much less likely.


I mean , so the problem wi last time is that there were errors in the transcripts where they put beeps where there weren't any , or  and they put in extraneous beeps.

And with the numbers there , it 's much less likely.

Yeah , one interesting note is  uh , or problem  I dunno if this was just because of how I play it back , I say , uh , SND - play and then the file , every once in a while , @ @  uh , like a beep sounds like it 's cut into two beeps.


And with the numbers there , it 's much less likely.

Yeah , one interesting note is  uh , or problem  I dunno if this was just because of how I play it back , I say , uh , SND - play and then the file , every once in a while , @ @  uh , like a beep sounds like it 's cut into two beeps.


And with the numbers there , it 's much less likely.

Yeah , one interesting note is  uh , or problem  I dunno if this was just because of how I play it back , I say , uh , SND - play and then the file , every once in a while , @ @  uh , like a beep sounds like it 's cut into two beeps.

Yeah , and I  I dunno if that 's an , uh , artifact of playback


Yeah , one interesting note is  uh , or problem  I dunno if this was just because of how I play it back , I say , uh , SND - play and then the file , every once in a while , @ @  uh , like a beep sounds like it 's cut into two beeps.

Yeah , and I  I dunno if that 's an , uh , artifact of playback


Yeah , and I  I dunno if that 's an , uh , artifact of playback

bu uh , I don't think it 's probably in the original file. Um , but , uh


bu uh , I don't think it 's probably in the original file. Um , but , uh

Ha. That 's interesting. I didn't hear that.


bu uh , I don't think it 's probably in the original file. Um , but , uh

Ha. That 's interesting. I didn't hear that.

Yeah. But with this new format , um , that hopefully they 're not hearing that , and if they are , it shouldn't throw them.


Ha. That 's interesting. I didn't hear that.

Yeah. But with this new format , um , that hopefully they 're not hearing that , and if they are , it shouldn't throw them.


Yeah. But with this new format , um , that hopefully they 're not hearing that , and if they are , it shouldn't throw them.

Well , maybe we better listen to it again , make sure , but , I mean , certainly the software shouldn't do that ,


Well , maybe we better listen to it again , make sure , but , I mean , certainly the software shouldn't do that ,


I it 's probably just , you know , mmm , somehow the audio  device gets hung for a second ,


As long as they have one number , and they know that there 's only one beep maximum  that goes with that number.


Yeah. The only  the only part that might be confusing is when Chuck is reading digits.


Yeah. The only  the only part that might be confusing is when Chuck is reading digits.

Well , you know , actually , are we having them


Well , you know , actually , are we having them


Well , you know , actually , are we having them

" Seven four eight beep seven beep  eight three two ".


Well , you know , actually , are we having them

" Seven four eight beep seven beep  eight three two ".

Yeah , but are we having them do digits ?


" Seven four eight beep seven beep  eight three two ".

Yeah , but are we having them do digits ?

Yes. Because , uh , we don't  we didn't  In order to cut them out we 'd have to listen to it.


Yeah , but are we having them do digits ?

Yes. Because , uh , we don't  we didn't  In order to cut them out we 'd have to listen to it.

Yeah. They are not transcribed yet. So. Yeah.


Yes. Because , uh , we don't  we didn't  In order to cut them out we 'd have to listen to it.

Yeah. They are not transcribed yet. So. Yeah.


Yeah. They are not transcribed yet. So. Yeah.


so we  they are transcribing the digits.


so we  they are transcribing the digits.

We can  we can ignore it when we get it back ,


so we  they are transcribing the digits.

We can  we can ignore it when we get it back ,

Although we could tell them    we could tell them , if you hear someone reading a digits string just say " bracket digit bracket "


We can  we can ignore it when we get it back ,

Although we could tell them    we could tell them , if you hear someone reading a digits string just say " bracket digit bracket "


We can  we can ignore it when we get it back ,

Although we could tell them    we could tell them , if you hear someone reading a digits string just say " bracket digit bracket "

and don't bother actually computing the di writing down the digits.


Although we could tell them    we could tell them , if you hear someone reading a digits string just say " bracket digit bracket "

and don't bother actually computing the di writing down the digits.


and don't bother actually computing the di writing down the digits.

That 'd be great. That 'd be what I 'm having the transcribers here do , cuz it can be extracted later.


and don't bother actually computing the di writing down the digits.

That 'd be great. That 'd be what I 'm having the transcribers here do , cuz it can be extracted later.

Yep. And then I wanted to talk about  but as I said I  we may not have time  what we should do about digits. We have a whole pile of digits that haven't been transcribed.


That 'd be great. That 'd be what I 'm having the transcribers here do , cuz it can be extracted later.

Yep. And then I wanted to talk about  but as I said I  we may not have time  what we should do about digits. We have a whole pile of digits that haven't been transcribed.

Le - let 's talk about it , because that 's  that 's something that I  I know Andreas is less interested in than Liz is ,


Yep. And then I wanted to talk about  but as I said I  we may not have time  what we should do about digits. We have a whole pile of digits that haven't been transcribed.

Le - let 's talk about it , because that 's  that 's something that I  I know Andreas is less interested in than Liz is ,


Le - let 's talk about it , because that 's  that 's something that I  I know Andreas is less interested in than Liz is ,

Do we have anything else to say about transcription ? About IBM stuff ?


Do we have anything else to say about transcription ? About IBM stuff ?

Uh , Brian  I  I  sent bresset    sent Brian a message about   the meeting and I haven't heard back yet. So. I g hope he got it and hopefully he 's


Uh , Brian  I  I  sent bresset    sent Brian a message about   the meeting and I haven't heard back yet. So. I g hope he got it and hopefully he 's

maybe he 's gone , I dunno. He didn't even reply to my message. So. I should probably ping him just to make sure that he got it.


maybe he 's gone , I dunno. He didn't even reply to my message. So. I should probably ping him just to make sure that he got it.

Alright. So , we have a whole bunch of digits , if we wanna move on to digits.


maybe he 's gone , I dunno. He didn't even reply to my message. So. I should probably ping him just to make sure that he got it.

Alright. So , we have a whole bunch of digits , if we wanna move on to digits.

Actually , maybe I  One  one relate more related thing in transcription. So that 's the IBM stuff. We 've got that sorted out. Um , how 're we doing on the  on the rest of it ?


maybe he 's gone , I dunno. He didn't even reply to my message. So. I should probably ping him just to make sure that he got it.

Alright. So , we have a whole bunch of digits , if we wanna move on to digits.

Actually , maybe I  One  one relate more related thing in transcription. So that 's the IBM stuff. We 've got that sorted out. Um , how 're we doing on the  on the rest of it ?

We 're doing well. I  I hire  I 've hired two extra people already , expect to hire two more.


Alright. So , we have a whole bunch of digits , if we wanna move on to digits.

Actually , maybe I  One  one relate more related thing in transcription. So that 's the IBM stuff. We 've got that sorted out. Um , how 're we doing on the  on the rest of it ?

We 're doing well. I  I hire  I 've hired two extra people already , expect to hire two more.


Actually , maybe I  One  one relate more related thing in transcription. So that 's the IBM stuff. We 've got that sorted out. Um , how 're we doing on the  on the rest of it ?

We 're doing well. I  I hire  I 've hired two extra people already , expect to hire two more.

And , um ,  I 've prepared , um , uh , a set of five which I 'm  which I 'm calling set two , which are now being edited by my head transcriber ,  in terms of spelling errors and all that. She 's also checking through and mar and   and monitoring , um , the transcription of another transcriber. You know , I mean , she 's going through and doing these kinds of checks.


We 're doing well. I  I hire  I 've hired two extra people already , expect to hire two more.

And , um ,  I 've prepared , um , uh , a set of five which I 'm  which I 'm calling set two , which are now being edited by my head transcriber ,  in terms of spelling errors and all that. She 's also checking through and mar and   and monitoring , um , the transcription of another transcriber. You know , I mean , she 's going through and doing these kinds of checks.


And , um ,  I 've prepared , um , uh , a set of five which I 'm  which I 'm calling set two , which are now being edited by my head transcriber ,  in terms of spelling errors and all that. She 's also checking through and mar and   and monitoring , um , the transcription of another transcriber. You know , I mean , she 's going through and doing these kinds of checks.

And , I 've moved on now to what I 'm calling set three. I sort of thought if I do it in sets  groups of five , then I can have , like , sort of a  a parallel processing through  through the  the current.


And , I 've moved on now to what I 'm calling set three. I sort of thought if I do it in sets  groups of five , then I can have , like , sort of a  a parallel processing through  through the  the current.

And  and you indicated to me that we have a g a goal now ,  for the  for the , um ,   the , uh , DARPA demo , of twenty hours. So , I 'm gonna go up to twenty hours , be sure that everything gets processed , and released , and    and that 's  that 's what my goal is. Package of twenty hours right now ,  and then once that 's done , move on to the next.


And , I 've moved on now to what I 'm calling set three. I sort of thought if I do it in sets  groups of five , then I can have , like , sort of a  a parallel processing through  through the  the current.

And  and you indicated to me that we have a g a goal now ,  for the  for the , um ,   the , uh , DARPA demo , of twenty hours. So , I 'm gonna go up to twenty hours , be sure that everything gets processed , and released , and    and that 's  that 's what my goal is. Package of twenty hours right now ,  and then once that 's done , move on to the next.

Yeah , uh , so twenty hours. But I guess the other thing is that , um , that  that 's kinda twenty hours ASAP because the longer before the demo we actually have the twenty hours , the more time it 'll be for people to actually do cool things with it.


And  and you indicated to me that we have a g a goal now ,  for the  for the , um ,   the , uh , DARPA demo , of twenty hours. So , I 'm gonna go up to twenty hours , be sure that everything gets processed , and released , and    and that 's  that 's what my goal is. Package of twenty hours right now ,  and then once that 's done , move on to the next.

Yeah , uh , so twenty hours. But I guess the other thing is that , um , that  that 's kinda twenty hours ASAP because the longer before the demo we actually have the twenty hours , the more time it 'll be for people to actually do cool things with it.

Mm - hmm. Good. I 'm  I 'm hiring people who ,  uh , really are


Yeah , uh , so twenty hours. But I guess the other thing is that , um , that  that 's kinda twenty hours ASAP because the longer before the demo we actually have the twenty hours , the more time it 'll be for people to actually do cool things with it.

Mm - hmm. Good. I 'm  I 'm hiring people who ,  uh , really are

They would like to do it full - time , several of these people. And  and I don't think it 's  possible , really , to do this full - time , but , that  what it shows is motivation to do as many hours as possible.


Mm - hmm. Good. I 'm  I 'm hiring people who ,  uh , really are

They would like to do it full - time , several of these people. And  and I don't think it 's  possible , really , to do this full - time , but , that  what it shows is motivation to do as many hours as possible.


They would like to do it full - time , several of these people. And  and I don't think it 's  possible , really , to do this full - time , but , that  what it shows is motivation to do as many hours as possible.


Yeah , I mean , I guess the  So the difference if  if , um , if the IBM stuff works out , the difference in the job would be that they p primarily would be checking through things that were already done by someone else ?


Correcting. We 'll  we 'll expect that they 'll have to move some time bins and do some corrections.


Correcting. We 'll  we 'll expect that they 'll have to move some time bins and do some corrections.

And I  you know , I 've also d uh , discovered  So with the new transcriber I 'm  um  So  Uh , lemme say that my , uh  So , um  At present , um , the people have been doing these transcriptions a channel at a time. And , that sort of , um ,  is useful , and t you know , and then once in a while they 'll have to refer to the other channels to clear something up. OK. Well ,  I realize that , um , w i we we 're using the pre - segmented version , and , um , the pre - segmented version is extremely useful , and wouldn't it be , useful also to have the visual representation of those segments ? And so I 've   uh ,  I , uh , uh , I 've  trained the new one  uh , the new the newest one ,  to , um ,  use the visual from the channel that is gonna be transcribed at any given time. And that 's just amazingly helpful. Because what happens then , is you scan across the signal and once in a while you 'll find a blip that didn't show up in the pre - segmentation.


Correcting. We 'll  we 'll expect that they 'll have to move some time bins and do some corrections.

And I  you know , I 've also d uh , discovered  So with the new transcriber I 'm  um  So  Uh , lemme say that my , uh  So , um  At present , um , the people have been doing these transcriptions a channel at a time. And , that sort of , um ,  is useful , and t you know , and then once in a while they 'll have to refer to the other channels to clear something up. OK. Well ,  I realize that , um , w i we we 're using the pre - segmented version , and , um , the pre - segmented version is extremely useful , and wouldn't it be , useful also to have the visual representation of those segments ? And so I 've   uh ,  I , uh , uh , I 've  trained the new one  uh , the new the newest one ,  to , um ,  use the visual from the channel that is gonna be transcribed at any given time. And that 's just amazingly helpful. Because what happens then , is you scan across the signal and once in a while you 'll find a blip that didn't show up in the pre - segmentation.

And that 'll be something like   I it 's ver  it 's interesting.


And I  you know , I 've also d uh , discovered  So with the new transcriber I 'm  um  So  Uh , lemme say that my , uh  So , um  At present , um , the people have been doing these transcriptions a channel at a time. And , that sort of , um ,  is useful , and t you know , and then once in a while they 'll have to refer to the other channels to clear something up. OK. Well ,  I realize that , um , w i we we 're using the pre - segmented version , and , um , the pre - segmented version is extremely useful , and wouldn't it be , useful also to have the visual representation of those segments ? And so I 've   uh ,  I , uh , uh , I 've  trained the new one  uh , the new the newest one ,  to , um ,  use the visual from the channel that is gonna be transcribed at any given time. And that 's just amazingly helpful. Because what happens then , is you scan across the signal and once in a while you 'll find a blip that didn't show up in the pre - segmentation.

And that 'll be something like   I it 's ver  it 's interesting.


And that 'll be something like   I it 's ver  it 's interesting.


Sometimes it seems to be , um , similar to the ones that are being picked up.


Sometimes it seems to be , um , similar to the ones that are being picked up.

And they 're rare events , but you can really go through a meeting very quickly. You just  you just , you know , yo you s you scroll from screen to screen , looking for blips. And , I think that we 're gonna end up with , uh  better coverage of the backchannels ,


And they 're rare events , but you can really go through a meeting very quickly. You just  you just , you know , yo you s you scroll from screen to screen , looking for blips. And , I think that we 're gonna end up with , uh  better coverage of the backchannels ,

but at the same time we 're benefitting tremendously from the pre - segmentation because  there are huge places where there is just absolutely no activity at all. And , uh , the audio quality is so good


but at the same time we 're benefitting tremendously from the pre - segmentation because  there are huge places where there is just absolutely no activity at all. And , uh , the audio quality is so good

So they can  they can , um , scroll through that pretty quick ?


So they can  they can , um , scroll through that pretty quick ?


So they can  they can , um , scroll through that pretty quick ?

Yeah. So I think that that 's gonna , also  eh ,  you know , speed the efficiency of this part of the process.


Yeah. So I think that that 's gonna , also  eh ,  you know , speed the efficiency of this part of the process.

Hmm. OK. Uh , yeah. So , uh  Yeah. So let 's talk about the digits , since they 're not here yet.


Yeah. So I think that that 's gonna , also  eh ,  you know , speed the efficiency of this part of the process.

Hmm. OK. Uh , yeah. So , uh  Yeah. So let 's talk about the digits , since they 're not here yet.

Uh , so , we have a whole bunch of digits that we 've read and we have the forms and so on , um , but only a small number of that ha well , not a small number  only a subset of that has been transcribed. And so we need to decide what we wanna do. And , uh , Liz and Andreas  actually they 're not here , but , they did say at one point that they thought they could do a pretty good job of just doing a forced alignment. And , again , I don't think we 'll be able to do with that alone , because , um , sometimes people correct themselves and things like that. But  so , I was just wondering what people thought about how automated can we make the process of finding where the people read the digits , doing a forced alignment , and doing the timing.


Yeah. So I think that that 's gonna , also  eh ,  you know , speed the efficiency of this part of the process.

Hmm. OK. Uh , yeah. So , uh  Yeah. So let 's talk about the digits , since they 're not here yet.

Uh , so , we have a whole bunch of digits that we 've read and we have the forms and so on , um , but only a small number of that ha well , not a small number  only a subset of that has been transcribed. And so we need to decide what we wanna do. And , uh , Liz and Andreas  actually they 're not here , but , they did say at one point that they thought they could do a pretty good job of just doing a forced alignment. And , again , I don't think we 'll be able to do with that alone , because , um , sometimes people correct themselves and things like that. But  so , I was just wondering what people thought about how automated can we make the process of finding where the people read the digits , doing a forced alignment , and doing the timing.

Well , forced alignment would be one thing. What about just actually doing recognition ?


Hmm. OK. Uh , yeah. So , uh  Yeah. So let 's talk about the digits , since they 're not here yet.

Uh , so , we have a whole bunch of digits that we 've read and we have the forms and so on , um , but only a small number of that ha well , not a small number  only a subset of that has been transcribed. And so we need to decide what we wanna do. And , uh , Liz and Andreas  actually they 're not here , but , they did say at one point that they thought they could do a pretty good job of just doing a forced alignment. And , again , I don't think we 'll be able to do with that alone , because , um , sometimes people correct themselves and things like that. But  so , I was just wondering what people thought about how automated can we make the process of finding where the people read the digits , doing a forced alignment , and doing the timing.

Well , forced alignment would be one thing. What about just actually doing recognition ?

Well , we  we know what they read , because we have the forms.


Uh , so , we have a whole bunch of digits that we 've read and we have the forms and so on , um , but only a small number of that ha well , not a small number  only a subset of that has been transcribed. And so we need to decide what we wanna do. And , uh , Liz and Andreas  actually they 're not here , but , they did say at one point that they thought they could do a pretty good job of just doing a forced alignment. And , again , I don't think we 'll be able to do with that alone , because , um , sometimes people correct themselves and things like that. But  so , I was just wondering what people thought about how automated can we make the process of finding where the people read the digits , doing a forced alignment , and doing the timing.

Well , forced alignment would be one thing. What about just actually doing recognition ?

Well , we  we know what they read , because we have the forms.


Well , forced alignment would be one thing. What about just actually doing recognition ?

Well , we  we know what they read , because we have the forms.

Right. But , the point is that we wanna get a set of clean digits.


Well , we  we know what they read , because we have the forms.

Right. But , the point is that we wanna get a set of clean digits.

You 're talking about as a pre - processing step.


Right. But , the point is that we wanna get a set of clean digits.

You 're talking about as a pre - processing step.


You 're talking about as a pre - processing step.


Yeah , I 'm  I 'm not quite sure what I 'm talking about. I mean  I  I mean , uh , we 're talking about digits now. And  and so , um , there 's a bunch of stuff that hasn't been marked yet. Uh. And , um ,  there 's the issue that  that they  we know what  what was said , but do we ?


Yeah , I 'm  I 'm not quite sure what I 'm talking about. I mean  I  I mean , uh , we 're talking about digits now. And  and so , um , there 's a bunch of stuff that hasn't been marked yet. Uh. And , um ,  there 's the issue that  that they  we know what  what was said , but do we ?

Because people make mistakes and stuff. I was just asking , just out of curiosity , if  if with , uh  uh , the SRI recognizer getting one percent word error , uh , would we  would we do  better  ? So , if you do a forced alignment but the force but the  but the transcription you have is wrong because they actually made mistakes , uh , or  false starts , it 's  it 's much less c  it 's  much less common than one percent ?


Yeah , I 'm  I 'm not quite sure what I 'm talking about. I mean  I  I mean , uh , we 're talking about digits now. And  and so , um , there 's a bunch of stuff that hasn't been marked yet. Uh. And , um ,  there 's the issue that  that they  we know what  what was said , but do we ?

Because people make mistakes and stuff. I was just asking , just out of curiosity , if  if with , uh  uh , the SRI recognizer getting one percent word error , uh , would we  would we do  better  ? So , if you do a forced alignment but the force but the  but the transcription you have is wrong because they actually made mistakes , uh , or  false starts , it 's  it 's much less c  it 's  much less common than one percent ?

But that 's pretty uncommon. Um , if we could really get one percent on


Because people make mistakes and stuff. I was just asking , just out of curiosity , if  if with , uh  uh , the SRI recognizer getting one percent word error , uh , would we  would we do  better  ? So , if you do a forced alignment but the force but the  but the transcription you have is wrong because they actually made mistakes , uh , or  false starts , it 's  it 's much less c  it 's  much less common than one percent ?

But that 's pretty uncommon. Um , if we could really get one percent on


Because people make mistakes and stuff. I was just asking , just out of curiosity , if  if with , uh  uh , the SRI recognizer getting one percent word error , uh , would we  would we do  better  ? So , if you do a forced alignment but the force but the  but the transcription you have is wrong because they actually made mistakes , uh , or  false starts , it 's  it 's much less c  it 's  much less common than one percent ?

But that 's pretty uncommon. Um , if we could really get one percent on

Well , I guess  yeah , I guess if we segmented it , we could get one percent on digits.


But that 's pretty uncommon. Um , if we could really get one percent on

Well , I guess  yeah , I guess if we segmented it , we could get one percent on digits.


Well , I guess  yeah , I guess if we segmented it , we could get one percent on digits.


Well , I guess  yeah , I guess if we segmented it , we could get one percent on digits.

Yeah. So that 's just my question. I 'm not saying it should be one way or the other , but it 's  If


Yeah. So that 's just my question. I 'm not saying it should be one way or the other , but it 's  If

But , Well , there  there 're a couple different of doing it. We could use the tools I 've already developed and transcribe it. Hire some people , or use the transcribers to do it. We could let IBM transcribe it. You know , they 're doing it anyway , and unless we tell them different , they 're gonna transcribe it. Um , or we could try some automated methods.


Yeah. So that 's just my question. I 'm not saying it should be one way or the other , but it 's  If

But , Well , there  there 're a couple different of doing it. We could use the tools I 've already developed and transcribe it. Hire some people , or use the transcribers to do it. We could let IBM transcribe it. You know , they 're doing it anyway , and unless we tell them different , they 're gonna transcribe it. Um , or we could try some automated methods.

And my  my tendency right now is , well , if IBM comes back with this meeting and the transcript is good , just let them do it.


But , Well , there  there 're a couple different of doing it. We could use the tools I 've already developed and transcribe it. Hire some people , or use the transcribers to do it. We could let IBM transcribe it. You know , they 're doing it anyway , and unless we tell them different , they 're gonna transcribe it. Um , or we could try some automated methods.

And my  my tendency right now is , well , if IBM comes back with this meeting and the transcript is good , just let them do it.

Yeah , it 's  Y you raised a point , kind of , uh , euphemistically  but , I mean , m maybe it is a serious problem. Ho - what will they do when they go  hear " beep  seven  beep  seven three five two "  I mean ,  you think they 'll  we 'll get  ?


And my  my tendency right now is , well , if IBM comes back with this meeting and the transcript is good , just let them do it.

Yeah , it 's  Y you raised a point , kind of , uh , euphemistically  but , I mean , m maybe it is a serious problem. Ho - what will they do when they go  hear " beep  seven  beep  seven three five two "  I mean ,  you think they 'll  we 'll get  ?


Yeah , it 's  Y you raised a point , kind of , uh , euphemistically  but , I mean , m maybe it is a serious problem. Ho - what will they do when they go  hear " beep  seven  beep  seven three five two "  I mean ,  you think they 'll  we 'll get  ?


It 'll  only be a problem for m for mine.


It 'll  only be a problem for m for mine.

Well it  it  well , it 'd be preceded by " I 'm reading transcript so - and - so " ?


Well it  it  well , it 'd be preceded by " I 'm reading transcript so - and - so " ?


Well it  it  well , it 'd be preceded by " I 'm reading transcript so - and - so " ?

So , I think if they 're processing it at


So , I think if they 're processing it at

I mean , it 'll be  it will be in the midst of a digit string.


So , I think if they 're processing it at

I mean , it 'll be  it will be in the midst of a digit string.

So  I mean it  sure , there  there might be a place where it 's " beep seven  beep eight  beep  eight  beep ". But , you know , they  they 're  they 're gonna macros for inserting the beep marks. And so , I  I don't think it 'll be a problem. We 'll have to see , but I don't think it 's gonna be a problem.


I mean , it 'll be  it will be in the midst of a digit string.

So  I mean it  sure , there  there might be a place where it 's " beep seven  beep eight  beep  eight  beep ". But , you know , they  they 're  they 're gonna macros for inserting the beep marks. And so , I  I don't think it 'll be a problem. We 'll have to see , but I don't think it 's gonna be a problem.

OK. Well , I  I  I dunno , I  I think that that 's  if they are in fact going to transcribe these things , uh , certainly any process that we 'd have to correct them , or whatever is  needs to be much less elaborate for digits than for other stuff.


So  I mean it  sure , there  there might be a place where it 's " beep seven  beep eight  beep  eight  beep ". But , you know , they  they 're  they 're gonna macros for inserting the beep marks. And so , I  I don't think it 'll be a problem. We 'll have to see , but I don't think it 's gonna be a problem.

OK. Well , I  I  I dunno , I  I think that that 's  if they are in fact going to transcribe these things , uh , certainly any process that we 'd have to correct them , or whatever is  needs to be much less elaborate for digits than for other stuff.


OK. Well , I  I  I dunno , I  I think that that 's  if they are in fact going to transcribe these things , uh , certainly any process that we 'd have to correct them , or whatever is  needs to be much less elaborate for digits than for other stuff.

That was it. Just , what do we do with digits ?


That was it. Just , what do we do with digits ?


That was it. Just , what do we do with digits ?

We have so many of them ,  and it 'd be nice to  actually do something with them.


That was it. Just , what do we do with digits ?

We have so many of them ,  and it 'd be nice to  actually do something with them.

Well , we  we  we wanna have them. Yeah , I


We have so many of them ,  and it 'd be nice to  actually do something with them.

Well , we  we  we wanna have them. Yeah , I


We have so many of them ,  and it 'd be nice to  actually do something with them.

Well , we  we  we wanna have them. Yeah , I

Anything else ? Your mike is a little low there.


Well , we  we  we wanna have them. Yeah , I

Anything else ? Your mike is a little low there.

I in Berkeley , yeah. So ,  uh  You  you have to go a little early , right ? At twenty


Anything else ? Your mike is a little low there.

I in Berkeley , yeah. So ,  uh  You  you have to go a little early , right ? At twenty

Well , I can stay till about , uh , three forty.


Anything else ? Your mike is a little low there.

I in Berkeley , yeah. So ,  uh  You  you have to go a little early , right ? At twenty

Well , I can stay till about , uh , three forty.

Alright. So le let 's make sure we do the ones that  that , uh , saved you.


I in Berkeley , yeah. So ,  uh  You  you have to go a little early , right ? At twenty

Well , I can stay till about , uh , three forty.

Alright. So le let 's make sure we do the ones that  that , uh , saved you.


Well , I can stay till about , uh , three forty.

Alright. So le let 's make sure we do the ones that  that , uh , saved you.

So there was some  Uh   In  in  Adam 's agenda list , he had something from you about segmentation this last recognition ?


Alright. So le let 's make sure we do the ones that  that , uh , saved you.

So there was some  Uh   In  in  Adam 's agenda list , he had something from you about segmentation this last recognition ?

Well , yeah. So this is just partly to inform everybody , um , and  and of course to get , um , input.


So there was some  Uh   In  in  Adam 's agenda list , he had something from you about segmentation this last recognition ?

Well , yeah. So this is just partly to inform everybody , um , and  and of course to get , um , input.


So there was some  Uh   In  in  Adam 's agenda list , he had something from you about segmentation this last recognition ?

Well , yeah. So this is just partly to inform everybody , um , and  and of course to get , um , input.

Um , so ,  uh , we had a discussion  Don and Liz and I had discussion last week about how to proceed with , uh , you know , with Don 's work ,


Well , yeah. So this is just partly to inform everybody , um , and  and of course to get , um , input.

Um , so ,  uh , we had a discussion  Don and Liz and I had discussion last week about how to proceed with , uh , you know , with Don 's work ,


Um , so ,  uh , we had a discussion  Don and Liz and I had discussion last week about how to proceed with , uh , you know , with Don 's work ,

and   and  and , uh , one of the obvious things that occur to us was that we 're  since we now have Thilo 's segmenter and it works , you know , amazingly well ,  um , we should actually basically re - evaluate the recognition , um , results using  you know , without cheating on the segmentations.


and   and  and , uh , one of the obvious things that occur to us was that we 're  since we now have Thilo 's segmenter and it works , you know , amazingly well ,  um , we should actually basically re - evaluate the recognition , um , results using  you know , without cheating on the segmentations.


and   and  and , uh , one of the obvious things that occur to us was that we 're  since we now have Thilo 's segmenter and it works , you know , amazingly well ,  um , we should actually basically re - evaluate the recognition , um , results using  you know , without cheating on the segmentations.

And how do we find the transcripts for those so that  ? Yeah. The references for  for  those segments ?


And how do we find the transcripts for those so that  ? Yeah. The references for  for  those segments ?


No , actually , um , NIST has , um m a fairly sophisticated scoring program  that you can give a , um   a time ,


uh  You know , you basically just give two  time - marked sequences of words , and it computes the um  the ,  uh   you know , the  the  th


So , it  we just  and we use that actually in Hub - five to do the scoring. Um. So what we 've been using so far was sort of a  simplified version of the scoring. And we can  we can handle the  the  the type of problem we have here.


So , it  we just  and we use that actually in Hub - five to do the scoring. Um. So what we 've been using so far was sort of a  simplified version of the scoring. And we can  we can handle the  the  the type of problem we have here.

So , basically you give some time constraints for  for the references and for  for the hypothesis ,


So , basically you give some time constraints for  for the references and for  for the hypothesis ,


Maybe the  start of your speech and the end of it ,


Right. It does time - constrained word - alignment.


Right. It does time - constrained word - alignment.

So. So that should be possible. I mean that shouldn't be a problem. Uh , so that was the one thing , and the other was that , um  What was the other problem ? Oh ! That Thilo wanted to use  the recognizer alignments to train up his , um , speech detector.


So. So that should be possible. I mean that shouldn't be a problem. Uh , so that was the one thing , and the other was that , um  What was the other problem ? Oh ! That Thilo wanted to use  the recognizer alignments to train up his , um , speech detector.

Um , so that we could use , uh  you know there wouldn't be so much hand  labelling needed to , uh  to generate training data for  for the speech detector.


So. So that should be possible. I mean that shouldn't be a problem. Uh , so that was the one thing , and the other was that , um  What was the other problem ? Oh ! That Thilo wanted to use  the recognizer alignments to train up his , um , speech detector.

Um , so that we could use , uh  you know there wouldn't be so much hand  labelling needed to , uh  to generate training data for  for the speech detector.

Yeah. I 'm just in progress of  of doing that. So.


Um , so that we could use , uh  you know there wouldn't be so much hand  labelling needed to , uh  to generate training data for  for the speech detector.

Yeah. I 'm just in progress of  of doing that. So.

And I think you 're in the process of doing that.


Yeah. I 'm just in progress of  of doing that. So.

And I think you 're in the process of doing that.


And I think you 're in the process of doing that.

It 'll give you a lot more data , too. Won't it ?


It 'll give you a lot more data , too. Won't it ?

Yeah. So , it 's basically  s I think , eight meetings or something which  which I 'm using , and ,  it 's   before it was twenty minutes of one meeting.


Yeah. So , it 's basically  s I think , eight meetings or something which  which I 'm using , and ,  it 's   before it was twenty minutes of one meeting.


That won't be perfect  the alignments aren't perfect ,


That won't be perfect  the alignments aren't perfect ,

but , um , it 's probably still better to have all this extra data , than


but , um , it 's probably still better to have all this extra data , than


Actually , I had a question about that. If you find that you can  lower the false alarms that you get where there 's no speech , that would be useful  for us to know. So , um


Actually , I had a question about that. If you find that you can  lower the false alarms that you get where there 's no speech , that would be useful  for us to know. So , um

Yeah. So ,  r right now you get f fal you know , false  false , uh , speech regions when it 's just like , um ,  breath or something like that ,


Yeah. So ,  r right now you get f fal you know , false  false , uh , speech regions when it 's just like , um ,  breath or something like that ,

and I 'd be interested to know the  wha if you retrain um ,


and I 'd be interested to know the  wha if you retrain um ,

do those actually go down or not ? Because  of


and I 'd be interested to know the  wha if you retrain um ,

do those actually go down or not ? Because  of

Yeah. I 'll  can make  an can , like , make a c comparison of  of the old system to the  to the new one , and  then


do those actually go down or not ? Because  of

Yeah. I 'll  can make  an can , like , make a c comparison of  of the old system to the  to the new one , and  then

Yeah , just to see if by doing nothing in the modeling of  just having that training data wh what happens.


Yeah. I 'll  can make  an can , like , make a c comparison of  of the old system to the  to the new one , and  then

Yeah , just to see if by doing nothing in the modeling of  just having that training data wh what happens.

Um another one that we had on Adam 's agenda  that definitely involved you was s something about SmartKom ?


Yeah , just to see if by doing nothing in the modeling of  just having that training data wh what happens.

Um another one that we had on Adam 's agenda  that definitely involved you was s something about SmartKom ?

Right. So , Rob Porzel  eh , Porzel ? and the , uh  Porzel  and the , uh , SmartKom group are collecting some dialogues.


Um another one that we had on Adam 's agenda  that definitely involved you was s something about SmartKom ?

Right. So , Rob Porzel  eh , Porzel ? and the , uh  Porzel  and the , uh , SmartKom group are collecting some dialogues.


Um another one that we had on Adam 's agenda  that definitely involved you was s something about SmartKom ?

Right. So , Rob Porzel  eh , Porzel ? and the , uh  Porzel  and the , uh , SmartKom group are collecting some dialogues.

Basically they have one person sitting in here , looking at a picture , and a wizard sitting in another room somewhere. And , uh , they 're doing a travel task. And , uh , it involves starting  I believe starting with a  It 's  it 's always the wizard , but it starts where the wizard is pretending to be a computer and it goes through a , uh ,  speech generation system.


Right. So , Rob Porzel  eh , Porzel ? and the , uh  Porzel  and the , uh , SmartKom group are collecting some dialogues.

Basically they have one person sitting in here , looking at a picture , and a wizard sitting in another room somewhere. And , uh , they 're doing a travel task. And , uh , it involves starting  I believe starting with a  It 's  it 's always the wizard , but it starts where the wizard is pretending to be a computer and it goes through a , uh ,  speech generation system.

Yeah. Actually , it 's changed to a synthesis for  for the first part now.


Basically they have one person sitting in here , looking at a picture , and a wizard sitting in another room somewhere. And , uh , they 're doing a travel task. And , uh , it involves starting  I believe starting with a  It 's  it 's always the wizard , but it starts where the wizard is pretending to be a computer and it goes through a , uh ,  speech generation system.

Yeah. Actually , it 's changed to a synthesis for  for the first part now.


Yeah. Actually , it 's changed to a synthesis for  for the first part now.

Um , and then , it goes to a real wizard and they 're evaluating that. And they wanted to use this equipment , and so the w question came up , is  well , here 's some more data. Should this be part of the corpus or not ? And my attitude was yes , because there might be people who are using this corpus for  acoustics , as opposed to just for language. Um , or also for dialogue of various sorts. Um , so it 's not a meeting. Right ? Because it 's two people and they 're not face to face.