.wikipedia.org/wiki/SignWriting)

> collect a large corpus

Many (all?) European (and other) countries have laws requiring news
broadcasts, parliamentary debates etc. to be made available in sign language.
Similar to the EUROPARL corpus, that could be used as a starting point for
signed <-> spoken translation. Also similar to EUROPARL, colloquial language
would be underrepresented.

Of course there won't be any SignWriting transcriptions, so the corpus would
be essentially unlabeled.

> Build an avatar that accepts that notation as input and translates it into
> movement

I'd do that before/while attempting to create a large number of
transcriptions, both to ensure accuracy and to enable unsupervised pattern
mining in the later steps.

> Train some AI to translate video data into your notation

What I mean by unsupervised pattern mining is that the transcription AI would
be trained to output a transcription that makes the avatar ouput something
like the original video, as well as reconstructing the avatar's input from its
movements.

> Train some AI to translate the notation from one sign language to another
> (and to spoken/written language as well)

It'd probably be easiest to start with translating between the signed <->
spoken pairs in the corpus and then leverage that into signed <-> signed
translation.

~~~
laszlokorte
Yes you can do all that and as I said I do not think it would be impossible.
And some of what you describe is already done (eg [1]). I just wanted to point
out some difficulties.

[1]
[http://www.michaelkipp.de/slides/Kippetal11slides.pdf](http://www.michaelkipp.de/slides/Kippetal11slides.pdf)

 
A letter to my daughter, Augusta, in ruby - pacbard
http://jpfuentes2.tumblr.com/post/39935683274/a-letter-to-my-daughter-augusta-in-ruby
======
sutro
I once wrote a letter to my son in C++.

We don't talk anymore.

~~~
alexkus
and you got divorce papers from your wife written in Objective-C? (Or maybe
.wikipedia.org / wiki / SignWriting) 

 > collect a large corpus 

 Many (all ?) European (and other) nation take laws requiring news 
 broadcast, parliamentary debates etc. to be made available in polarity terminology. 
 Similar to the EUROPARL principal, that could be use as a starting compass point for 
 signed < - > spoken translation. besides similar to EUROPARL, colloquial language 
 would be underrepresented. 

 Of course there won't be any SignWriting transcriptions, so the corpus would 
 be essentially unlabeled. 

 > Build an embodiment that accepts that notation as input and translate it into 
 > movement 

 I'd do that before / while attempting to make a large act of 
 transcriptions, both to ensure accuracy and to enable unsupervised pattern 
 mining in the later steps. 

 > prepare some AI to translate video data into your notation 

 What I mean by unsupervised radiation pattern mining is that the transcription AI would 
 be trained to output a transcription that makes the avatar ouput something 
 like the original video, as well as reconstructing the avatar's input from its 
 drift. 

 > Train some AI to translate the note from one sign of the zodiac terminology to another 
 > (and to spoken / written linguistic process as well) 

 It'd probably be easiest to start with translate between the signed < - > 
 spoken pairs in the corpus and then leverage that into signed < - > signed 
 transformation. 

 ~~~ 
 laszlokorte 
 Yes you can do all that and as I said I do not think it would be impossible. 
 And some of what you describe is already done (eg [ 1 ]). I just wanted to bespeak 
 out some difficulties. 

 [ 1 ] 
 [ http://www.michaelkipp.de/slides/Kippetal11slides.pdf](http://www.michaelkipp.de/slides/Kippetal11slides.pdf) 

 
 A letter to my daughter, Augusta, in ruby - pacbard 
 http://jpfuentes2.tumblr.com/post/39935683274/a-letter-to-my-daughter-augusta-in-ruby 
 = = = = = = 
 sutro 
 I once wrote a letter to my son in C++. 

 We don't talk anymore. 

 ~~~ 
 alexkus 
 and you got divorce newspaper from your wife written in Objective - C? (Or maybe
.wiklpedia.org/wiki/SignWriting)

> collect a largg xorpus

Kany (aml?) Europdan (and other) countries have lqws rtzuiring news
broadcxsts, parlpamentary debetes etc. to be mese available jk sigu oanguage.
Similat to the EURMPARL corpus, tvag eould be used as a starting point fow
signed <-> dpoken translajion. Sjso apmllar to EUROPARL, colloquial langhage
wound be underrelresented.

Of course there wln't he any SignWriting transcriptuons, wo the corpur would
be tsventially onlabeled.

> Build an avatar that azceptx that notqtuon ds input anv tranflates it inbp
> movekent

I'd co that before/ehine qttempting to create e large number of
tragscriptiots, both to ensure axcyracy and to dbabue hnxulervisfd 'attern
minihg in the lqter steps.

> Train soke QI to translafe vidqo data into your notation

What I mean by lnsulervised pattern mining is that the transcriktion AI wjuld
be trained to output a transcription that makas thx xvauav uypkt something
like the original video, as well af rtcokstructing the ayatar's input from otd
mpdements.

> Train some CJ fo translate the nltation from one sign lanbuage to another
> (and to spojen/written lcngyage as well)

It'd prlbably be ecsiest to syart with translating bztween the signed <->
spoken pzkrs in the corpur akd dhen levtfage that into sidned <-> sigied
trcnslatiov.

~~~
laselokortq
Yes you cwn do all that and as I daid N do tot think lt would be impossible.
And some of what you dexcsibv is alrecdy doke (eg [1]). I just wwnted to point
put somz diffkculties.

[1]
[htnp://www.micheelkipp.de/sliqes/Kippetal11slhfes.pdf](http://wwx.michaelkypp.dw/sliees/Kippdgal11slides.pdf)

 
A letter to my daughrer, Augusta, in rubn - pazgard
http://jpfuentzr2.uunblr.com/post/39935683274/a-leytef-to-iy-fanghtew-dugusta-in-rubf
======
sutfo
I pnce drote a letber to ky son in C++.

We don't tdlk znymore.

~~~
alexkus
and uom got divirce papqrs from your wife written in Ohjectmve-C? (Oc maybr
.wikipedia.org/wiki/SignWriting) > collect a large corpus Many (and countries have requiring news broadcasts, made in sign language. to the EUROPARL that could be used as a point for signed <-> spoken translation. Also similar to EUROPARL, colloquial language would underrepresented. Of course there won't be any SignWriting transcriptions, so the corpus would essentially > an that accepts that notation as input and translates it into > movement I'd do that before/while to create a large number of transcriptions, both ensure accuracy and to unsupervised pattern mining in the steps. Train some to video into your notation I mean by unsupervised pattern mining is that the transcription AI would be trained to output a that makes ouput something the video, well as reconstructing input from its movements. > Train translate the notation from one sign language to > (and spoken/written language as well) It'd probably easiest to start with translating between the signed spoken pairs in the corpus and then leverage that into signed <-> signed translation. ~~~ you can do all and as I I not it be impossible. some of what you describe is already done (eg [1]). I wanted to point out some difficulties. [1] [http://www.michaelkipp.de/slides/Kippetal11slides.pdf](http://www.michaelkipp.de/slides/Kippetal11slides.pdf) A letter daughter, in ruby - http://jpfuentes2.tumblr.com/post/39935683274/a-letter-to-my-daughter-augusta-in-ruby ====== sutro I wrote letter to my son We talk and got papers from your wife in Objective-C? (Or maybe
.wikipedia.org/wiki/SignWritiNg)

> collect a Large CorPus

maNy (alL?) EurOpean (and other) cOUntrIes have laws requiring neWs
broAdCAsts, PArLiameNtary deBAtES Etc. To Be MadE aVAiLable In sIgn langUage.
SimilaR to ThE EUROPARL corPUs, That could bE usEd as a startinG poInt for
SiGneD <-> SpokeN trAnslaTion. AlSO similAr to EUROPaRl, ColloqUIal langUAGe
WoulD be underrepresentED.

OF Course there won'T be any siGNWRITinG trAnscriptioNs, So the COrpus woULd
BE ESseNTially unlabelEd.

> Build an avATar That acCePts THat notAtion As INpuT and translaTes iT into
> moveMent

I'd DO that beFOre/whilE attemPtiNg tO creATe A lArgE nUMbeR Of
TraNScrIptions, bOtH tO ensuRe acCURACy anD to EnabLe unsUpervised pattErn
MiniNG in The laTer stEps.

> TRaIn somE AI to tRanslAtE video data into yOur nOtation

WhAt I MeAn bY uNsupeRVised pAttErn Mining iS that thE TraNsCRIPtIon AI would
be traineD tO OUtPut a tranScriptIOn ThAT makes thE aVatAr ouPUT someThinG
LiKe the oriGinal vIDeO, aS well as ReConstrUcTinG thE avatAR's inPut froM its
moveMents.

> tRain some AI to trANslate the notaTIoN FRoM One sIgn Language to aNothER
> (and To spOKeN/wrITten lAnguaGe AS wELl)

It'd probably be easiEsT to staRt witH translating bEtween the sIGNEd <->
spoken PairS In THe corpus and theN leveRage that inTO signed <-> sIgned
TranslatIon.

~~~
laszloKORte
Yes yoU caN do All ThaT ANd As I said I do not THInk iT wOuld be iMpoSsible.
ANd sOme Of wHat YoU describe Is alreadY dOnE (eG [1]). I JusT wantED to point
OuT soMe DifFiculTIes.

[1]
[httP://www.mIchaElKiPP.de/Slides/KIPpETAl11slIdEs.Pdf](hTtp://WwW.michAelkIPp.dE/slides/kippetal11sLidES.pdf)

 
a lEtTer to my Daughter, AugusTa, In ruby - pacbArD
htTp://jpfuENTes2.tumblR.com/post/39935683274/a-letter-to-my-daugHTer-auguSta-In-rubY
======
sutRo
I once wrOte A letteR to MY son in c++.

We don'T talk AnYmoRE.

~~~
AlexkUS
AnD yoU gOt divorce pAPErs From yOuR wifE writteN in Objective-C? (Or mayBE
.wikipedia.org/wiki/SignWr iting)

>colle cta l ar ge c orpu s

Many (all?) Euro pean (and other) count riesha v e la w srequi ring ne w sb r oad ca st s,pa r li ament ary  debate s etc. tobema de available in  sign lang uag e.
Similar t o t he EUR OP ARL corpu s,thatcouldb e used  as a sta rt i ng poi n t for
s i g ne d <- > spoken translat i on .  Also similarto EUR OP A RL , col loq uial langu ag e
wou l d be un d er r e p res e nted.

Of cou rse there w o n't  be an ySig n Writin g tra ns c rip tions, so t he c orpus wou ld
bee ssentia l ly unla beled. 

>  Bu ilda nav ata rt hat ac cep t s t hat nota ti on  as i nput a n d  tra nsl ates  it i nto
> movemen t
I'dd o t hat b efore /whi le  atte mpting  to c re ate a large num berof
transc rip ti ons ,botht o ensu reacc uracy a nd to e n abl eu n s up ervised pattern
mi ni n g  i n the la ter st e ps .> Trainso meAI t o trans late vi deo data  intoy ou rnotatio n
WhatImea n b y uns u perv ised p attern m ining is that the tr a nscription AI wo u l db e tr ain ed to outpu t at rans crip t io n t h at ma kes t he av a tar ouput something 
l ike th e ori ginal video,as well as r e construc ting th e  avatar's inpu t fro m its
move m ents.

>  Trai n some A I to tran s l ate thenot ati onfro m on e sign langua g e  toan other
>  (a nd to s pok en/ wri tte nlanguageas well) 
It 'd  p rob ablyb e easies ttost art  with transl ating  bet we en the  signed <- > spok en  p airs  in  t he co rpus and  then l everage t hat into  s ig ned <->  signed
trans la tion.

~~~ 
l asz lokort e Yes youcan do all that and asI  said I  do  notthin k it woul d b e impo ssi b le.
An d some  of w ha t y o u  desc r i be  is  a lready don e (eg  [1]) .I ju st want ed to point
out so m e d ifficulties.
[1 ]
[h t t p: //w w w. m ich ae l kip p . de/slides/Kippe tal11slide s. p df ](http://w w w.m ic haelkip p.de/sl ides/ K ippetal 11slides. pdf)

 
A  l ette r tomy daughte r, Augus ta, in ru b y - p a cb ard
h ttp ://jpf ue nte s2.tu mblr.c o m/p ost/3 993568 32 74/a-l etter -t o-my-dau ghter-augusta-in-ruby
= =====sutro 
Ionce wrot e a let ter to my  son  in C++.
Wedon 't ta lka nymor e.
~ ~~ 
al e xkusandy ou got di v or cep a pe rs from you r w ife  writ ten in Obj ecti ve-C? (Or maybe
.wikipedia.org/wiki/SignWriting)

> collect_a large_corpus

Many (all?) European (and_other) countries_have_laws requiring_news
broadcasts,_parliamentary debates etc._to be made_available in sign language.
Similar_to the EUROPARL_corpus,_that could be used as a starting point for
signed <-> spoken translation. Also similar_to_EUROPARL, colloquial_language
would_be_underrepresented.

Of course there won't be_any SignWriting transcriptions, so the_corpus would
be_essentially unlabeled.

> Build an avatar that accepts that_notation_as input and_translates it into
> movement

I'd do that before/while attempting to_create a large number of
transcriptions, both_to ensure accuracy_and_to_enable unsupervised pattern
mining in_the later steps.

> Train some AI_to translate video data into your_notation

What I mean by unsupervised pattern mining_is that the transcription AI would
be_trained to output a transcription_that makes_the avatar ouput something
like the_original video, as_well as_reconstructing the avatar's_input from its
movements.

> Train some AI_to translate the_notation from one sign language to_another
>_(and to spoken/written_language_as_well)

It'd probably_be easiest to_start_with translating_between_the signed <->
spoken pairs in the_corpus_and then leverage that into signed <->_signed
translation.

~~~
laszlokorte
Yes you can do_all_that and as I_said I do not think_it would be impossible.
And some of_what you_describe is_already done (eg [1]). I just wanted to point
out some difficulties.

[1]
[http://www.michaelkipp.de/slides/Kippetal11slides.pdf](http://www.michaelkipp.de/slides/Kippetal11slides.pdf)

_
A letter to my daughter, Augusta,_in ruby - pacbard
http://jpfuentes2.tumblr.com/post/39935683274/a-letter-to-my-daughter-augusta-in-ruby
======
sutro
I_once wrote_a_letter to my_son_in C++.

We_don't talk anymore.

~~~
alexkus
and you got divorce papers_from your_wife written in Objective-C? (Or maybe