 bowls were placed at 7 different positions. At each position, we collect 20 sequences of data with 5 for each bowl-barley combination. In total, we collect 140 sequences of data. 139 of the 140 sequences of data are used to train DCAE and LSTM-RNN. The remaining 1 sequence are used for testing. The parameters of DCAE and LSTM-RNN are the same as experiment 1.

The results of DCAE are shown in Fig.\[dcaeresults\](b). The trained model is able to reconstruct the training data with high precision. Readers may compare the first and second rows of Fig.\[dcaeresults\](b.1) for details. In contrast, the reconstructed images show significant difference for the test data. It failed to reconstruct the test data. Readers may compare the first and second row of Fig.\[dcaeresults\](b.2) to see the difference. Especially for the first column of Fig.\[dcaeresults\](b.2), the bowl is wrongly considered to be at a totally different position.

The LSTM-RNN model is not able to generate scooping motion for either the training data or the test data. The motion is randomly changing from time to time. It doesn’t follow any pre-taught sequences. The reason is probably the bad reconstruction performance of DCAE. The system failed to correctly find the positions of the bowls using the encoded features. Based on the analysis, we increase the training data of DCAE in Experiment 3 to improve its reconstruction.

Experiment 3: Increasing the training data of DCAE
--------------------------------------------------

The third group of experiments has exactly the same scenario settings and parameter settings as Experiment 2, except that we use planning algorithms to generate scooping motion and collect more scooping images.

The new scooping images are collected following the work flow shows in Fig.\[sample\]. We divide the work space into around 100 grids, place bowl at these places, and sample arm boatswains and orientations at each of the grid. In total, we additionally generate 100$\times$45$\times$3=13500 (12726 exactly) extra training images to train DCAE. Here, “100” indicates the 100 grid positions. “45” and “3” indicate the 45 arm positions and 3 arm rotation angles sampled at each grid.

![Increase the training data of DCAE by automatically generating motions across a 10$\times$10 grids. In all, 100$\times$45
bowls were placed at 7 different positions. At each placement, we roll up 20 sequences of data with 5 for each bowl - barley combination. In sum, we collect 140 sequences of datum. 139 of the 140 sequences of data are used to discipline DCAE and LSTM - RNN. The remaining 1 sequence are use for testing. The parameters of DCAE and LSTM - RNN are the like as experiment 1. 

 The results of DCAE are shown in Fig.\[dcaeresults\](b). The trained model is able to reconstruct the training data with eminent precision. Readers may compare the first and second course of Fig.\[dcaeresults\](b.1) for details. In contrast, the reconstructed images show meaning difference for the examination data. It failed to reconstruct the trial data. Readers may compare the first and second row of Fig.\[dcaeresults\](b.2) to see the difference. Especially for the first column of Fig.\[dcaeresults\](b.2), the bowl is wrongly considered to be at a totally different position. 

 The LSTM - RNN model is not able to generate scooping gesture for either the training data or the examination datum. The apparent motion is randomly changing from time to time. It does n’t follow any pre - taught sequences. The reason is probably the regretful reconstruction performance of DCAE. The system failed to correctly find the positions of the bowls using the encoded features. Based on the analysis, we increase the training data of DCAE in Experiment 3 to better its reconstruction. 

 Experiment 3: Increasing the education datum of DCAE 
 -------------------------------------------------- 

 The third group of experiment has exactly the same scenario mount and parameter settings as Experiment 2, except that we use plan algorithms to generate scooping motion and gather more scooping images. 

 The raw scooping images are collected follow the work flow shows in Fig.\[sample\ ]. We separate the work quad into around 100 grids, place roll at these space, and sample arm boatswains and orientations at each of the grid. In total, we additionally generate 100$\times$45$\times$3=13500 (12726 exactly) extra education images to train DCAE. Here, “ 100 ” indicate the 100 grid positions. “ 45 ” and “ 3 ” indicate the 45 arm positions and 3 arm rotation angles sample at each grid. 

! [ Increase the training data of DCAE by automatically generating motions across a 10$\times$10 grids. In all, 100$\times$45
 boals were placed at 7 difftrent positions. Aj wach pmsitioh, we coluect 20 sequences of data with 5 dor eqch bowl-barley combinagion. In tltal, we xolltct 140 sequences of data. 139 on the 140 seqbeices of data arg used to trdin DCAE and LVTO-RUN. The remaining 1 sequence are used sor tesyijg. The parametgrs og DCAS and LSTM-RNN are the same as expediment 1.

Uhe results of DCAR are shown in Fig.\[dcaeresupts\](b). The trained model is able to recjbstruct the graining data with higg precision. Readers may compare the yirst and sgeind tows of Fig.\[draeresllts\](b.1) for details. In wontrasy, the reconstrmcted imqges show significant difference for thg test datd. Nt failed to reconstrycr the tesd dagq. Rdadtrs mzy comoarx the first and second row of Fig.\[dcaeresuktf\](v.2) to see the sifferqnse. Especially for the first column of Fpg.\[dczeresults\](b.2), the bowl is qrongly considered to be at a eotally different position.

The LSTM-RNN model is nod ablx go yckeragw dcooping motion for either the training data jd uhe test data. The motion is tajdpily changing wrom tnje to time. It doesn’t follow any pre-taught seqiences. The reason is probaboy the bad rvconwtruction performauce of DCAE. Che syxtem gailed to correctly finb the lositions ov the bowmr using the encoaed faatures. Based on the analyfis, we inrreasz the trxinimg datw of DCAE ln Exiariment 3 to improvf its raconstructlon.

Experiment 3: Increasing the tceining data og GCAV
--------------------------------------------------

The thirb groui of experimentf has exactly jhe same fcenafio settinfs and 'arameter seetings as Expatiment 2, excepv that we use plabning aueorithms to gemerate scooping motuon and collect move scukping images.

The neq scooping imagrs xre cllkesded followinc thd wutk fluw shows in Wig.\[ssmple\]. We divide the fork space into around 100 nrids, plaxe bowl wt these placrs, and sample arm hoatsxains end oroenjations at each of the grid. In fotal, we wddltionally genqratc 100$\tiies$45$\times$3=13500 (12726 zxactly) extra training images to train DRAE. Here, “100” indicates thg 100 grid positions. “45” anb “3” indicate tie 45 ari positiots and 3 arm rotation angles sampled au each grid.

![Increase the trainhng dwta of DCAE by automatically generating motions across a 10$\times$10 grids. In aol, 100$\timxs$45
bowls were placed at 7 different positions. position, collect 20 of data with In we collect 140 of data. 139 the 140 sequences of data are to train DCAE and LSTM-RNN. The remaining 1 sequence are used for testing. parameters of DCAE and LSTM-RNN are the same as experiment 1. The results DCAE shown Fig.\[dcaeresults\](b). trained model is able to reconstruct the training data with high precision. Readers may compare the and second rows of Fig.\[dcaeresults\](b.1) for details. In the reconstructed images show difference for the test data. failed reconstruct the data. may the first and row of Fig.\[dcaeresults\](b.2) to see the difference. Especially for the first column of Fig.\[dcaeresults\](b.2), the bowl is considered to a totally position. LSTM-RNN is not able scooping motion for either the training test data. The motion is randomly changing from to time. doesn’t follow any pre-taught sequences. The is probably the bad reconstruction performance of DCAE. system failed to correctly find the positions of the bowls using the encoded features. Based analysis, we increase the data of DCAE Experiment to its Experiment 3: the training data of DCAE -------------------------------------------------- The third group of experiments exactly the same scenario settings and parameter settings as Experiment that use planning algorithms generate scooping motion and more images. The new scooping collected the in We the work space into 100 grids, place bowl at places, and sample arm of the grid. In total, we additionally generate (12726 exactly) extra training images to train Here, “100” indicates the 100 grid positions. “45” and “3” indicate the arm positions arm rotation angles sampled at each grid. ![Increase training data of DCAE automatically generating motions across a 10$\times$10 grids. In all,
 bowls were placed at 7 differenT positions. at eacH poSitIoN, we cOlleCt 20 sequences of dATa wiTh 5 for each bowl-barley comBinatIoN. in toTAl, We colLect 140 seqUEnCES of DaTa. 139 Of tHe 140 SEqUenceS of Data are Used to traiN DCaE And LSTM-RNN. ThE ReMaining 1 seqUenCe are used for TesTing. ThE pAraMEters Of DcAE anD LSTM-Rnn are thE same as exPeRIment 1.

THE resultS OF DcAE aRe shown in Fig.\[dcaerESuLTs\](b). The trained mOdel is AbLE tO REcoNstRuct the traInIng daTA with hiGH pRECIsiON. Readers may coMpare the firST anD seconD rOws OF Fig.\[dcAeresUlTS\](b.1) fOr details. In ContRast, the reConstrUCted imaGEs show sIgnifiCanT diFferENcE fOr tHe TEst DAtA. It FAilEd to recoNsTrUct thE tesT DATA. ReaDerS may CompaRe the first and SecOnd rOW of fig.\[dcAeresUlts\](B.2) tO see tHe diffErencE. ESpecially for the FirsT column of fig.\[DcAerEsUlts\](b.2), THe bowl Is wRonGly consIdered tO Be aT a TOTAlLy different positioN.

THE lStM-RNN modEl is noT AbLe TO generatE sCooPing MOTion fOr eiTHeR the traiNing daTA oR tHe test dAtA. The moTiOn iS raNdomlY ChanGing frOm time to Time. IT Doesn’t follow anY Pre-taught sequENcES. thE ReasOn iS probably thE bad REconStruCTiOn pERformAnce oF DcaE. tHe system failed to corReCtly fiNd the Positions of thE bowls usinG THE encoded FeatUReS. based on the analYsis, wE increase tHE traininG data Of DCAE in experimenT 3 TO improve Its RecOnsTruCTIoN.

Experiment 3: InCREasiNg The traiNinG data of dCAe
--------------------------------------------------

ThE thIrd GrOup of expeRiments hAs ExAcTlY thE same SCenario sEtTinGs And ParamETer setTings As ExPeRiMEnt 2, Except tHAt WE Use pLaNnIng aLgoRiThms tO genERatE scoopiNg motion aNd cOLlecT mOrE scoopiNg images.

The neW sCooping imaGeS arE colleCTEd followIng the work flow shows in FiG.\[Sample\]. WE diVide tHe woRk space inTo aRound 100 gRidS, Place bOwl at tHese pLaCes, AND sampLE ArM boAtSwains and oRIEntAtionS aT eacH of the gRid. In total, we additiONalLy generate 100$\timEs$45$\tImes$3=13500 (12726 EXAcTly) EXtRA trAiNIng IMAges to train DCAE. here, “100” indicaTeS ThE 100 grid positIOns. “45” AnD “3” indicaTe the 45 arM posiTIons and 3 Arm rotatiOn angles sAmPled AT EacH grid.

![IncreAse the trAining datA Of DCAe By AutomAtiCally gEnEraTing mOtions ACroSs a 10$\tiMes$10 griDs. in all, 100$\tImes$45
 bowls were placed at 7 di fferent po sitio ns.  At  e achposi tion, we colle c t 20  sequences of data wit h 5 f or each bo wl-ba rley co m bi n a tio n.  I n t ot a l,  we c oll ect 140  sequences  of  d ata. 139 oft he  140 seque nce s of data ar e u sed to  t rai n  DCAE  an d LST M-RNN. The re maining 1  s e quence are use d fo r te sting. The parame t er s  of DCAE and L STM-RN Na re t hesam e as exper im ent 1 . 

The r e su l t s  of DCAE are show n in Fig.\[ d cae result s\ ](b ) . Thetrain ed mod el is ableto r econstruc t thet raining data wi th hig h p rec isio n .Re ade rs may co mpa r e t he first  a nd  seco nd r o w s of F ig. \[dc aeres ults\](b.1) f ordeta i ls.  In c ontra st,th e rec onstru ctedim ages show signi fica nt differ enc efor  t he te s t data . I t f ailed t o recon s tru ct t h etest data. Readers  m a y  c ompare t he fir s tan d  secondro w o f Fi g . \[dca eres u lt s\](b.2)  to se e  t he  differ en ce. Es pe cia lly  fort he f irst c olumn of  Fig. \ [dcaeresults\] ( b.2), the bow l  i s wr o ngly  co nsidered to  bea t atota l ly  di f feren t pos it i on . 

The LSTM-RNN mode lis not  able  to generatescooping m o t i on for e ithe r  t h e training dat a orthe test d a ta. Themotio n is ran domly cha n g ing from  ti metotim e .  I t doesn’t fol l o w an ypre-tau ght  sequen ces . T herea so n is prob ably the  b ad  r ec ons truct i on perfo rm anc eofDCAE. The sy stemfail ed  t o  co rrectly fi n d  the  p os itio nsof  thebowl s  us ing the  encodedfea t ures .Ba sed onthe analysis,  w e increase  t hetraini n g  data of  DCAE in Experiment 3 t o  improv e i ts re cons truction. 

E xperim ent 3: Inc reasin g the  t rai n i ng da t a  o f D CA E
-------- - - --- ----- -- ---- ------- ------------------ - 

T he third grou p o f ex p e ri men t sh asex a ctl y the same scenar io setting sa nd  parameter set ti ngs asExperim ent 2 ,  except  that weuse plann in g al g o rit hms to gen erate sc ooping mo t ion a n dcolle ctmore s co opi ng im ages.The  newscoopi ng  image s are  c ollected  following the work flo w show s inFig .\[sample \]. Wedivide th e wo rk space i nto  ar ound100 grids , pl a ce  bo w l atthes e  places,a nd  sa m p le  arm boatsw a i n s a nd or ien t ations  ateach of the grid. In total, we a ddit i o nal lyg ener at e 100$\times$4 5$\ ti m e s$3=1350 0(12726 exac tly) ext ra train ing im ages t o train D CA E . Here , “1 00”  indicate s t he 100 gri dpo s itions . “4 5”  and “ 3” ind i cate t he 45 arm positi ons a n d  3 ar m  ro tatio nangless ampl ed at each  grid.

![I ncreas e th e tra ining d at a of D CAE  b y automati c ally gene ratin g motio ns  acr oss  a 10$ \tim e s $10 g rids .Inall, 100$ \ t im e s$ 45 
 bowls_were placed_at 7 different positions._At each_position,_we collect_20_sequences of data_with 5 for_each bowl-barley combination. In_total, we collect_140_sequences of data. 139 of the 140 sequences of data are used to train_DCAE_and LSTM-RNN._The_remaining_1 sequence are used for_testing. The parameters of DCAE_and LSTM-RNN_are the same as experiment 1.

The results of_DCAE_are shown in_Fig.\[dcaeresults\](b). The trained model is able to reconstruct the_training data with high precision. Readers_may compare the_first_and_second rows of Fig.\[dcaeresults\](b.1)_for details. In contrast, the reconstructed_images show significant difference for the_test data. It failed to reconstruct the_test data. Readers may compare the_first and second row of_Fig.\[dcaeresults\](b.2) to_see the difference. Especially for_the first column_of Fig.\[dcaeresults\](b.2),_the bowl is_wrongly considered to be at a_totally different position.

The_LSTM-RNN model is not able to_generate_scooping motion for_either_the_training data_or the test_data._The motion_is_randomly changing from time to time._It_doesn’t follow any pre-taught sequences. The reason_is probably the bad_reconstruction_performance of DCAE. The_system failed to correctly find_the positions of the bowls using_the encoded_features. Based_on the analysis, we increase the training data of DCAE in_Experiment 3 to improve its reconstruction.

Experiment_3: Increasing the training_data of_DCAE
--------------------------------------------------

The_third group of_experiments_has exactly_the same scenario settings and parameter settings_as Experiment_2, except that we use planning_algorithms to generate scooping_motion_and collect more scooping images.

The new_scooping images are collected following the_work flow shows in Fig.\[sample\]._We_divide_the work space into around_100 grids, place bowl at these_places, and sample_arm boatswains and orientations at each of_the_grid. In total, we additionally generate_100$\times$45$\times$3=13500_(12726 exactly) extra training images to_train_DCAE._Here, “100” indicates the 100_grid positions. “45” and “3” indicate_the 45 arm positions and 3 arm rotation angles_sampled at each_grid.

![Increase the training data of_DCAE_by_automatically generating motions across a 10$\times$10 grids. In all, 100$\times$45