

We here address that $E({\mbox{\boldmath{$t$}}})=\sum_{i=1}^M \left 
(\frac{1}{2}-\delta_{r_i,t_i} \right )$ in Eq. (\[eq:gallager2\]) obeys Eq. (\[prob\]) independetly of ${\mbox{\boldmath{$r$}}}$ when each codeword ${\mbox{\boldmath{$t$}}}$ is equally generated in the ensemble such that each component is independently selected from an identical unbiased distribution $P(t_i=1)=P(t_i=0)=1/2$, which holds for the random code ensemble[@Shannon; @Gallager], although non-trivial correlations of ‘energy’ $E({\mbox{\boldmath{$t$}}})$ between ‘states’ ${\mbox{\boldmath{$t$}}}$ arise making the energy distribution different from Eq. (\[prob\]) in the case of practical linear codes. Therefore, for the current random code ensemble, Eq. (\[eq:gallager2\]) can be simplified as $$\begin{aligned}
\left \langle P_E({\cal C})
\right \rangle_{\cal C}  
\le 
\left (\frac{\cosh \frac{F}{2(1+n)}}{  \cosh \frac{F}{2}  }
\right )^M
\left \langle 
\left (
\sum_{A=1}^{2^N-1} \exp \left [-\frac{F}{1+n} \epsilon_A \right ]
\right )^n \right \rangle,  
\label{eq:bound_DREM}\end{aligned}$$ where $\left \langle \cdots \right \rangle $ denotes the configutational average with respect to the ‘energy states’ $\epsilon_A$ ($A=1,2,\ldots,2^N -1$) following Eq. (\[prob\]). Regarding $F/(1+n)$ as the inverse temperature, this means that an assessment of the average decoding error probability can be linked to calculating the general moment of the ‘partition function’ $Z=\sum_{A=1}^{2^N-1} 
\exp \left [-\frac{F}{1+n} \epsilon_A \right ]$ of DREM.

The replica analysis of GCDREM {#GCDREM}
==============================

Section \[
We here address that $ E({\mbox{\boldmath{$t$}}})=\sum_{i=1}^M \left 
 (\frac{1}{2}-\delta_{r_i, t_i } \right) $ in Eq.   (\[eq: gallager2\ ]) obeys Eq.   (\[prob\ ]) independetly of $ { \mbox{\boldmath{$r$}}}$ when each codeword $ { \mbox{\boldmath{$t$}}}$ is equally generated in the corps de ballet such that each part is independently choose from an identical unbiased distribution $ P(t_i=1)=P(t_i=0)=1/2 $, which holds for the random code ensemble[@Shannon; @Gallager ], although non - trivial correlation coefficient of ‘ energy ’ $ E({\mbox{\boldmath{$t$}}})$ between ‘ states ’ $ { \mbox{\boldmath{$t$}}}$ arise have the energy distribution different from Eq.   (\[prob\ ]) in the event of practical linear codes. consequently, for the current random code ensemble, Eq. (\[eq: gallager2\ ]) can be simplified as $ $ \begin{aligned } 
 \left \langle P_E({\cal C }) 
 \right \rangle_{\cal C }  
 \le 
 \left (\frac{\cosh \frac{F}{2(1+n) } } {   \cosh \frac{F}{2 }   } 
 \right) ^M 
 \left \langle 
 \left (
 \sum_{A=1}^{2^N-1 } \exp \left [ -\frac{F}{1+n } \epsilon_A \right ] 
 \right) ^n \right \rangle,  
 \label{eq: bound_DREM}\end{aligned}$$ where $ \left \langle \cdots \right \rangle $ announce the configutational average with respect to the ‘ energy states ’ $ \epsilon_A$ ($ A=1,2,\ldots,2^N -1 $) following Eq.   (\[prob\ ]). Regarding $ F/(1+n)$ as the inverse temperature, this mean that an assessment of the average decoding erroneousness probability can be linked to calculating the general moment of the ‘ division function ’ $ Z=\sum_{A=1}^{2^N-1 } 
 \exp \left [ -\frac{F}{1+n } \epsilon_A \right ] $ of DREM. 

 The replica psychoanalysis of GCDREM { # GCDREM } 
 = = = = = = = = = = = = = = = = = = = = = = = = = = = = = = 

 Section \ [


We jere address that $E({\mbox{\buldmath{$t$}}})=\sum_{i=1}^M \lgfr 
(\frac{1}{2}-\velta_{r_i,f_i} \right )$ in Eq. (\[eq:gallager2\]) obeys Eq. (\[prlb\]) indekvndetly of ${\mbox{\boldmagh{$r$}}}$ when vach codeqord ${\nbox{\boldmavg{$t$}}}$ is equally nenerctxd in the ensemnle such thdt each componang ns independently selected from an idqntical ujbiased distrifutipg $P(t_j=1)=I(t_l=0)=1/2$, which holds for the random cods ensemule[@Shannon; @Gallsger], although non-trivial clrrepations of ‘energy’ $F({\mbox{\boldmajg{$t$}}})$ fwtween ‘stater’ ${\mbox{\boldmath{$t$}}}$ arise jaking the energy distribution aiffexent from Ew. (\[peob\]) hn the case of pgactical linear codes. Therefpre, for the cuvrent rabdom code ensemble, Eq. (\[eq:gallager2\]) can be simplifiad as $$\begin{aligned}
\lwfr \lancle [_E({\cau C})
\rkghu \rengme_{\cal F}  
\me 
\left (\frzc{\cosh \frac{D}{2(1+n)}}{  \cosh \frac{F}{2}  }
\rignt )^N
\left \langle 
\meft (
\stm_{W=1}^{2^N-1} \exp \left [-\frac{F}{1+n} \epsilon_A \right ]
\right )^n \dight \rangle,  
\label{eq:boynd_DREM}\end{aligned}$$ whete $\left \laggle \cdots \right \rangle $ denotes the configutatiotal atefagt qith fwsoect to the ‘energy states’ $\epsilon_A$ ($A=1,2,\ldots,2^N -1$) fjmlpwpng Eq. (\[prob\]). Regardlng $F/(1+n)$ as the invetsf ygmperature, thir means tgat an assessment lf the wverate decodigg etror probability can be linjed to calcujqting the general loment of tke ‘parjition function’ $Z=\sum_{A=1}^{2^N-1} 
\exp \leyt [-\frad{F}{1+n} \epsilon_W \right ]$ kw DREM.

The replicx akalfsis of GCDREM {#GCDREM}
==============================

Sectijn \[
We here address that $E({\mbox{\boldmath{$t$}}})=\sum_{i=1}^M \left (\frac{1}{2}-\delta_{r_i,t_i} in (\[eq:gallager2\]) obeys (\[prob\]) independetly of is generated in the such that each is independently selected from an identical distribution $P(t_i=1)=P(t_i=0)=1/2$, which holds for the random code ensemble[@Shannon; @Gallager], although non-trivial correlations ‘energy’ $E({\mbox{\boldmath{$t$}}})$ between ‘states’ ${\mbox{\boldmath{$t$}}}$ arise making the energy distribution different from Eq. in case practical codes. Therefore, for the current random code ensemble, Eq. (\[eq:gallager2\]) can be simplified as $$\begin{aligned} \left P_E({\cal C}) \right \rangle_{\cal C} \le \left (\frac{\cosh \cosh \frac{F}{2} } \right \left \langle \left ( \sum_{A=1}^{2^N-1} \left \epsilon_A \right \right \right \label{eq:bound_DREM}\end{aligned}$$ where $\left \cdots \right \rangle $ denotes the configutational average with respect to the ‘energy states’ $\epsilon_A$ ($A=1,2,\ldots,2^N -1$) Eq. (\[prob\]). as the temperature, means an assessment of decoding error probability can be linked general moment of the ‘partition function’ $Z=\sum_{A=1}^{2^N-1} \exp [-\frac{F}{1+n} \epsilon_A ]$ of DREM. The replica analysis GCDREM {#GCDREM} ============================== Section \[


We here address that $E({\mbox{\bolDmath{$t$}}})=\sum_{i=1}^m \left 
(\FraC{1}{2}-\deLtA_{r_i,t_I} \rigHt )$ in Eq. (\[eq:gallagER2\]) obeYs Eq. (\[prob\]) independetly of ${\Mbox{\bOlDMath{$R$}}}$ WhEn eacH codewoRD ${\mBOX{\boLdMaTh{$t$}}}$ Is EQuAlly gEneRated in The ensemblE suCh That each compONeNt is indepeNdeNtly selected FroM an ideNtIcaL UnbiaSed DistrIbutioN $p(t_i=1)=P(t_i=0)=1/2$, Which holdS fOR the raNDom code ENSeMble[@shannon; @Gallager], alTHoUGh non-trivial coRrelatIoNS oF ‘ENerGy’ $E({\Mbox{\boldmaTh{$T$}}})$ betwEEn ‘stateS’ ${\MbOX{\BOldMAth{$t$}}}$ arise makiNg the energy DIstRibutiOn DifFErent fRom Eq. (\[PrOB\]) in The case of prActiCal linear Codes. THErefore, FOr the cuRrent rAndOm cOde eNSeMbLe, EQ. (\[eQ:GalLAgEr2\]) cAN be SimplifiEd As $$\Begin{AligNED}
\LEft \lAngLe P_E({\Cal C})
\rIght \rangle_{\cal c}  
\le 
\Left (\FRac{\Cosh \fRac{F}{2(1+n)}}{  \Cosh \FrAc{F}{2}  }
\riGht )^M
\leFt \lanGlE 
\left (
\sum_{A=1}^{2^N-1} \exp \leFt [-\frAc{F}{1+n} \epsilOn_A \RiGht ]
\RiGht )^n \rIGht \ranGle,  
\LabEl{eq:bouNd_DREM}\eND{alIgNED}$$ WhEre $\left \langle \cdots \RiGHT \rAngle $ denOtes thE CoNfIGutationAl AveRage WITh resPect TO tHe ‘energy States’ $\EPsIlOn_A$ ($A=1,2,\ldoTs,2^n -1$) folloWiNg EQ. (\[prOb\]). RegARdinG $F/(1+n)$ as tHe inversE tempERature, this meanS That an assessmENt OF ThE AverAge Decoding errOr prOBabiLity CAn Be lINked tO calcUlATiNG the general moment of ThE ‘partiTion fUnction’ $Z=\sum_{A=1}^{2^N-1} 
\Exp \left [-\fraC{f}{1+N} \Epsilon_A \RighT ]$ Of drEM.

The replica aNalysIs of GCDREM {#gcDREM}
==============================

SecTion \[


We here address that $E( {\mbox{\bo ldmat h{$ t$} }} )=\s um_{ i=1}^M \left ( \fra c{1}{2}-\delta_{r_i,t_ i} \r ig h t )$ in  Eq.(\[eq:g a ll a g er2 \] )obe ys Eq . (\[ pro b\]) in dependetly  of  $ {\mbox{\bold m at h{$r$}}}$whe n each codew ord  ${\mb ox {\b o ldmat h{$ t$}}} $ is e q uallygenerated  i n  the e n sembles u ch  tha t each componenti si ndependently s electe df ro m anide ntical unb ia sed d i stribut i on $ P (t_ i =1)=P(t_i=0)= 1/2$, which hol ds for  t her andomcodeen s emb le[@Shannon ; @G allager],  altho u gh non- t rivialcorrel ati ons  of‘ en er gy’  $ E ({\ m bo x{\ b old math{$t$ }} }) $ bet ween ‘ s t ates ’ $ {\mb ox{\b oldmath{$t$}} }$aris e  ma kingthe e nerg ydistr ibutio n dif fe rent from Eq. ( \[pr ob\]) inthe  c ase  o f pra c ticallin ear  codes.  Theref o re,  f o r th e current random c od e en semble,Eq. (\ [ eq :g a llager2\ ])  ca n be s impli fied as  $$\begi n{alig n ed }\left \ la ngle P _E ({\ cal  C})\ righ t \ran gle_{\ca l C}
\le 
\left (\ f rac{\cosh \fr a c{ F } {2 ( 1+n) }}{   \cosh \fr ac{F } {2} }
\ r ig ht) ^M
\l eft \ la n gl e  
\left (
\sum_{A=1 }^ {2^N-1 } \ex p \left [-\fr ac{F}{1+n} \ e psilon_A  \ri g ht ]
\right )^n \ right  \rangle,
\label{ eq:bo und_DREM }\end{ali g n ed}$$ wh ere  $\ lef t \ l a ng le \cdots \ri g h t \r an gle $ d eno tes the  co nfi gut ati on al averag e with r es pe ct  t o t he ‘e n ergy sta te s’$\ eps ilon_ A $ ($A= 1,2,\ ldot s, 2^ N  -1 $) foll o wi n g  Eq.  ( \[ prob \]) .Regar ding $F/ (1+n)$as the in ver s e te mp er ature,this means th at  an assess me ntof the a verage d ecoding error probabili t y can b e l inked  tocalculati ngthe ge ner a l mome nt ofthe ‘ pa rti t i on fu n c ti on’  $ Z=\sum_{A= 1 } ^{2 ^N-1}  \exp  \left[-\frac{F}{1+n} \e p sil on_A \right ] $ o f DR E M .
Th e  r e pli ca ana l y sis of GCDREM { #GCDREM}
= == = == ========== = === == ======= =

Sect ion \ [ 


We here_address that_$E({\mbox{\boldmath{$t$}}})=\sum_{i=1}^M \left 
(\frac{1}{2}-\delta_{r_i,t_i} \right_)$ in_Eq. (\[eq:gallager2\])_obeys Eq. (\[prob\])_independetly_of ${\mbox{\boldmath{$r$}}}$ when_each codeword ${\mbox{\boldmath{$t$}}}$_is equally generated in_the ensemble such_that_each component is independently selected from an identical unbiased distribution $P(t_i=1)=P(t_i=0)=1/2$, which holds for_the_random code_ensemble[@Shannon;_@Gallager],_although non-trivial correlations of ‘energy’_$E({\mbox{\boldmath{$t$}}})$ between ‘states’ ${\mbox{\boldmath{$t$}}}$ arise_making the_energy distribution different from Eq. (\[prob\]) in the case_of_practical linear codes._Therefore, for the current random code ensemble, Eq. (\[eq:gallager2\])_can be simplified as $$\begin{aligned}
\left \langle_P_E({\cal C})
\right \rangle_{\cal_C}__
\le 
\left (\frac{\cosh \frac{F}{2(1+n)}}{_ \cosh \frac{F}{2}  }
\right )^M
\left_\langle 
\left (
\sum_{A=1}^{2^N-1} \exp \left [-\frac{F}{1+n}_\epsilon_A \right ]
\right )^n \right \rangle, _
\label{eq:bound_DREM}\end{aligned}$$ where $\left \langle \cdots \right_\rangle $ denotes the configutational_average with_respect to the ‘energy states’_$\epsilon_A$ ($A=1,2,\ldots,2^N -1$)_following Eq. (\[prob\])._Regarding $F/(1+n)$ as_the inverse temperature, this means that_an assessment of_the average decoding error probability can_be_linked to calculating_the_general_moment of_the ‘partition function’_$Z=\sum_{A=1}^{2^N-1}_
\exp \left_[-\frac{F}{1+n}_\epsilon_A \right ]$ of DREM.

The replica_analysis_of GCDREM {#GCDREM}
==============================

Section \[