# Explanation of LidarBoost Algorithm?

I am trying to understand the LidarBoost algorithm as explained in this paper (PDF warning).

I don't understand how they take the original depth-images $Y_k$ and transform them into the up-sampled images $D_k$. I get how optical flow is used to align the $Y_k$ into a chosen reference frame, but is the transform between $Y_k$ and $D_k$ just a standard image up-sampling with nearest neighbors for the "interpolation" step? If that's the case, can someone explain how they get the term $W_k$ in their data term of the energy function? They say this about it, but I don't understand how to construct $W_k$ for each $k$:

$W_k \in \mathbb{R}^{\beta_n \times \beta_m}$ is a banded matrix that encodes the positions of $D_k$ which one samples from during resampling on the high-resolution target grid

I'm trying (so far frustratingly ineffectively) to get enough of a sense of the algorithm to try to implement it.

It sounds like $W_k$ is just a matrix of 1's and 0's. When $W_k$ is a 1, then the corresponding range value in $D_k$ is used. If it's a 0, then that range value is not used.
Similarly, $T_k$ should be mostly 1, and 0 when the corresponding $D_k$ values are unreliable.
• Two things confuse me with that. First of all, it says that $W_k$ is a banded matrix, and I don't see how treating it as an indicator matrix would give the banded structure; same thing for $T_k$, which the paper claims is diagonal. Secondly, how would I actually construct $W_k$ from a given $Y_k$ and $D_k$? I can't figure out when to decide to use a sample or not. – anjruu Apr 30 '13 at 20:46
• I suspect $W_k$ is "banded" because the top-right and bottom-left corners may be zero (depending on the re-sampling). I, too, do not understand why $W_k$ would be diagonal. I emailed Dr Schuon to see if he has any more detailed explanation of the algorithm; let's see if he responds. – Peter K. Apr 30 '13 at 21:53
{"ft_lang_label":"__label__en","ft_lang_prob":0.94779783,"math_prob":0.9927362,"size":909,"snap":"2019-43-2019-47","text_gpt3_token_len":227,"char_repetition_ratio":0.0961326,"word_repetition_ratio":0.0,"special_character_ratio":0.23652366,"punctuation_ratio":0.053892214,"nsfw_num_words":0,"has_unicode_error":false,"math_prob_llama3":0.99916244,"pos_list":[0],"im_url_duplicate_count":[null],"WARC_HEADER":"{\"WARC-Type\":\"response\",\"WARC-Date\":\"2019-11-17T05:59:22Z\",\"WARC-Record-ID\":\"<urn:uuid:2fde2959-e207-4a17-915d-4bf613b45ca6>\",\"Content-Length\":\"137106\",\"Content-Type\":\"application/http; msgtype=response\",\"WARC-Warcinfo-ID\":\"<urn:uuid:442028df-d625-40e9-a775-7b1aef8b7f0a>\",\"WARC-Concurrent-To\":\"<urn:uuid:9410a217-7193-48dd-8e07-0ccff28e97ae>\",\"WARC-IP-Address\":\"151.101.1.69\",\"WARC-Target-URI\":\"https://dsp.stackexchange.com/questions/8916/explanation-of-lidarboost-algorithm\",\"WARC-Payload-Digest\":\"sha1:WRH6HWSQDE55R2JUX6TJQDPIW5XDKBKR\",\"WARC-Block-Digest\":\"sha1:6KSZG6BBXOC46PV5RMJC4VEZXG7LZM4C\",\"WARC-Identified-Payload-Type\":\"text/html\",\"warc_filename\":\"/cc_download/warc_2019/CC-MAIN-2019-47/CC-MAIN-2019-47_segments_1573496668787.19_warc_CC-MAIN-20191117041351-20191117065351-00070.warc.gz\"}"}