Long-LRM: Long-sequence Large Reconstruction Model for Wide-coverage Gaussian Splats
3D Reconstruction
Yes
No ethics review needed. Yes, Other reasons (please specify below)
While the work on token merging and Gaussian pruning for memory efficiency is valuable, these engineering optimizations better fit computer vision venues like CVPR. Despite the technical advances,  could you justify how this work aligns with ICLR's focus on fundamental machine learning methodology rather than computer vision conferences?
1. Enhance feed-forward scene reconstruction methods, eg, GS-LRM to more input views.

2. The usage of hyrbid network of Mamba and transformer is reasonable for handling extreme long-sequence tokens, though it is not the first paper in this field that introduce Mamba.

3. Practical solutions for memory efficiency through token merging and Gaussian pruning, enabling scaling to high resolutions (960x540) where other variants fail.

4. The ablation study is comprehensiev, well demonstrating the effectiveness of each component, with clear metrics on performance gains.
This paper introduces Long-LRM, a feed-forward model for large-scale 3D Gaussian reconstruction that can process 32 high-resolution (960×540) input images in just 1.3 seconds on a single A100 GPU. The key innovation lies in its hybrid architecture combining Mamba2 and transformer blocks, along with efficient token merging and Gaussian pruning strategies to handle long sequences and memory constraints. The model achieves 600× faster reconstruction than optimization-based 3D Gaussian Splatting while maintaining comparable or better quality, as demonstrated through comprehensive evaluations on DL3DV and Tanks and Temples datasets.
1. Lack of novelty. The core contribution of this paper seems a combination of GS-LRM and Hamba, Gamba  and MVGamba. 

2. The lack of discussion on the above Mamba-based 3D reconstruction models, which have been publicly available more than half years, is not acceptable.

3. While this paper presents several practical innovations in memory optimization, it may be more suitable for computer vision conferences rather than ICLR.
Yes
No ethics review needed.
please refer to the weakness part.
1. Extends the application of feed-forward 3D scene reconstruction to longer-range inputs.
2. Sound network architecture design by combining transformers and Mamba2 to process long token sequences.
3. Applies a token merging module to reduce computational overhead for processing long-range input views.
4. The author provides justification for using Mamba in Table 2, although the comparison with GS-LRM is somewhat unfair.
This paper proposed a generalizable 3D reconstruction framework for a long range of input images. 3D Gaussian Splatting is used as the 3D representation like many previous works. The network architecture is design as mixture of Mamba2 and transformer layers to process input tokens with long length.  The whole model is trained in single stage and can reconstruct large scale 3D secenes on DL3DV-140, Tanks and Template datasets.
1. Insufficient justification for using Mamba. GS-LRM claims it can accept arbitrary input view numbers by downsampling images with large patch sizes to shorten the overall token length for global attention. The features after attention can then be upsampled to predict a large number of Gaussians. However, in Table 2, the authors provide the same patch size for both the 7M1T and GS-LRM architectures, leading to an unfair comparison.

2. Why not cost volumes and abadon 3D inductive biases. Although the authors have argued that methods like MVSplat are prone to out-of-memory (OOM) issues, these challenges are largely engineering problems that can be addressed with techniques like FlashAttention or through lightweight network architecture design. The authors need to clarify this point; otherwise, this work may mislead the feed-forward 3D scene reconstruction community.

3. Lack of discussion on 3D reconstruction works utilizing Mamba. This work seems to overlook prior research utilizing Mamba for 3D reconstruction, such as Hamba, Gamba, and MVGamba, which have been publicly available for over six months. Discussing these related works is necessary to emphasize the motivation for this study.

4. Limited technical contribution and insight. The technical contributions of this work are quite limited, as are its insights. It mainly extends previous 3D reconstruction efforts that use Mamba for scene reconstruction. Notably, combining Mamba and transformer blocks cannot be considered novel, as this setup was proposed in the Mamba v2 paper and has been widely adopted in various Vision Mamba works with Mamba v2. When evaluating the technical contributions, it is challenging to provide a positive rating, as nearly all modules in this paper have been widely used in numerous feed-forward 3D object reconstruction studies over the past year. Additionally, the claims regarding cost volumes contradict established practices in feed-forward 3D scene reconstruction.

Based on the weaknesses outlined above, I think this paper is marginally below the acceptance threshold.
Yes
No ethics review needed.
1.Is it able to seamlessly concat all sets of gaussians inferred by your models for large scale scenes which need hundreds of images? If so, how is it compared with city-scale reconstruction methods like CityGaussian and Octree-GS: Towards Consistent Real-time Rendering with LOD-Structured 3D Gaussians, which are designed for real large scale scene reconstruciton.
1.Introducing a method able to infer the 3DGS for wide-coverage scenes.

2.Utilize Mamba2 architecture to model the long token relations.
They propose a generalizable 3D Gaussian reconstruction model that can reconstruct a wide -coverage scene from a long sequence of input images with Mamba2 blocks. Some validation results shows the effeciveness compared with original 3DGS.
1.The comparison is not enough. Only compared with naive 3DGS. There are recent 3DGS/NeRF variants designed for large scale scene modeling: Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fields, Scaffold-GS: Structured 3D Gaussians for View-Adaptive Rendering, Mip-Splatting: Alias-free 3D Gaussian Splatting.

2.Despite of the inference speed, it shows in the videos the floaters appear without further regularizations.

3.They main contribution is to use Mamba2 for long sequence modeling, which limits the technical contribution of the paper.

4.It is better to show the NVS comparison under sparse view setting compared with generalizable 3DGS methods like MVsplat and pixelSplat.

5.The method only shows the NVS results, it would be better to show some surface reconstruction results since with the development of "2DGS" and "High-quality Surface Reconstruction using Gaussian Surfels". Nowadays surface reconstruction with Gaussians already achieves very good results.

6.No regularization for aliasing effect is proposed.
Enabling high-quality large-scene 3D Gaussian reconstruction in 1.3 seconds.
@inproceedings{
anonymous2024longlrm,
title={Long-{LRM}: Long-sequence Large Reconstruction Model for Wide-coverage Gaussian Splats},
author={Anonymous},
booktitle={Submitted to The Thirteenth International Conference on Learning Representations},
year={2024},
url={https://openreview.net/forum?id=meOELl7HRf},
note={under review}
}
We propose Long-LRM, a generalizable 3D Gaussian reconstruction model that is capable of reconstructing a large scene from 
a long sequence of input images. Specifically, our model can process 32 source images at 960$\times$540 resolution within only 1.3 seconds on a single A100 80G GPU. Our architecture features a mixture of the recent Mamba2 blocks and the classical transformer blocks which allowed many more tokens to be processed than prior work, enhanced by efficient token merging and Gaussian pruning steps that balance between quality and efficiency. Unlike previous generalizable 3D GS models that are limited to taking 1$\sim$4 input images and can only reconstruct a small portion of a large scene, Long-LRM reconstructs the entire scene in a single feed-forward step. On large-scale scene datasets such as DL3DV-140 and Tanks and Temples, our method achieves performance comparable to optimization-based approaches while being two orders of magnitude more efficient.
I certify that there is no URL (e.g., github page) that could be used to find authors’ identity.
I acknowledge that I and all co-authors of this work have read and commit to adhering to the ICLR Code of Ethics.
3D Reconstruction
I certify that there is no acknowledgement section in this submission for double blind review.
/pdf/c8c51632d1975e37959e65fcdf4ad650d4adb0b4.pdf
applications to computer vision, audio, language, and other modalities
I understand the reciprocal reviewing requirement as described on https://iclr.cc/Conferences/2025/CallForPapers. If none of the authors are registered as a reviewer, it may result in a desk rejection at the discretion of the program chairs. To request an exception, please complete this form at https://forms.gle/Huojr6VjkFxiQsUp6.
I certify that this submission complies with the submission instructions as described on https://iclr.cc/Conferences/2025/AuthorGuide.
Long-LRM: Long-sequence Large Reconstruction Model for Wide-coverage Gaussian Splats
ICLR 2025 Conference Submission
ICLR.cc/2025/Conference/Submission