Update README.md
Browse files
README.md
CHANGED
@@ -1,27 +1,27 @@
|
|
1 |
---
|
2 |
-
title:
|
|
|
|
|
3 |
emoji: π§
|
4 |
colorFrom: yellow
|
5 |
colorTo: indigo
|
6 |
sdk: static
|
7 |
-
pinned:
|
8 |
license: cc0-1.0
|
9 |
short_description: 's2 chunking: a hybrid framework for document segmentation'
|
10 |
---
|
|
|
11 |
|
12 |
-
# Nerfies
|
13 |
|
14 |
-
|
|
|
|
|
15 |
|
16 |
-
|
17 |
-
```
|
18 |
-
@article{park2021nerfies
|
19 |
-
author = {Park, Keunhong and Sinha, Utkarsh and Barron, Jonathan T. and Bouaziz, Sofien and Goldman, Dan B and Seitz, Steven M. and Martin-Brualla, Ricardo},
|
20 |
-
title = {Nerfies: Deformable Neural Radiance Fields},
|
21 |
-
journal = {ICCV},
|
22 |
-
year = {2021},
|
23 |
-
}
|
24 |
-
```
|
25 |
|
26 |
-
|
27 |
-
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
+
title: >-
|
3 |
+
S2 Chunking: A Hybrid Framework for Document Segmentation Through Integrated
|
4 |
+
Spatial and Semantic Analysis
|
5 |
emoji: π§
|
6 |
colorFrom: yellow
|
7 |
colorTo: indigo
|
8 |
sdk: static
|
9 |
+
pinned: true
|
10 |
license: cc0-1.0
|
11 |
short_description: 's2 chunking: a hybrid framework for document segmentation'
|
12 |
---
|
13 |
+
# π S2 Chunking: A Hybrid Framework for Document Segmentation Through Integrated Spatial and Semantic Analysis
|
14 |
|
|
|
15 |
|
16 |
+
π§ Authors: Prashant Verma
|
17 |
+
π
Published: Jan 2025
|
18 |
+
π [Read on arXiv](https://arxiv.org/abs/2501.05485)
|
19 |
|
20 |
+
## π Abstract
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
21 |
|
22 |
+
Document chunking is a critical task in natural language processing (NLP) that involves dividing a document into meaningful segments. Traditional methods often rely solely on semantic analysis, ignoring the spatial layout of elements, which is crucial for understanding relationships in complex documents. This paper introduces a novel hybrid approach that combines layout structure, semantic analysis, and spatial relationships to enhance the cohesion and accuracy of document chunks. By leveraging bounding box information (bbox) and text embeddings, our method constructs a weighted graph representation of document elements, which is then clustered using spectral clustering. Experimental results demonstrate that this approach outperforms traditional methods, particularly in documents with diverse layouts such as reports, articles, and multi-column designs. The proposed method also ensures that no chunk exceeds a specified token length, making it suitable for use cases where token limits are critical (e.g., language models with input size limitations)
|
23 |
+
|
24 |
+
|
25 |
+
## π§ Code & Models
|
26 |
+
|
27 |
+
The code used in this paper is available in this Space. You can also try the demo.
|