Hugging Face's logo
Guilherme Penedo's picture
89 15 16

Guilherme Penedo

guipenedo
maxchillin's profile picture iarfocusty's profile picture roshdiraed's profile picture
·

AI & ML interests

None yet

Recent Activity

new activity about 6 hours ago
HuggingFaceFW/fineweb:Downloading the 350BT sample uses 990GB of disk space
new activity about 6 hours ago
HuggingFaceFW/fineweb:Create Ffcc
upvoted an article about 9 hours ago
Finding Moroccan Arabic (Darija) in Fineweb 2
View all activity

Organizations

Hugging Face's profile picture BigScience Data's profile picture HuggingFaceBR4's profile picture Hugging Face H4's profile picture Hugging Face Extreme-Scale's profile picture Hugging Face TB Research's profile picture Hugging Face Smol Cluster's profile picture Nanotron Research's profile picture HuggingFaceFW's profile picture Data Is Better Together's profile picture mlo-data-cleaning's profile picture Dev Mode Explorers's profile picture HuggingFaceFW-Dev's profile picture Hugging Face Science's profile picture ml-fw-prerelease's profile picture Open R1's profile picture

guipenedo's activity

New activity in HuggingFaceFW/fineweb about 6 hours ago

Downloading the 350BT sample uses 990GB of disk space

4
#57 opened 26 days ago by
ddh0

Create Ffcc

1
#58 opened 1 day ago by
Ricky23184
New activity in huggingface-legal/takedown-notices 12 days ago

Update 2025/2025-01-22-Torstar.md
#4 opened 12 days ago by
guipenedo
New activity in HuggingFaceFW/fineweb-edu 20 days ago

New update returns a 500 server error using the datasets-server API

6
#18 opened about 2 months ago by
jonna32
New activity in HuggingFaceFW/fineweb-2 23 days ago

Synthetic Data Generator

1
#5 opened about 1 month ago by
kishorekashyap
New activity in HuggingFaceFW/fineweb-2 about 1 month ago

Cannot load with datasets

3
#4 opened about 1 month ago by
mbanon
New activity in HuggingFaceFW/fineweb-edu about 1 month ago

A lot of load errors after new update

14
#19 opened about 1 month ago by
yzhangcs

Add "date" column to "default" subset
#20 opened about 1 month ago by
lhoestq
New activity in HuggingFaceFW/fineweb about 2 months ago

Simple exact deduplication removes 2/3 of data.

4
#49 opened 6 months ago by
egor-pakhomov

Torrent?

3
#4 opened 10 months ago by
emilss

Any plan to train models on larger subset of dataset?

1
#8 opened 10 months ago by
mrfakename

Are copyrighted works included in this dataset?

4
#9 opened 10 months ago by
umm-maybe

Reprocessing for a new language

14
#12 opened 10 months ago by
pere

Training configs for data ablation study

2
#14 opened 10 months ago by
jimmyhbx

tiny-fineweb

3
#19 opened 10 months ago by
3thn

Unsafe files

1
#25 opened 9 months ago by
alielfilali01

"Reproducing GPT-2 (124M) in llm.c in 90 minutes for $20" using fineweb by Karpathy
#28 opened 9 months ago by
clem

Regarding to the newly updated indexes(writen as deduplication issues)

5
#29 opened 8 months ago by
kimcando

Dedup

1
#32 opened 8 months ago by
shawnkx

Language subset

3
#33 opened 8 months ago by
talmor