Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

Common Crawl Foundation

Team
non-profit
Verified
https://commoncrawl.org
commoncrawl
commoncrawl
Activity Feed

AI & ML interests

Crawled data and metadata

Recent Activity

malteosΒ  updated a dataset about 16 hours ago
commoncrawl/llms.txt
lfoppianoΒ  updated a bucket about 18 hours ago
commoncrawl/warc2zip-examples
malteosΒ  published a dataset about 19 hours ago
commoncrawl/web-graph-embeddings
View all activity

Thom Vaughan's profile picture Pedro Ortiz Suarez's profile picture Paul Lazar's profile picture Greg Lindahl's profile picture Ford H's profile picture Jen English's profile picture Sebastian Nagel's profile picture Laurie Burchell's profile picture Hande Celikkanat's profile picture malteos's profile picture Thijs Dalhuijsen's profile picture Luca's profile picture Catherine Arnett's profile picture Michael Paris's profile picture

commoncrawl 's Spaces 6

pinned
Running

README

🌍

Explore Common Crawl's metadata and experimental datasets

Nov 20, 2024
Running
Agents

Web Graph kNN Spot-check

πŸ”Ž

Nearest neighbours of a host in the CC host-graph embedding

about 19 hours ago
Running

Web Graph Embeddings

🏒

4 days ago
Running
1

What is actually inside llms.txt

πŸ“„

Display analysis of 584,107 llms.txt documents from Common Crawl

21 days ago
Running
Agents
4

CommonLID Leaderboard

🌍

Explore the CommonLID language ID leaderboard online

22 days ago
Running
9

cc-citations

πŸ“œ

Scientific articles using or citing Common Crawl data

Feb 19
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs