crunchcrawl

Crunchcrawl This module lets you index and download the company information held in Crunchbase. Before using, double-check http://www.crunchbase.com/robots.txt and the API conditions to ensure you'r...

Report an issue
Downloads
2,009
Last updated
Data files
3
Total size
2.57 MB
Format
csv
License
CC-BY-4.0
badge

Crunchcrawl


This module lets you index and download the company information held in Crunchbase.
*Before using, double-check http://www.crunchbase.com/robots.txt and the API conditions to ensure you're obeying the terms-of-service*

It contains various scripts to index and pull down the latest data about the company, as well as a snaphot of the data as it was on Monday August 23rd 2010. This data is CC-BY, see http://www.crunchbase.com/help/licensing-policy for more information.

By Pete Warden <pete@petewarden.com>, freely reusable, see http://petewarden.typepad.com for more

API access

Access dataset files directly from scripts, code, or AI agents.

Each file has a stable URL (r-link) that you can use directly in scripts, apps, or AI agents. These URLs are permanent and safe to hardcode.

  1. Fetch datapackage.json to inspect schema and resources
  2. Download data resources listed in datapackage.json
  3. Read README.md for full context
/core/crunchcrawl/15 files
  • README.mddocumentationhttps://datahub.io/core/crunchcrawl/_r/-/README.md
  • cliargs.phphttps://datahub.io/core/crunchcrawl/_r/-/cliargs.php
  • companydata.csvhttps://datahub.io/core/crunchcrawl/_r/-/companydata.csv
  • companydata.txthttps://datahub.io/core/crunchcrawl/_r/-/companydata.txt
  • companyurls.txthttps://datahub.io/core/crunchcrawl/_r/-/companyurls.txt
  • companyurls_test.txthttps://datahub.io/core/crunchcrawl/_r/-/companyurls_test.txt
  • datapackage.jsonmetadata & schemahttps://datahub.io/core/crunchcrawl/_r/-/datapackage.json
  • gathercompanies.phphttps://datahub.io/core/crunchcrawl/_r/-/gathercompanies.php
  • gathercompanyurls.phphttps://datahub.io/core/crunchcrawl/_r/-/gathercompanyurls.php
  • parallelcurl.phphttps://datahub.io/core/crunchcrawl/_r/-/parallelcurl.php
  • places2k.txthttps://datahub.io/core/crunchcrawl/_r/-/places2k.txt
  • scratchpad.pyhttps://datahub.io/core/crunchcrawl/_r/-/scratchpad.py
  • zcta5.txthttps://datahub.io/core/crunchcrawl/_r/-/zcta5.txt
  • zips_by_amount.csvhttps://datahub.io/core/crunchcrawl/_r/-/zips_by_amount.csv
  • zips_by_numbers.csvhttps://datahub.io/core/crunchcrawl/_r/-/zips_by_numbers.csv