Shovels

Large scale data delivery for modern data teams

We use the latest geospatial and data science techniques to bring you the most accurate and useful data possible. We deliver to Snowflake, BigQuery, and Databricks or directly to your S3, GCS, or Azure buckets.

Illustration showing building materials and construction data analytics

Enterprise-grade building permit data

Snowflake integration icon Snowflake delivery

To get our permit data in Snowflake, we just need your public org and account identifiers. No extra engineering or security support required.

Big Query integration icon BigQuery delivery

To get permit data into your BigQuery account, we just need a Google service account. The tables will arrive pre-formatted and ready to query.

Parquet format icon Parquet delivery

Parquet files are optimized for complex data structures, making data ingestion faster and more reliable. We also support CSV delivery if needed.

Automatic updates icon Automatic updates

With our private table sharing service, updates are done automatically. When we have new production data, it flows into your Snowflake, Big Query, or Databricks account automatically.

Custom schema icon Custom schema

For super custom reporting, we can run SQL locally and format your report exactly the way you want it. For these requests, we'll deliver as CSV and offer both one-time and monthly options.

Terms and conditions icon Flexible terms

Our terms give you the flexibility to create derivative works and build robust products using our comprehensive permit and contractor data.

Enterprise-grade workflows

We ❤️ data warehouses

We're used to working with data science teams and integration consultants. Contact us to discuss your use case and get a data sample.

Push anywhere.
We support all major cloud storage providers, including AWS, Azure, and GCP. We also push to Snowflake, BigQuery, and Databricks.
Transfer securely.
We use SFTP and HTTPS to transfer your data securely. Let us do the data appending so your team can focus on what matters most.
New models.
We use AI and modern data science to derive new insights from permit, parcel, and census tract data.
Product screenshot

Frequently Asked Questions

What data tables are included in the Shovels data feed?

The data feed includes seven core tables: Permits (130M+ records), Contractors (2.3M+), Decisions (25K+), Residents (46M+), Employees (77M+), Contractor State Licenses (3M+), and Parcels (160M+ via Regrid). Permits are updated twice monthly, Decisions are updated in real time, while all other tables are updated monthly.

Which data warehouses does Shovels deliver to?

Shovels delivers directly to Snowflake, BigQuery, and Databricks through private table sharing. We also support delivery to AWS S3, Google Cloud Storage, and Azure blob storage. Parquet files are available as an alternative format.

How are data feed updates handled?

Updates are automatic and monthly. Shovels refreshes its database on the 1st and 15th of each month, and new production data flows into your Snowflake, BigQuery, or Databricks account automatically. Each cycle adds 5-10 million new records and 1-5 million status updates.

Can I get a custom data schema or report?

Yes. For custom reporting needs, Shovels can run SQL queries and format reports to your exact specifications. Custom reports are available as CSV with one-time or monthly delivery options.

What engineering effort is needed to set up the data feed?

Minimal. For Snowflake, Shovels only needs your public org and account identifiers. For BigQuery, a Google service account is required. Tables arrive pre-formatted and ready to query with no additional engineering or security configuration.

Explore our building permit and contractor data now