Specifications

This data feed subscription is licensed to you or your organization only, you may not resell or relicense the data without explicit written permission from Whois API, Inc. Any violation will be prosecuted to the fullest extent of the law.

The data feed provides a downloadable subdomains database in the format of rows with information of each of the 9.6+ billion records. To get access to the Database files from the paths, you need to provide valid credentials. Username and password are equal to your personal API Key which you can obtain from the My Products page.

Sample

How to download the datafeed files

Downloading via HTTPS

Downloading via FTP

Downloading via FTPS

Read more about the FTPS connection: https://en.wikipedia.org/wiki/FTPS.

Our FTP server supports explicit FTP over TLS encryption. You may configure your FTP client to use explicit FTP over TLS encryption for secure communications.

Our FTPS server is accessed using the same paths and API keys as a regular FTP server, the instructions for which are described above. To connect via FTPS, select the "Require explicit FTP over TLS" encryption option in your FTP client, if it supports it. FileZilla configuration example:

explicit FTP over TLS encryption

Average file sizes

File type File mask Avg. gzipped file size Avg. unpacked file size Avg. number of records
Daily diff sdp.*.daily.diff.csv.gz 116MB 328MB 4.4M
Weekly diff sdp.*.weekly.diff.csv.gz 833MB 2.3GB 32M
Weekly full sdp.*.weekly.full.csv.gz 201GB 622GB 11B
Monthly diff sdp.*.monthly.diff.csv.gz 4.5GB 13GB 166M

  • Daily Diff — Contains subdomains discovered within the last 24 hours.
  • Weekly Diff — Contains subdomains discovered within the last 7 days.
  • Weekly Full — Complete export of all known subdomains from the database.
  • Monthly Diff — Contains subdomains discovered within the last 30 days.

Output structure and fields' descriptions

  • Structure: <domain>,<firstSeen>,<lastSeen>
  • Example: 104-55-77-110.lightspeed.mssnks.sbcglobal.net,1548418836,1592145871
domain
Domain name.
firstSeen
Timestamp of the first time that the record was seen.
lastSeen
Timestamp of the last update for this record.