Derivative Analytics Data - S3

We offer Amazon S3 bulk downloads to retrieve massive historical datasets for select data types, delivered in Apache Parquet or CSV format.

Note: Our data buckets are configured as Requester Pays buckets, meaning your company will be responsible for any Amazon data transfer fees incurred during downloads. To access the data, you must include the following in your request headers: Header: x-amz-request-payer: requester or Parameter: --request-payer requester(for CLI requests).

Ensure this setting is included in all requests to avoid access issues.

Derivative Analytics Datasets

Market TypeSample Files
Decorated TradesDownload
Delta Surface ConstantDownload
Delta Surface FloatingDownload
Level 1 QuoteDownload

Derivative Analytics Data Fields & Descriptions

Decorated Trades

FieldDescription
tradeIdThe id of the trade.
instrumentNormalizedThe name of the instrument in Amberdata format.
blockTradeIdThe id of the block trade.
currencyThe currency
deltaThe greek delta value of the underlying option.
exchangeTimestampThe date & time as provided by the exchange.
expirationTimestampThe expiration timestamp.
gammaThe greek gamma value of the underlying option.
indexPriceThe index price (spot).
instrumentThe name of the instrument as provided by exchange.
isBuySideIndicates whether the trade was on the buy side (true) or sell side (false).
liquidationTrue if the trade is the result of a liquidation.
numberOfLegsThe number of legs in the block trade.
openInterestChangeThe change in open interest.
postTradeAskIvThe post-trade ask implied volatility.
postTradeAskPriceThe post-trade ask price.
postTradeAskVolumeThe post-trade ask size.
postTradeBidIvThe post-trade bid implied volatility.
postTradeBidPriceThe post-trade bid price.
postTradeBidVolumeThe post-trade bid size.
postTradeMarkIvThe post-trade mark implied volatility.
postTradeMarkPriceThe post-trade mark price.
postTradeMidIvThe post-trade mid implied volatility.
postTradeMidPriceThe post-trade mid price.
postTradeOpenInterestThe post-trade open interest.
postTradeOrderbookTimestampThe timestamp of the order post-trade.
preTradeAskIvThe pre-trade ask implied volatility.
preTradeAskPriceThe pre-trade ask price.
preTradeAskVolumeThe pre-trade ask size.
preTradeBidIvThe pre-trade bid implied volatility.
preTradeBidPriceThe pre-trade bid price.
preTradeBidVolumeThe pre-trade bid size.
preTradeMarkIvThe pre-trade mark implied volatility.
preTradeMarkPriceThe pre-trade mark price.
preTradeMidIvThe pre-trade mid implied volatility.
preTradeMidPriceThe pre-trade mid price.
preTradeOpenInterestThe pre-trade open interest.
preTradeOrderbookTimestampThe timestamp of the order pre-trade.
priceThe trade price.
priceHigh24hThe highest trade price in the past 24 hours.
priceLow24hThe lowest trade price in the past 24 hours.
priceUsdThe trade price (notional value).
putCallWhether this record is a put or a call.
rhoThe greek rho value of the underlying option.
sequenceThe sequence number for the trade data provided by the exchange; if available.
strikeThe strike price.
thetaThe greek theta value of the underlying option.
tickDirectionThe direction of the tick.
tradeAmountThe trade size.
tradeIvThe trade implied volatility.
underlyingPriceThe underlying price (ex: Deribit options are future options, the underlying is not spot but the corresponding future).
vegaThe greek vega value of the underlying option.
volume24hThis is the 24hr rolling volume.

Delta Surface Constant

FieldDescription
hifiTimestampThis is the data timestamp
daysToExpirationRemaining DTE (daysToExpiration).
currencyThe currency.
atmThe "at-the-money" implied volatility. This is weighted between the closest OTM put and closest OTM call. The weights are proportional to the distance of the strike prices vs underlying price.
delta50This is the IV for the selected delta point on the curve.
deltaCall05This is the IV for the selected delta point on the curve.
deltaCall10This is the IV for the selected delta point on the curve.
deltaCall15This is the IV for the selected delta point on the curve.
deltaCall20This is the IV for the selected delta point on the curve.
deltaCall25This is the IV for the selected delta point on the curve.
deltaCall30This is the IV for the selected delta point on the curve.
deltaCall35This is the IV for the selected delta point on the curve.
deltaCall40This is the IV for the selected delta point on the curve.
deltaCall45This is the IV for the selected delta point on the curve.
deltaPut05This is the IV for the selected delta point on the curve.
deltaPut10This is the IV for the selected delta point on the curve.
deltaPut15This is the IV for the selected delta point on the curve.
deltaPut20This is the IV for the selected delta point on the curve.
deltaPut25This is the IV for the selected delta point on the curve.
deltaPut30This is the IV for the selected delta point on the curve.
deltaPut35This is the IV for the selected delta point on the curve.
deltaPut40This is the IV for the selected delta point on the curve.
deltaPut45This is the IV for the selected delta point on the curve.
expirationTimestampThis is the option expiration date.
indexPriceThe index price (spot).
multiplierThe contract multiplier.
openInterestThe open interest at the time of this record.
underlyingPriceUnderlying futures price with the corresponding DTE.

Delta Surface Floating

FieldDescription
hifiTimestampThis is the data timestamp
expirationTimestampThis is the option expiration date.
currencyThe currency.
atmThe "at-the-money" implied volatility. This is weighted between the closest OTM put and closest OTM call. The weights are proportional to the distance of the strike prices vs underlying price.
daysToExpirationRemaining DTE (daysToExpiration).
delta50This is the IV for the selected delta point on the curve.
deltaCall05This is the IV for the selected delta point on the curve.
deltaCall10This is the IV for the selected delta point on the curve.
deltaCall15This is the IV for the selected delta point on the curve.
deltaCall20This is the IV for the selected delta point on the curve.
deltaCall25This is the IV for the selected delta point on the curve.
deltaCall30This is the IV for the selected delta point on the curve.
deltaCall35This is the IV for the selected delta point on the curve.
deltaCall40This is the IV for the selected delta point on the curve.
deltaCall45This is the IV for the selected delta point on the curve.
deltaPut05This is the IV for the selected delta point on the curve.
deltaPut10This is the IV for the selected delta point on the curve.
deltaPut15This is the IV for the selected delta point on the curve.
deltaPut20This is the IV for the selected delta point on the curve.
deltaPut25This is the IV for the selected delta point on the curve.
deltaPut30This is the IV for the selected delta point on the curve.
deltaPut35This is the IV for the selected delta point on the curve.
deltaPut40This is the IV for the selected delta point on the curve.
deltaPut45This is the IV for the selected delta point on the curve.
indexPriceThe index price (spot).
multiplierThe contract multiplier.
openInterestThe open interest at the time of this record.
underlyingPriceUnderlying futures price with the corresponding DTE.

Level 1 Quote

FieldDescription
askThe ask.
askIvThe ask implied volatility.
askVolumeThe ask size.
bidThe bid.
bidIvThe bid implied volatility.
bidVolumeThe bid size.
currencyThe currency.
deltaThe greek delta value of the underlying option.
exchangeTimestampThe date & time as provided by the exchange.
expirationTimestampThe expiration timestamp.
gammaThe greek gamma value of the underlying option.
hifiTimestampThe date & time of the aggregated record.
indexPriceThe index price (spot).
instrumentThe name of the instrument as provided by exchange.
instrumentNormalizedThe name of the instrument in Amberdata format.
isAtmThe "at-the-money" flag for the given expiration cycle. Each expiration has exactly one ATM put and ATM call.
isCarryForwardWhether this record was a carry forward from the previous data point (if there is not quote updates, the most recent quote is carried forward).
isExchangeProvidedGreeksWhether the Greeks were provided by the exchange or calculated by Amberdata.
markIvThe mark implied volatility.
markPriceThe mark price.
multiplierThe contract multiplier.
openInterestThe open interest at the time of this record.
putCallWhether this record is a put or a call.
rhoThe greek rho value of the underlying option.
strikeThe strike price.
thetaThe greek theta value of the underlying option.
underlyingPriceThe underlying price (ex: Deribit options are future options, the underlying is not spot but the corresponding future).
vegaThe greek vega value of the underlying option.
volumeThis is the 24hr rolling volume.

FAQs

Why is delivery via S3 important?

  • With data in S3, our customers can bulk download historical data in an analytics friendly format. This allows them to dig deep into the data and perform their own proprietary research and test trading strategies without being limited by our REST API throughput.

How does a customer get access to these datasets?

  • Customers will need to have their own AWS credentials in which we will provision for S3 access. If you are interested in downloading data via S3, please contact your Account Executive.

Why Parquet format instead of a GZIP compressed JSON file?

  • Parquet is a columnar storage format for structured data that is optimized for querying and analysis. In Parquet format, data is stored in columns rather than rows, allowing for more efficient compression and encoding of data. This can result in significant performance improvements for analytical workloads that involve large datasets and complex queries. Parquet is widely used in big data environments for data warehousing, analytics, and machine learning applications and can be easily integrated into existing data pipelines.

How do I download a parquet sample file and open it to see which fields are returned?

  • If you only want to see the fields, simply download the sample parquet file, load it as a pandas dataframe in Python and use dataframe.dtypes, that'll give you a quick output of the field types. Here is the code available for you to try out:
#Import the pandas library
import pandas as pd

# Replace 'your_parquet_file.parquet' with the path to your Parquet file
parquet_file = 'your_parquet_file.parquet'

# Load the Parquet file as a pandas DataFrame
df = pd.read_parquet(parquet_file)

# Display the data types of the DataFrame
print(df.dtypes)
  • Now if you wanted to actually read the parquet data, once you've downloaded the sample parquet file, you can run the following Python code:
#Import the pandas library
import pandas as pd   

# Replace 'your_parquet_file.parquet' with the path to your Parquet file
parquet_file = 'your_parquet_file.parquet' 

pd.read_parquet(parquet_file, engine='pyarrow')