Alternative Data Explained
Alternative data is non traditional information like card spending, web traffic and satellite images. Learn the main types, how funds use it and the risks.
Alternative data is information about companies, industries or economies that comes from outside traditional sources such as financial statements, market prices and official statistics. Examples include aggregated credit card transactions, website traffic, app downloads, satellite images of parking lots, shipping records and job postings. Hedge funds and quantitative firms use alternative data to estimate results before companies report them or to track economic trends in real time. The industry has grown rapidly, but so have the costs, legal questions and competition.
Main categories#
| Category | Examples | Lesson |
|---|---|---|
| Transaction data | Aggregated card spending, receipts, invoices | Credit Card and Consumer Spending Data |
| Web and app data | Website visits, search trends, app downloads and usage | Web Traffic, App Downloads and Search Trends |
| Geospatial data | Satellite images, foot traffic from phone location data | Satellite, Foot Traffic and Geolocation Data |
| Supply chain and trade | Shipping manifests, vessel tracking, customs records | Shipping and Supply Chain Data |
| Labour data | Job postings, employee reviews, hiring trends | Job Postings Data |
| Text and sentiment | News, social media, earnings call transcripts | Social and News Sentiment |
| Weather and environment | Forecasts, crop conditions, emissions | Weather and Agricultural Data |
Why investors use it#
- Earlier information: estimate a retailer's quarterly sales weeks before it reports.
- Higher frequency: daily or weekly data instead of quarterly reports.
- Independent verification: check management claims against outside evidence.
- Macro nowcasting: track the economy faster than official statistics. See GDP.
The alternative data workflow#
- Source and evaluate datasets: coverage, history, frequency, cost.
- Legal and compliance review: privacy, licensing and material non public information.
- Clean and map: link data to companies and tickers, handle gaps and bias. See Cleaning Market Data.
- Test predictive power: does the data predict reported results or returns, out of sample? See Signal Discovery and In-Sample vs Out-of-Sample Testing.
- Integrate into models or research processes.
- Monitor decay as more firms buy the same data. See Signal and Alpha Decay.
Costs#
Datasets can cost from a few thousand to over a million dollars a year. Add the costs of data engineers, storage and analysts. Large funds can afford many datasets; smaller traders typically use cheaper or free sources such as search trends, public filings and app rankings.
Legal and ethical issues#
| Issue | Concern |
|---|---|
| Personal data and privacy | Data must be anonymised and comply with laws such as the EU's GDPR and US state privacy laws |
| Web scraping | Terms of service, copyright and computer access laws |
| Material non public information | Data obtained in breach of a duty of confidentiality can create insider trading risk. See Insider Trading |
| Consent | Whether individuals knowingly agreed to data use |
Regulators, including the SEC, have scrutinised how funds obtain and use alternative data.
Limits and risks#
- Bias: panels may not represent the whole population.
- Short histories: many datasets cover only a few years, limiting testing.
- Overfitting: testing many datasets increases false discoveries. See P-Hacking and Multiple Testing.
- Crowding: once many funds use a dataset, its edge shrinks.
- Changes in the data source: a vendor's methodology or panel can shift suddenly.
Frequently asked questions#
What is alternative data?#
Information from non traditional sources, such as card transactions, web traffic, satellite images or job postings, used to gain insight into companies and economies.
How do hedge funds use alternative data?#
To estimate company results before they are reported, track trends in real time and verify management claims.
Is alternative data legal?#
Generally yes, if it is properly sourced, anonymised and does not involve material non public information obtained in breach of a duty.
Next, look at spending data in Credit Card and Consumer Spending Data.
3 quick questions on this lesson. Get them all right to finish it.
Turn on JavaScript to take the quiz.
Mentioned in
- Sentiment DataData and Alternative Data
- Shipping and Supply Chain DataData and Alternative Data
- Job Postings DataData and Alternative Data
- On-Chain AnalyticsCrypto
- Retail SalesEconomics and Macro
- Historical Data for BacktestingResearch and Backtesting