# Social and News Sentiment

> Text analysis turns news and social media into sentiment signals. Learn how sentiment is measured, from word lists to language models, the evidence and the pitfalls.

Source: https://learn.tradelabsai.com/alternative-data/social-and-news-sentiment/  
Track: Data and Alternative Data · Level: Advanced · Updated: 2026-10-03  
Publisher: TradeLabs AI (https://tradelabsai.com). Education, not financial advice.  
Cite as: TradeLabs Learn, "Social and News Sentiment", https://learn.tradelabsai.com/alternative-data/social-and-news-sentiment/

Every day, millions of news articles, social media posts and forum comments discuss companies and markets. Sentiment analysis uses computers to read this text and measure whether it is positive, negative or neutral. Traders use sentiment signals to anticipate price moves, detect shifts in attention and spot crowded trades. The tools range from simple word counts to large language models, and the evidence suggests sentiment can add information, though signals are noisy and decay quickly.

## Sources of text

| Source | Characteristics |
|---|---|
| Professional news | Edited, timely, widely read. See [News Feeds](https://learn.tradelabsai.com/alternative-data/news-feeds/) |
| Social media (X, Reddit, StockTwits) | Very fast, noisy, retail heavy |
| Earnings call transcripts | Management tone and analyst questions. See [Earnings Calls](https://learn.tradelabsai.com/fundamentals/earnings-calls/) |
| Regulatory filings | Formal language; changes between filings matter |
| Analyst reports | Professional opinions |
| Forums and chat groups | Retail enthusiasm and coordination |

## How sentiment is measured

| Method | How it works | Strengths and weaknesses |
|---|---|---|
| Dictionary (word lists) | Count positive and negative words | Simple, transparent; misses context |
| Finance specific dictionaries | Word lists built for financial text | More accurate in finance |
| Machine learning classifiers | Train models on labelled text | Better context; needs training data |
| Language models | Large models score sentiment or extract meaning | Powerful; costly and can be inconsistent |

Researchers Tim Loughran and Bill McDonald showed in 2011 that general purpose word lists misclassify many financial terms: words like "liability", "tax" or "crude" are negative in everyday dictionaries but neutral in finance. Their finance specific word lists became a standard tool. See [Machine Learning in Trading](https://learn.tradelabsai.com/machine-learning/machine-learning-in-trading/).

## The evidence

- **Paul Tetlock (2007)** found that high pessimism in a Wall Street Journal column predicted downward pressure on stock prices, followed by a reversal.
- **Studies of firm specific news** found that negative words in news stories predicted lower earnings and returns.
- **Social media studies** have found some predictive power for short term returns and volume, but results vary and often weaken after publication.

**Example: Meme stock sentiment**
In January 2021, discussion of GameStop on Reddit's WallStreetBets forum surged, along with heavy buying of shares and call options by retail traders. Mentions and positive sentiment rose sharply as the stock climbed from under $20 to an intraday high near $483 within weeks, forcing short sellers to cover. Social data captured the attention surge in real time, but the stock later fell more than 80% from its peak. Sentiment measured attention and momentum, not value. See [Market Manipulation](https://learn.tradelabsai.com/industry/market-manipulation/).

## Building a sentiment signal

1. **Collect text** with accurate timestamps.
2. **Link text to companies** (entity recognition).
3. **Score sentiment** with an appropriate method.
4. **Aggregate** by company and time, weighting by relevance and source.
5. **Measure change** relative to normal levels.
6. **Test predictive power** out of sample, including costs. See [In-Sample vs Out-of-Sample Testing](https://learn.tradelabsai.com/research/out-of-sample-testing/).

## Pitfalls

| Pitfall | Explanation |
|---|---|
| Sarcasm and slang | Social posts often mean the opposite of their words |
| Bots and spam | Fake accounts can manipulate sentiment |
| Pump and dump schemes | Coordinated promotion of small stocks. See [Market Manipulation](https://learn.tradelabsai.com/industry/market-manipulation/) |
| Look ahead bias | Using text not available at the time. See [Look-Ahead Bias](https://learn.tradelabsai.com/research/look-ahead-bias/) |
| Fast decay | Sentiment signals often matter for hours or days |
| Crowding | Popular sentiment signals are widely traded |

## Frequently asked questions

### What is sentiment analysis in trading?

Using computer methods to score news, social media and other text as positive, negative or neutral, and using those scores as trading signals.

### Does social media sentiment predict stock prices?

Studies have found some short term predictive power, but signals are noisy, can be manipulated and often fade quickly.

### What is the Loughran McDonald dictionary?

A finance specific list of positive and negative words developed by researchers Tim Loughran and Bill McDonald, widely used to measure sentiment in financial text.

Next, learn how weather drives markets in [Weather and Agricultural Data](https://learn.tradelabsai.com/alternative-data/weather-and-agricultural-data/).

## Continue learning

- Next lesson: [Weather and Agricultural Data](https://learn.tradelabsai.com/alternative-data/weather-and-agricultural-data/)
- Previous lesson: [Job Postings Data](https://learn.tradelabsai.com/alternative-data/job-postings-data/)
- Related: [Job Postings Data](https://learn.tradelabsai.com/alternative-data/job-postings-data/): Job postings and employee data reveal company plans and labour market trends. Learn the main sources, how investors read hiring signals and the data's limits.
- Related: [Sentiment Data](https://learn.tradelabsai.com/alternative-data/sentiment-data/): Sentiment data measures how optimistic or fearful investors are. Learn survey, positioning, options and crypto sentiment indicators and how to use them.
- Related: [News Feeds](https://learn.tradelabsai.com/alternative-data/news-feeds/): News feeds deliver headlines and stories to traders, often in machine readable form. Learn the main sources, latency, how algorithms parse news and the risks.
- Related: [Machine Learning in Trading](https://learn.tradelabsai.com/machine-learning/machine-learning-in-trading/): An honest guide to machine learning in trading: where it helps, why it often fails on market data, the main model types and a sound workflow for using it safely.
- Related: [Market Manipulation](https://learn.tradelabsai.com/industry/market-manipulation/): Market manipulation means artificially moving prices or volume to mislead others. Learn the main types, from pump and dumps to spoofing, and real cases.
- Related: [Earnings Calls](https://learn.tradelabsai.com/fundamentals/earnings-calls/): Earnings calls are where management discusses results and answers analysts. Learn the structure, the signals in tone and Q&A, and how to use transcripts.