StockSense
A multimodal framework that reads a financial news headline, looks at the stock's 30-day candlestick chart, and checks 18 technical indicators before committing to a direction. When the three signals disagree, it stays out of the market.
I built the dataset from scratch: 15,578 news articles matched to 6,542 generated chart images and daily prices across 57 tickers, producing 28,598 labelled pairs over a year of trading. It runs today as a Streamlit agent that explains every call.
- Problem
- Text sentiment alone predicts direction barely better than chance — 44.9%.
- Approach
- Late fusion of text, chart vision, and technical features into one classifier, with a confidence threshold that can decline to trade.
- Result
- 86.87% under random split; under a leak-free temporal split, selective prediction lifts accuracy to 50.00% at 0.667 specificity.
- Honest bit
- Q1 2026 concept drift is reported in full rather than tuned away.