Research
Free data stack for a cyclicals research site.
The blueprint behind the dashboards on this site. Seven verticals laid out top-down — rates / FX / credit, economic calendar / policy, semis, oil & energy, shipping & trade, macro demand, and valuation reference — built entirely on free, automatable public data. APIs, CSVs, Excel drops, stable HTML pages — no Bloomberg, no FactSet, no Daloopa, no paid shipping feeds. This page documents every source, the widget it feeds, the MVP API stack to start with, and the cycle-score formulas on top.
Rates, FX & credit
The cross-asset backdrop. Treasury yield curve, key FX pairs, credit spreads, and inflation-linked yields — the cost-of-capital and risk-appetite layer that prices every cyclical equity story underneath.
Live snapshot — Yahoo data via worker
| Source | Method | What to track | Site use |
|---|---|---|---|
| U.S. Treasury Daily Yield Curve | Public page / CSV | Daily 1M / 3M / 6M / 1Y / 2Y / 3Y / 5Y / 7Y / 10Y / 20Y / 30Y constant-maturity yields | → Yield curve tracker |
| FRED — Interest Rates | API · free key | DGS10, DGS2, DFF (Fed funds), T10Y2Y / T10Y3M (curve spreads), SOFR, IORB | → Yield curve tracker, Curve spread tracker |
| FRED — TIPS breakevens (T10YIE, T5YIFR) | API · free key | 10-yr breakeven inflation, 5y5y forward inflation, real yields | → TIPS / breakevens tracker |
| ICE BofA HY OAS & IG OAS via FRED | API · free key | BAMLH0A0HYM2 (HY OAS), BAMLC0A0CM (IG OAS) — the cleanest free read on credit conditions | → Credit spreads tracker |
| ECB Euro Reference Exchange Rates | CSV / API | Daily EUR cross-rates against ~30 currencies, full history | → FX tracker |
| Federal Reserve H.10 FX Rates | CSV / web | Daily / weekly / monthly USD vs. major and broad indexes; foreign-exchange rates by country | → FX tracker |
| BIS Effective Exchange Rates | CSV / API | Nominal and real effective exchange rates (NEER / REER) for ~60 economies | → FX tracker |
| NY Fed SOFR & reference rates | Public page / API | Daily SOFR, SOFR averages (30/90/180-day), Term SOFR context, OBFR, EFFR | → Yield curve tracker |
Economic calendar & policy reports
When data prints, what central banks said, and what the multilateral institutions are forecasting. The schedule layer that anchors every other vertical — FOMC, CME FedWatch, BLS releases, ECB, IMF, World Bank.
| Source | Method | What to track | Site use |
|---|---|---|---|
| FOMC Calendar & Statements | Public page / PDF | FOMC meeting dates, statements, minutes (3-week lag), SEP / dot plot, press conference transcripts | → FOMC tracker |
| CME FedWatch Tool | Public dashboard | Implied probability of FOMC moves at each upcoming meeting from Fed funds futures pricing | → FOMC tracker |
| BLS Release Schedule | Public calendar | Forward calendar of CPI, PPI, NFP, JOLTS, ECI, productivity, real earnings | → Data release calendar |
| ECB Monetary Policy Calendar | Public page | Governing Council meeting dates, statements, press conferences, SMA | → Global central bank calendar |
| Treasury Auction Schedule | Public page / API | Upcoming bill, note, bond, TIPS, FRN auction calendar with sizes; results post-auction | → Data release calendar |
| IMF World Economic Outlook (WEO) | PDF / database | Twice-yearly global GDP, inflation, current-account, fiscal forecasts; full WEO database export | → Multilateral outlook tracker |
| World Bank Global Economic Prospects | PDF / web | Twice-yearly global growth forecasts, EM/DM split, commodity outlook, downside-risk scenarios | → Multilateral outlook tracker |
| BEA Release Schedule | Public calendar | Forward calendar of GDP advance/second/third, PCE, personal income, trade balance | → Data release calendar |
Semiconductors
Global billings, memory pricing, equipment capex, fundamentals, and HBM commentary. The bedrock of the MU view and the cross-read into NVDA/AMD/AVGO.
| Source | Method | What to track | Site use |
|---|---|---|---|
| WSTS Historical Billings Report | Excel / PDF | Monthly semiconductor billings by region, 3-month moving averages | → Global semi sales tracker |
| SIA market data | Web / press | WSTS-based monthly sales, units, ASPs by product/region where available | → Global semi sales tracker |
| TrendForce DRAM spot prices | Public page | DRAM spot pricing direction | → Memory pricing tracker |
| SEMI equipment billings | Press releases | Semiconductor equipment billings, capex cycle | → Equipment / capex tracker |
| SEC EDGAR APIs | JSON · no key | 10-Q/10-K facts, filing history, XBRL facts, companyfacts bulk ZIP | → MU fundamentals tracker, HBM tracker, XOM driver bridge |
| SEC company tickers | JSON | Ticker to CIK mapping | Foundation — ticker→CIK resolution for every SEC EDGAR pull |
| TSMC Monthly Revenue | Public IR page | Monthly TSMC revenue (NTD), YoY and MoM — foundry leadership read on AI/HPC/smartphone demand | → Foundry leadership tracker |
| DigiTimes Asia (free section) | Public articles | Asia supply-chain reporting on foundry utilization, memory, AI accelerators, equipment | Context layer — supply-chain narrative, no dedicated widget |
| Counterpoint Research insights | Public press | Free smartphone / handset / memory / foundry market share press releases | Context layer — share / unit-volume cross-checks |
Oil & energy
Prices, U.S. inventory data, refining throughput, global supply/demand, and speculative positioning. The energy cycle dashboard is the cleanest to fully automate.
| Source | Method | What to track | Site use |
|---|---|---|---|
| EIA API | API · free key | WTI/Brent, crude inventories, gasoline/distillate stocks, refinery utilization, product supplied, imports/exports | → Oil dashboard, Inventory surprise dashboard, Refining margin proxy, XOM driver bridge |
| EIA Weekly Petroleum Status Report | Web / API | Weekly U.S. crude, gasoline, distillate, refinery, demand data | → Inventory surprise dashboard |
| FRED — WTI / Brent series | API · free key | WTI, Brent, macro/industrial series | → Oil dashboard, Refining margin proxy |
| CFTC Commitments of Traders | API / CSV | Managed-money crude positioning, net longs/shorts | → Positioning dashboard |
| JODI Oil Database | CSV downloads | Country-level oil production, demand, stocks | Context layer — global supply/demand cross-check, no dedicated widget |
| OPEC MOMR | PDF / manual | OPEC supply, demand forecasts, inventory commentary | Context layer — monthly narrative input, no dedicated widget |
| Baker Hughes Rig Count | Public weekly page | U.S. and international weekly rig count by basin and oil/gas split — the cleanest free supply-side leading indicator | → Rig count tracker, XOM driver bridge |
| EIA Short-Term Energy Outlook (STEO) | Excel / PDF / web | Monthly EIA forecasts: U.S. and global oil supply, demand, prices, inventories, refining margins | → STEO forecast tracker |
| IEA Oil Market Report | PDF / web | Monthly global oil balances, OECD inventories, demand forecasts (executive summary public) | Context layer — cross-check vs. EIA STEO and OPEC MOMR |
Shipping & trade
Container freight indices, U.S. port throughput, and HS-code-level trade flows. Where supply-chain stress shows up before headline macro.
| Source | Method | What to track | Site use |
|---|---|---|---|
| Freightos Baltic Index (FBX) | Public / limited free | 40-foot container rates by major lane | → Container freight tracker, Supply-chain stress dashboard |
| Drewry World Container Index | Public weekly page | Weekly container freight benchmark | → Container freight tracker, Supply-chain stress dashboard |
| Shanghai Containerized Freight Index (SCFI) | Public page | China / export container freight | → Container freight tracker |
| BTS Monthly TEU Data | Socrata API | U.S. port TEU volumes | → Port throughput tracker, Supply-chain stress dashboard |
| Census International Trade API | API | Imports / exports by HS code, port, country, end-use | → Trade flow tracker |
| UN Comtrade | API · free tier | Global trade flows by commodity / country | → Trade flow tracker |
| Cass Freight Index | Monthly press / PDF | U.S. domestic freight shipments and expenditures (truck, rail, intermodal) | → Domestic freight tracker, Supply-chain stress dashboard |
| Port of LA Signal | Public dashboard | Real-time and forward-look TEU forecasts at the largest U.S. container port | → Port throughput tracker |
| ATA Truck Tonnage Index | Monthly press release | U.S. for-hire truck tonnage, SA / NSA, MoM and YoY | → Domestic freight tracker |
Macro & demand
The backdrop layer: supply-chain pressure, industrial production, and PMI breadth that sit underneath every other vertical.
| Source | Method | What to track | Site use |
|---|---|---|---|
| NY Fed Global Supply Chain Pressure Index | Public data / page | Global supply-chain stress | → Supply-chain pressure tracker, Supply-chain stress dashboard |
| FRED — semiconductor industrial production | API · free key | U.S. semiconductor / electronic-component production | → Industrial production overlay |
| ISM PMI reports | Public release | Manufacturing PMI, new orders, inventories, supplier deliveries | → PMI breadth dashboard |
| BLS API | API · free key | CPI, PPI, nonfarm payrolls, unemployment, JOLTS, average hourly earnings, employment cost index | → Inflation tracker, Labor market tracker |
| BEA API | API · free key | GDP, PCE, PCE inflation, personal income, corporate profits, trade balance | → Inflation tracker, Consumer demand tracker |
| Federal Reserve Beige Book | Public PDF / web | Eight-times-yearly anecdotal read of economic activity across 12 Fed districts | → Beige Book sentiment tracker |
| University of Michigan Consumer Sentiment | Monthly release | Consumer sentiment index, expectations, current conditions, 1-yr / 5-yr inflation expectations | → Consumer demand tracker |
| Atlanta Fed GDPNow | Public dashboard / CSV | Real-time GDP nowcast, sub-component contributions, model history | → GDP nowcast tracker |
| Census Retail Sales / Durable Goods | API · free | Monthly retail trade, advance retail sales, durable goods orders, factory orders | → Consumer demand tracker |
Valuation reference (Damodaran)
Aswath Damodaran — NYU Stern, the “Dean of Valuation” — updates the most-used free valuation datasets on the internet. Cost of capital by industry, country risk premiums, betas, multiples, margins. Free Excel downloads, refreshed annually (some quarterly). The reference layer behind every DCF on this site.
| Source | Method | What to track | Site use |
|---|---|---|---|
| Damodaran Online (data archive) | Public page | Top-level navigation to every dataset, paper, spreadsheet, and lecture — the entry point | → Cost-of-capital reference |
| Cost of Capital by Industry | Excel | WACC, cost of equity, cost of debt, capital structure for ~95 industries (US, Global, Europe, Japan, EM, India, China) | → Cost-of-capital reference, used in DCF tool |
| Country Risk Premiums & ERP | Excel / web | Implied ERP (US monthly), country risk premiums (~180 countries), sovereign default spreads | → Cost-of-capital reference |
| Industry Betas & Unlevered Betas | Excel | Levered / unlevered betas, debt-to-equity, cash-adjusted betas by industry — for cross-checking comps | → Cost-of-capital reference, used in WACC tool |
| Industry Multiples (P/E, EV/EBITDA, EV/Sales) | Excel | Trailing and forward multiples by industry, price-to-book, EV/Invested Capital, EV/Sales by sector | → Industry multiples reference, used in comps tool |
| Industry Margins & Operating Stats | Excel | Gross / operating / net margins, ROIC, ROE, capex/sales, sales/capital by industry | → Industry multiples reference |
| Musings on Markets (blog) | Blog / public | Damodaran's running commentary on valuation, ERP, sector views, individual-name DCFs — canonical reading | Context layer — methodology cross-check |
Widget blueprint
If the source tables above are the inputs, this is the outputs — the specific dashboards, trackers, and metrics each vertical's data becomes once it's wired up. The “Site use” column in each table links straight to the matching widget below.
Rates, FX & credit
Economic calendar & policy
Semiconductors
Oil & energy
Shipping & trade
Macro & demand
Valuation reference (Damodaran)
MVP source stack
Start here. Cleanest to automate, widest coverage, no key-management headaches. Everything else is a nice-to-have layered on top.
One-stop public research terminal
Ten sources to ship the v1.
This is the smallest set that produces a credible cycle dashboard for semis, energy, shipping, and the macro / policy layer in a weekend — no Bloomberg, no FactSet, no Daloopa, no paid shipping feeds.
- EIA API — oil prices, inventories, refinery utilization, product demand.
- FRED API — WTI / Brent, macro indicators, industrial production, easy chartable history.
- SEC EDGAR API — MU / XOM financials, filings, filing alerts.
- WSTS Historical Billings Report — monthly semi cycle data.
- Census Trade API — import/export flows by HS code.
- BTS Socrata API — port TEU data.
- CFTC COT — crude positioning.
- TrendForce DRAM page — memory price direction.
- BLS API — CPI, PPI, NFP, JOLTS — the inflation and labor backdrop everything cyclical sits on.
- FOMC calendar + CME FedWatch — meeting dates, statements, and the futures-implied path the market is pricing.
Cycle scores
One composite read per sector, refreshed from the sources above. Where the rest of the page supplies inputs, this is the synthesis — one number that tells you where each cycle is.
MU / Memory Cycle Score
- DRAM price trend
- WSTS memory / semi sales
- MU gross margin
- MU inventory days
- SEMI equipment billings
- HBM commentary tagging
XOM / Energy Cycle Score
- WTI / Brent trend
- EIA inventories
- Product supplied
- Refinery utilization
- Rig count
- CFTC positioning
Shipping Stress Score
- Freightos / Drewry / SCFI
- BTS TEUs
- Census import volumes
- NY Fed GSCPI
- Cass / ATA truck tonnage
Macro Cycle Score
- Core CPI / PCE trend
- NFP + JOLTS
- ISM PMI breadth
- Atlanta Fed GDPNow
- FedWatch implied path
- Michigan inflation expectations
All sources above are public and free at the tier described. Some — Freightos, Drewry, OPEC MOMR — gate the deepest-history series behind paid plans; the public surface still gives a usable signal. Nothing on this page is investment advice. See disclaimer.