Methodology

One row per item in one day's intel run; the latest completed day by default, or add ?day=YYYY-MM-DD for a specific day. The leading columns mirror the external-scan contract key for key so the same firewall intake ingests both files: topic_slug carries the item's primary company_slug, tags carries its dimension tags, relevance carries its significance score, topic_code is always null (no company-level taxonomy code exists). full_text is a composed document: headline, summary, extracted facts, then the raw article text, capped at 24,000 characters. Add ?company=<slug> to narrow to one registry company (matches any linked company, not only the primary one). This is a working corpus, not a redistribution channel. Downloading requires an access key.

Schema

Column	Type	Definition
item_id	text	Stable UUID of the collected item.
run_day	date	The collection day (YYYY-MM-DD, UTC).
url	text	The item URL as discovered.
normalized_url	text	Canonical dedupe form: host plus path plus sorted query, tracking params stripped.
headline	text	Headline or title as discovered.
source_domain	text	Hostname of the URL, www stripped.
published_on	date	Publication date when known (YYYY-MM-DD).
discovered_via	text	How the item was found: feed, search, edgar, or manual.
topic_slug	text	The item's primary company slug; joins intel-companies. Named topic_slug to mirror external-scan.
topic_code	text	Always null: intel has no company-level taxonomy code. Present to mirror external-scan.
summary	longtext	Two to three model-written sentences; empty when enrichment was skipped.
tags	text	Dimension taxonomy codes the enrichment assigned, joined with a semicolon.
entities	text	Companies, agencies, and people named, joined with a semicolon.
relevance	number	The item's advisory 0 to 1 significance score from enrichment.
enrich_status	enum	done, skipped, error, or pending.
fetch_status	enum	done, failed, skipped, or pending.
fetched_via	enum	direct or jina.
text_chars	number	Character count of the composed full_text.
full_text	longtext	A composed document: headline, summary, extracted facts, then the raw article text, capped at 24,000 characters.
enriched_by	text	Model that produced the enrichment (summary, tags, relevance); null before model tracking or when skipped.
doc_type	enum	news, press, filing, transcript, or report.
company_slugs	text	Every registry company the enrichment linked this item to, joined with a semicolon.
tier	enum	Registry tier of the primary company: self, card_issuer, consumer_bank, fintech, tech_platform, or wildcard. Null when the item has no primary company.
source_tier	number	Source reliability tier, 1 (most reliable: regulators, primary company sources, wire services, research houses) to 4 (least: social platforms, stock tip and promotional sites). Deterministic for a known domain from a curated map and suffix rules; a domain neither covers is rated once by the utility model and cached. Null when the domain has not been rated yet.
source_kind	enum	The kind of source behind the domain: regulator, primary, research, wire, major, trade, tech_press, general, aggregator, pr_wire, blog, social, promo, or unknown. Rated on the same path as source_tier. Null when not yet rated.
content_kind	enum	The kind of content in the piece, assigned during enrichment: news, analysis, data, press_release, marketing, opinion, or other. Discounts promotional or opinion text found inside an otherwise reliable source. Null when enrichment has not classified it.
priority	number	Composed ranking score for the importer: relevance times the source tier weight (tier 1 is 1.0, tier 2 is 0.85, tier 3 is 0.6, tier 4 is 0.25) times the content kind weight (news, analysis, and data are 1.0, opinion and other are 0.85, press_release is 0.7, marketing is 0.4), rounded to two decimals. An unrated source counts as tier 3 and an unclassified piece counts as other. Null only when relevance is null.

Intel Desk: items, daily

Request access Unlock with an access key

/api/datasets/intel-items · 27 columns · access key required

One day of the Intel Desk collection engine: documents discovered about tracked companies from public press feeds, web search, and SEC filings, with full text, extracted facts, and a model summary.

Methodology

Schema

Column	Type	Definition
item_id	text	Stable UUID of the collected item.
run_day	date	The collection day (YYYY-MM-DD, UTC).
url	text	The item URL as discovered.
normalized_url	text	Canonical dedupe form: host plus path plus sorted query, tracking params stripped.
headline	text	Headline or title as discovered.
source_domain	text	Hostname of the URL, www stripped.
published_on	date	Publication date when known (YYYY-MM-DD).
discovered_via	text	How the item was found: feed, search, edgar, or manual.
topic_slug	text	The item's primary company slug; joins intel-companies. Named topic_slug to mirror external-scan.
topic_code	text	Always null: intel has no company-level taxonomy code. Present to mirror external-scan.
summary	longtext	Two to three model-written sentences; empty when enrichment was skipped.
tags	text	Dimension taxonomy codes the enrichment assigned, joined with a semicolon.
entities	text	Companies, agencies, and people named, joined with a semicolon.
relevance	number	The item's advisory 0 to 1 significance score from enrichment.
enrich_status	enum	done, skipped, error, or pending.
fetch_status	enum	done, failed, skipped, or pending.
fetched_via	enum	direct or jina.
text_chars	number	Character count of the composed full_text.
full_text	longtext	A composed document: headline, summary, extracted facts, then the raw article text, capped at 24,000 characters.
enriched_by	text	Model that produced the enrichment (summary, tags, relevance); null before model tracking or when skipped.
doc_type	enum	news, press, filing, transcript, or report.
company_slugs	text	Every registry company the enrichment linked this item to, joined with a semicolon.
tier	enum	Registry tier of the primary company: self, card_issuer, consumer_bank, fintech, tech_platform, or wildcard. Null when the item has no primary company.
source_tier	number	Source reliability tier, 1 (most reliable: regulators, primary company sources, wire services, research houses) to 4 (least: social platforms, stock tip and promotional sites). Deterministic for a known domain from a curated map and suffix rules; a domain neither covers is rated once by the utility model and cached. Null when the domain has not been rated yet.
source_kind	enum	The kind of source behind the domain: regulator, primary, research, wire, major, trade, tech_press, general, aggregator, pr_wire, blog, social, promo, or unknown. Rated on the same path as source_tier. Null when not yet rated.
content_kind	enum	The kind of content in the piece, assigned during enrichment: news, analysis, data, press_release, marketing, opinion, or other. Discounts promotional or opinion text found inside an otherwise reliable source. Null when enrichment has not classified it.
priority	number	Composed ranking score for the importer: relevance times the source tier weight (tier 1 is 1.0, tier 2 is 0.85, tier 3 is 0.6, tier 4 is 0.25) times the content kind weight (news, analysis, and data are 1.0, opinion and other are 0.85, press_release is 0.7, marketing is 0.4), rounded to two decimals. An unrated source counts as tier 3 and an unclassified piece counts as other. Null only when relevance is null.