Free Instant SEO Audit

A research team at Thinking Machines trained language models on expert human annotations to handle the small, repeated judgments investors make throughout the day.

The real work is triage, not reading

The team narrowed the question to one specific task: information triage, deciding what is relevant and worth further attention. Automating this step could free up time for higher-level synthesis and decision making.

Is it possible to teach language models financial judgment?

The team asked a sharper question: is it possible to teach language models financial judgment? The team’s claim that their model outperformed frontier models is unverified, as they did not name the models tested or provide accuracy figures or cost comparisons.

How was the model evaluated?

The evaluation covered six information filtering tasks drawn from investors’ daily workflows, according to Project Greenhouse: Progress Toward Fully Open and Sovereign Agentic Search, as of Oct 8, 2026. The team notes that they have many additional internal tasks that show similar patterns to the six described. Accuracy, the percentage of documents correctly labeled according to their investors, was the primary metric.

Task 01: Financial Article Relevancy

Given a financial article, classify whether it is relevant to a C-suite investment professional.

  • Evaluation metrics: F1 score, Accuracy

From a subset to a broader vision

Based on those results, the team sketches the early shape of a larger idea: differentiated intelligence, in which models are tuned to the specific needs of a given organization rather than treated as one-size-fits-all tools. The financial-document work is a concrete proof point for that broader direction.

When expert judgment is hard to document, annotation with targeted training can convert it into a pattern a model can reproduce.


Share This Post

Do you want help with your SEO or website development? Then Contact Us Here.

NewSunSEO

Grow in Google and AI Search

★★★★★★★★★★5.0 from 17 Google reviews

AI-SEO, local search, paid ads and websites from one team, with offices on Long Island and in Myrtle Beach.

  • AI-SEO
  • Local AI-SEO
  • AI Consulting
  • PPC
  • Web Design
  • Web Development

Request a Free Proposal

Tell us about your business and where you want to grow.

We will reply by email to talk through your goals and what a proposal would include.

    We use your details only to reply to you and send what you asked for. See our Privacy Policy.

    BizScoreAI award: #1 Internet Marketing Service - Myrtle BeachBizScoreAI award: Top Rated Local SEO - Myrtle Beach