fine-tuning — tisram

VentureBeat · 2026-10-15 2026-10-16-w1

NVIDIA's new, open Nemotron 3.5 Super VL with post-training beats Claude Opus 5, GPT-6.1 Sol on specialized task benchmarks

Super VL, a 120B open base, went from about 28% to about 72% on medical claims after post-training, against about 38% for Claude Opus 5. The base model sat below Opus 5, so the gain came from the customer's data and tuning budget, and the comparison is tuned against untuned. Its Artificial Analysis index of 26 trails GLM-5.3-Flash (42) and Qwen3.8-Flash-Next (40), which says the weights are not what wins. For builders the buying decision moves from which model to who owns the evaluation set and the post-training pipeline. In the week's argument this is the lightest of Nvidia's levers: it gives away the part that is commoditizing and keeps buyers building on its stack, with Bolt E4B due Oct 23 as the next test.

# tags

benchmark edge-ai enterprise-ai fine-tuning hugging-face huggingface inference-economics local-llm model-licensing nvidia open-models post-training vendor-claims venturebeat

VentureBeat 2026-10-15-3

NVIDIA's new, open Nemotron 3.5 Super VL with post-training beats Claude Opus 5, GPT-6.1 Sol on specialized task benchmarks

NVIDIA's Super VL, a 120B open base, went from about 28% to about 72% on medical claims after post-training, against about 38% for Claude Opus 5. The base model sat below Opus 5, so the gain came from the customer's data and tuning budget, and the comparison is tuned against untuned. Set beside Meta's Muse Spark Open, it suggests the weights are the commodity and the evaluation set and training pipeline are what a buyer should own.

# tags

nvidia open-models post-training fine-tuning enterprise-ai vendor-claims benchmark venturebeat model-licensing hugging-face huggingface edge-ai local-llm inference-economics

◆ entities

Teacher-student distillation Open Source Strategy Ecosystem lock-in through integration breadth Vertical Integration Enterprise AI adoption

→ threads

inference-economics

⟷ links

2026-03-17-3 2026-03-13-1 2026-03-15-1 2026-03-14-3 2026-03-10-1 2026-05-27-3 2026-04-17-w2 2026-03-17-2 2026-05-07-1 2026-03-14-1

permalink

OpenAI · 2026-05-01 2026-05-01-w1

Where the goblins came from

Reward signals shaped for a single personality bled into base behavior across 76.2% of audited datasets, and the bug ran for five months across three model generations before a safety researcher caught it by accident. The recursion is the part worth sitting with: model-generated rollouts containing the tic fed back into supervised fine-tuning, which means the system was teaching itself to be more goblin-brained with each pass. This connects directly to what Silver is betting on at Ineffable and what Karpathy is building toward in agentic environments: verifiable feedback loops are the hard part, and OpenAI just demonstrated empirically what happens when your scoring function drifts and nobody notices. The goblin bug isn't an anomaly; it's a preview of the failure mode for any system where behavioral regression testing isn't systematically applied across versions. Every custom GPT and fine-tune is a covert training run on the base model, and that just became a procurement question.

# tags

agentic-ai-viability ai-1.0-defensibility ai-safety alignment evalrig evaluation-infrastructure fine-tuning frontier-models gpt-5-4 gpt-5-5 interpretability openai reinforcement-learning reliability reward-hacking synthetic-media training-data

OpenAI 2026-05-01-2

Where the goblins came from

OpenAI's goblin postmortem buries the lede: reward signals applied to a single personality leaked into base behavior in 76.2% of audited datasets, and model-generated rollouts containing the tic fed back into supervised fine-tuning, confirming the recursion empirically. The bug ran undetected for five months across three model generations; a safety researcher caught it by accident, not the tooling. Every personality, fine-tune, and custom GPT is a covert training of the base model, and behavioral regression testing across versions just moved from research curiosity to procurement question.

# tags

alignment reward-hacking openai gpt-5-5 reinforcement-learning ai-safety ai-1.0-defensibility frontier-models evaluation-infrastructure evalrig agentic-ai-viability reliability gpt-5-4 interpretability training-data fine-tuning synthetic-media