Meta Force Space
BTC $60,721.00 +1.58% ETH $1,705.49 +1.44% SOL $70.01 +0.44% XRP $0.9225 +0.64% BNB $554.32 +2.44% DOGE $0.0550 +0.64%
← Back to the news

Hackers replaced a DeepSeek model for 53 hours and stripped away its safety protections

Quick Take

  1. Prime Intellect says a modified DeepSeek V4.1 Flash model served customer requests on one deployment for 53 hours.
  2. The host reported unchanged results on two capability tests as HarmBench refusals fell from 198 of 240 prompts to zero.
  3. Prime Intellect advised customers who relied on the model to refuse certain requests to review outputs from the incident window.

Prime Intellect disclosed an unauthorized DeepSeek model swap on Nov. 19. The host said a modified copy of DeepSeek V4.1 Flash served customer requests on one deployment for 53 hours. The substitute matched the original on two capability tests, the host said. On a safety test called HarmBench, refusals fell from 198 of 240 prompts to zero.

Prime Intellect said the affected deployment ran the substitute from 01:24 UTC on Nov. 8 until 06:35 UTC on Nov. 10, a window of 53 hours and 11 minutes. The company did not say how many requests went to that deployment during the swap.

The replacement used publicly available weights that Prime Intellect said had been modified to reduce refusals. Weights are the numerical settings that shape what a model generates. The swap took place behind the DeepSeek V4.1 Flash endpoint. Prime Intellect said the deployment kept its chat template and serving settings, along with the tokenizer that breaks text into pieces the model processes.

What tests found after the DeepSeek model swap

Prime Intellect reported unchanged results on GPQA Diamond and τ-bench when it tested the modified weights. GPQA Diamond tests advanced science questions, while τ-bench tests whether agents can use tools and follow rules in simulated customer interactions.

The safety tests exposed a difference. HarmBench was developed to evaluate how models respond to attempts to elicit harmful outputs. Prime Intellect also recorded a drop from 98 refusals out of 100 prompts to one on JailbreakBench, and from 304 out of 313 to two on StrongREJECT. The counts are from the company’s benchmark tests. The advisory gives no refusal count for customer requests.

Two capability tests held steady. Refusals fell.

Prime Intellect compared the original DeepSeek V4.1 Flash with the copy that served requests on one deployment for 53 hours.

A comparison limited to the two capability tests would have missed the fall in refusals.

The safety benchmarks use different prompt totals. Counts represent benchmark tests. The advisory does not provide individual capability scores or customer outcome counts.

Sources and evidence

Sources

  1. Prime Intellect security advisory

Supporting facts

  • Prime Intellect said a modified copy of DeepSeek V4.1 Flash answered requests routed to the affected deployment from Nov. 8 at 01:24 UTC to Nov. 10 at 06:35 UTC, a window of 53 hours and 11 minutes. [1]
  • Prime Intellect said the capability benchmarks GPQA Diamond and τ-bench were unaffected in its tests of the modified model weights. [1]
  • Prime Intellect reported that HarmBench refusals fell from 198 of 240 test prompts with the original model to zero with the substitute. [1]
  • Prime Intellect reported that refusals fell from 98 of 100 test prompts to one on JailbreakBench, and from 304 of 313 to two on StrongREJECT. [1]

Method

Bars show reported refusals on a common count scale. Prime Intellect reported baseline totals of 240 HarmBench prompts, 100 JailbreakBench prompts and 313 StrongREJECT prompts. It described both capability results as unchanged.

Scope

The safety benchmarks use different prompt totals. Counts represent benchmark tests. The advisory does not provide individual capability scores or customer outcome counts.

Infographic by CryptoSlate

Prime Intellect said it contacted all affected customers and advised those who relied on the model to refuse certain requests to review the outputs they received during the affected window. An answer from the substitute could have passed into an application that was counting on a refusal.

The company said it examined the disks and memory of the machines involved, checked recovered versions of the intruder’s proxy and reviewed records of their activity. It reported finding no evidence that customer prompts or responses were recorded or left the serving cluster. Prime Intellect also said no other models on its platform were modified and no keys or customer credentials were affected. Its investigation remains open.

Editorial credits

Liam 'Akiba' Wright
Liam 'Akiba' Wright
Editor-in-Chief CryptoSlate

Also known as "Akiba," Liam Wright is a reporter, podcast producer, and Editor-in-Chief at CryptoSlate. He believes that decentralized technology has the potential to make…

Originally published by CryptoSlate on

Read the original on CryptoSlate ↗

Text and images are the property of CryptoSlate and are reproduced here with attribution and a link to the original publication.

More stories

All the latest news