Chinese AI Security Tool Provides Researchers with Guide on Making Biological Weapons Due to Jailbreak

According to Techub News, the prediction market platform Kalshi tweeted that reports indicate a certain Chinese security AI tool, due to a jailbreak vulnerability, provided researchers with a guide on how to manufacture biological weapons. This incident highlights the extreme risks that large language models can pose when security protections fail. As of now, no official agency or the company involved has confirmed or responded to the report.