Hy3 Preview

• 🆕 Tencent Hy Team's 295B Mixture-of-Experts model, 21B active per token.
• 📏 256K-token context window for long, complex inputs.
• 🧠 Built for reasoning, STEM and instruction following.
• 🔧 Adds a Multi-Token-Prediction layer for speculative decoding.
• 🎯 Targets coding, agents, function calling and context learning.
• ⚡ MoE routing keeps inference cost near a 21B-active model.
• 🌐 Open weights on Hugging Face under Tencent's Hy community license.
• 📚 Separate base checkpoint also published.

tencent

Tencent is a Chinese multinational technology conglomerate headquartered in Shenzhen, and one of the world's highest-grossing multimedia companies by revenue. Best known for its sprawling presence in social platforms, digital services, and as the largest…

Hy3 Preview is an open-weight large language model from Tencent's Hy team, released in 2026. Architecturally it is a Mixture-of-Experts model with 295B total parameters, activating only 21B per token, paired with a Multi-Token-Prediction layer that supports speculative decoding. Per the model card and an accompanying Hugging Face technical write-up, it uses a routed-expert design with a shared expert, grouped-query attention, and a 256K context window, distributed in int4 quantization.

According to Venice's catalog description, the model is aimed at complex reasoning, instruction following, in-context learning, coding and agent tasks. The Hugging Face write-up frames the architecture as a "rebuilt" Hunyuan with a new reasoning recipe, routing routine queries quickly while directing harder problems to deeper reasoning chains. Its listed capabilities include reasoning, code optimization, function calling and web search.

As the newest entry in Tencent's Hy family, the team presents Hy3 Preview as an upgrade over earlier Hunyuan releases, with the MoE design intended to deliver larger-model quality at a smaller active-parameter inference cost. Tencent also reports results on STEM and agent evaluations, but these are presented as self-reported figures rather than independently verified numbers.

The weights are published on Hugging Face, with a separate base checkpoint available for further fine-tuning, under Tencent's Hy community license. The release has drawn meaningful download and engagement activity on Hugging Face since launch.