r/LocalLLaMA • u/Aggressive-Sign-8167 • 2d ago
Question | Help Tencent Hy Team & Shunyu Yao Here! Ask Us Anything about Hy4 & Hy4 flash!

Fresh off launching Hy4 and Hy4 Flash, the Hy research team is here to discuss how they built the models, boosted efficiency, and made them better for everyday workflows.
Our participants today:
Blog: https://hy.tencent.ai/research/hy4-flash https://hy.tencent.ai/research/hy4
HF: https://huggingface.co/tencent/Hy4-flash https://huggingface.co/tencent/Hy4
345
Upvotes
113
u/jucabala457 2d ago
Any chance for a Hy4-mini to replace qwen3.6-35ba3b?
97
u/TastesLikeOwlbear 2d ago
I don’t have a question, really, I just wanted to say that as of five minutes ago, Hy4-flash saturated our internal benchmark for agentic coding and PR review, the first model to pass all tests and finishing more quickly than Qwen 3.8 Flash Next, GLM 5.3 Flash, and Deepseek V4.1 Flash. Wow!
55
u/crusaderky 2d ago edited 2d ago
Not counting ngrams, Hy4-flash is 156B-A12B (7.7% activations). Qwen3.8-Flash is 125B-A6B (4.8% activations); DSv4.1 is 552B-A16B (2.9% activations), which drops to A8B (1.45%) during prefill.
How important for intelligence is the extra density? Did you test how much quality drop you would get at e.g. 156B-A8B or 156B-A5B?
52
u/Bitter-College8786 2d ago
Do you think, these models have reached their capacity, how much intelligence they can "soak"?
Wanted to know if more intelligent future Hy models need to have more parameters or will you be able to offer a stronger models with the same size, like a post-trained Hy4
49
u/walden42 2d ago
I just want to say thanks for sharing your open weight models. We as a community do our best to look past the propaganda of both Chinese and US government and their media. The average person here just appreciates that AI models can be run in a private setting. Simple as.
26
u/BalorNG 2d ago
Any chance for a looped MoE model?
23
u/inzee 2d ago
Any chance for a 24-31B dense model?
22
u/Obvious-Ad-2454 2d ago
What is your teams approach with using LLMs for your own work ?
Do you use opensource models, your own internal ones, closed source ?
21
u/Laoweek 2d ago
Not a question just an encouragement. Please keep doing the work so we don’t need to deal with the godforsaken company that’s Anthropic
20
u/dwrz 2d ago
I have noticed degradation in LLMs ability to write. I would use Claude 3.5 for editing text, but no longer use 5.5. The only LLM that I've found outputs barely sufficient code documentation is Gemini Pro. Qwen 3.6 is a better writer than 3.8. Is this because LLMs are being trained on code, because of overfit, or something else?
19
u/rorowhat 2d ago
Since you guys know the models like nobody else does, can you also release an ultra optmized engine that goes along with the model? I believe this would really sell this model to most folks that are struggling to get good performance with llama.cpp.
35
u/pantalooniedoon 2d ago
Thanks for another open release! Do Chinese labs look to reddit for feedback at all? Does our complaining and begging work?
16
u/TheRealMasonMac 2d ago
Have you thought about paying more attention to non-verifiable instruction following? I notice that a lot of proprietary Western models perform better (e.g. with regards to style constraints).
16
u/More-Curious816 2d ago
What was the most difficult behavior to improve during post-training?
15
u/More-Curious816 2d ago
Vulnerability discovery and reverse engineering are not inherently offensive activities. and Incident-response teams use reverse engineering, for malware analysis and deobfuscation, and forensic investigation to understand how an attacker compromised a system.
vulnerability discovery capability that allow the defense team to discover vulnerabilities before the attackers do is one of the most important ways to reduce the attack surface of critical infrastructure from the defnse point of view
Aren't you making defenders pay the price by limiting the model cyber capabilities? especially since these capabilities are inherently dual-use so limiting one hurt the other side badly?
14
u/Frail_Waif 2d ago
Do you all talk with other open LLM labs outside of research papers, or is the environment fairly competitive?
14
u/ps18pmcom 2d ago
Will you at all release any small models to compete with LFM3 on edge devices?
13
u/shuczhao 2d ago
Great to see the red-teaming details for Hy4. Usually, heavy safety tuning makes open models refuse basic pentesting, reverse engineering, or CTF tasks. How did you guys avoid over-refusal on those dual-use coding prompts?
13
u/ortegaalfredo 2d ago edited 2d ago
Hi!
I tested Hy4 Flash on custom benchmarks. Unfortunately, many new models seem to be benchmaxxed, like Baidu Ernie, that while being a big model, in my benchmarks it scores lower than qwen-flash.
But Hy4-flash scores very well, up to, or better than Qwen-3.8-Flash-Next. That makes me think that the big Hy4 might be the best current open model available. Strata/Maya/antirez ds4 have been game changers in that they allow to run those big models on modest hardware. So I have two questions:
And
2. Do you feel the pressure to remove cyber-capabilities like Kimi did?
12
u/Transcendent_Bussy 2d ago
Are you guys planning on continuing development of models that can fit in the 64-128gb ram range?
11
u/More-Curious816 2d ago
What was the strongest architectural alternative to the final Hy4 design that the team seriously considered but rejected? and why?
19
u/Infinite-Local5435 2d ago
Great model especially when paired with WorkBuddy! Some questions from me:
Thanks a bunch and please keep the remote control thingy from the current preview mode since it's a life saver when i want to execute something on my pc through gui and not agent in case something needs evaluation or goes wrong!
8
u/Ok_Cow1976 2d ago
Are the two models trained more on coding or for general purposes
8
u/True_Requirement_891 2d ago
Why remove cyber sec red-teaming data from training? One could literally chain up a harness that uses this model part of the loop and do the same task.
It neuters the model for no real gain. Have you guys thought of an alternative to this?
8
u/More-Curious816 2d ago
you said that
but also said
So Hy4 Flash combines self-distillation from Hy4 with a substantially different architecture incorporating 1.Hybrid attention. 2. LatentMoE. 3. N-gram embedding (Engram).
my questions are:
7
u/Loose_Being_8583 2d ago
Welcome!Like Hy4 Preview, the full release of Hy4 still sometimes spends too long reasoning. Does this overthinking come from the RL reward design or from the distribution of the training data? Can the model learn when to stop?
7
u/Exciting_Variation56 2d ago
Does your team see this model as one users will run on their hardware at home? or is that your intention with your hinted-at smaller MoE model in other threads?
I'm literally looking into a server rack just because of this flash release. Great work and thank you for sharing with the world.
6
u/JGByvygyrfg 2d ago
Any plans to release a new open image model? HunyuanImage-3.0 was great but far too large for most setups. Make a smaller 5-12B model for local usage than make a larger model as there need to be more open source image models. I'd like to see another HunyuanVideo as well. Also btw what happened to your Discord server? There no moderation, very little real activity, and you let it get hacked once.
6
u/lawdawgattorney 2d ago
Are you going to release an exl3, nvfp4 or trellismx quantized version of this (hy4) model?
6
u/Barni275 2d ago
Any chances for Hy-27B? 🙏
5
u/Every-Article6734 2d ago
Will there be similar size of open weight models in future? This is particularly fit for 128GB machine in Q4.
Thank you for bringing the model to the community.
5
u/Kahvana 2d ago edited 2d ago
Thank you for releasing the weights!
Finally, for more personal questions to the people(s) answering:
Thank you for your time and for doing the AMA. I'm looking forward to using more of your work in the future!
5
u/kmike84 2d ago
Recently mimo was really open about their training process: https://mimo.xiaomi.com/rl/#overview
What do you think about this?
And if you can share - is their post-training close to what you're doing, or are there significant differences - costs, amounts of data, ratio of various task types, etc.?
5
u/Impossible_Ground_15 2d ago
Are you considering releasing an open weight Text to Speech model?
Thank you for what you do for the community!
9
u/EducationalWelcome31 2d ago edited 2d ago
Hy4 Flash - Is this model harder to quantize than others of similar size?
I had awesome 100% performance with the hosted model in a work task I often use as a model benchmark. But with the NVFP4 build I had around a 8% error rate. Haven't seen any drop near that level with 4-bit quants of other models.
Compared to other 4-bit quants, I've also found KLD to be surprisingly high and same top token as the base model to be low.
I use basalt on a 2x5070ti + 1x5060ti, 96gb ddr5 machine.
8
u/Illustrious-Thing567 2d ago
How much thought have you given to creative writing/readability? One of the major things that would make me switch away from Qwen 3.8 Flash Next would be having a model that is far more readable and understandable when explaining things.
4
u/Notdesciplined 2d ago
At what level would Hy4 models be at today?
what level will it potential reach for future models?
4
u/MerePotato 2d ago
Any plans for a model targeting 24GB VRAM?
4
u/Mysterious_Finish543 2d ago
Will there be a technical report for Hy4 and Hy4 Flash?
Would love to get a report like DeepSeek did for R1, V4, etc, very useful for open research.
4
u/KambeiZ 2d ago
I don't know if i'm too late to the party, but i'm curious on the training & architecture side: what leads the decision behind each tinkering of the network layers? For example, how do you "choose" what layer are essential to keep for the flash from the initial architecture in Hy4 ? Really curious!!
4
u/Shadow_s_Bane 2d ago
Can we expect GGUFs ? If yes which one of the flash ones should I get ?
4
u/InfinityZeroFive 2d ago
Thanks for the open-weights! I work in computational biology and I have tested Hy4 Flash on hand-docking ligands into proteins without using standard docking tools (like GNINA), in both reasoning-only and with-tools settings. As a fun eval. This task requires the model to reason over the biological chemistry, first identify the likely pocket of the protein and then, based on the contacts, how the ligand should be placed.
Hy4 Flash is surprisingly decent, especially considering it recalls the protein less often than other open models (like DeepSeek V4.1 Flash 1107). It has moderate-OK capability to reason from sequence the correct pose, but with tools has surprised me a few times, even beating Claude Sonnet and Haiku 5.5 in some cases (the Claude models are heavily trained for biological tasks - currently open-source models are quite far behind in science, for example as you can see in TerminalBench-Science)
My question to the Hy team is: do you plan to prioritise RL for science (bio specifically) in the future, especially for mid-sized models in the range of Hy4 Flash to 500B parameters? And do you think Chinese labs can challenge Claude's dominance in biology?
12
u/crusaderky 2d ago
How much do you think ArtificialAnalysis' obvious bias towards closed US models is hurting your bottom line and that of other Chinese frontier labs?
3
u/mr_andrey_isachenko 2d ago
Congrats on the Hy4 and Hy4 Flash release, and thanks for doing an AMA here!
Two questions for Shunyu and the architecture/RL team:
3
u/Zealousideal-Mall818 2d ago
OK , LOVE YOUR WORK AND THANK YOU , question ; when will you guys pivot to creating models that use more structured Datasets , instead of just text , when will you merge the 3d training with video training creating a render engine that is controllable not some random slot machine ,
3
u/chill-boi 2d ago
The Hy4 system card says you “turn real-world needs and feedback into training data and evaluation targets,” and some misuse evals are built from real agent interaction data. Did you ever use past misalignment incidents, either your own or publicly reported ones from other labs, in training or as evaluation targets?
3
u/takoulseum 2d ago
Instead of making new models, do you plan updates of Hy4 Flash?
3
u/a_pimpnamed 2d ago
You guys planning on making ternary models from scratch to make models stupidly efficient to serve?
3
u/power97992 2d ago
How is the progress on continual learning?
4
u/kmike84 2d ago
How would you rank your friendly open source competitor labs (deepseek, z.ai, moonshot, alibaba, etc.) - not based on the model scores, but based on their team's technical capability, research quality, etc.? Who would you consider top 3, in order?
2
u/-Krotik- 2d ago
which technology do you think is gonna impact local LLMs the most?
2
u/sdatta11 2d ago
CLI can easily break when a model hallucinates precise syntax or flags. Could you elaborate on how you handled reinforcement learning without loosing the context.
2
u/power97992 2d ago
Can your company build a memory fab, so vram and gpus can get cheaper? ( Highly unlikely to happen)
A more pertinent question- for hy 4.5, you scale up the parameters to 1.5 Trillion to 2 T yeah?
2
u/Pharaoh0527 2d ago
With access to advanced AI chips becoming increasingly restricted, what is the biggest bottleneck for Tencent Hy: compute, training efficiency, or algorithms? Can future Hy models continue to close the gap with frontier models?
2
u/Efficient_Fig_254 2d ago
exl3 quantization would be huge for local inference on lower-end hardware. any plans to support it?
2
u/PrimeDirective8 2d ago
Looking at llama.cpp PRs, I see one to support Hy4 Flash was opened 2 days ago. Do you guys work with the likes of llama.cpp to add support before the model is widely released, or is it best to release and let users add support later?
I'll second other's request for a 35B to 70B, maybe up to 120B MoE.
2
u/ResearchCrafty1804 2d ago
What do you think will unlock the next era in AI, a breakthrough in architecture, more/better data or something else?
2
u/ResearchCrafty1804 2d ago
Some researchers say that theoretically an 1B (active parameters) model could outperform today’s frontier models in a couple years, do you think it’s indeed possible, or is there a ceiling?
2
u/Anna__Nelson 2d ago
Thank you for open-sourcing Hy4 and Hy4 Flash! I’ve been using both recently and have had a great experience. I have a few questions for the team:
2
u/nunodonato 2d ago
Is there a specific reason why you guys decided to not publish benchmark results for very common benchmarks like GPQA Diamond, tau bench, IFBench, SWE Bench...?
2
u/Silent_Glass 2d ago
Perhaps a very dumb question as I’m still learning about local AI Models. I have 96GB VRAM with 128 RAM. Can it run flash?
2
u/CharlesYao0710 2d ago
我不太懂你们讨论的那么专业的内容,但是至少对于国内的一些AI,我觉得Hy正在加速追击甚至赶超,而且是我欣赏的开源路径\(°o°)/。问一个比较low的问题吧O_o,Gemini对世界知识的理解强有一部分原因是Google学术还有Google搜索,YouTube等多年的数据库,那你们团队的训练数据是否一部分来自于公众号,视频号等,这些数据对于训练有效吗?(◠‿◕)
2
u/OddDesigner9784 2d ago
What are models you consider comparable to hy4 or flash from the US labs. I don't really trust AA so I wonder what your evaluation is
2
u/More-Curious816 2d ago
there is so much attention on stem related topcs like coding, mathematics and scientific researchs, but lack of attention on creative works like writing coherent fictional stories. do you plan on shift your attention to this issue or release a model that less coding and mire creative writing?
2
u/cleverusernametry 1d ago edited 1d ago
I turn criticism into power, I soar beyond limits, owning my greatness!
3
u/More-Curious816 2d ago
from https://huggingface.co/tencent/Hy4-flash
what are the reasons for exposing your base model to a large amount of synthetic instruction data during mid-training?
2
u/RobotSympathiser 2d ago edited 2d ago
Hi Hy4 team, congratulations on the release.
I work on small and medium sparse MoE models and quantization. I have a 35B-A3B model (256 experts, top-8, about 3B active) quantized to roughly 2.1 bpw ternary, and I'm trying to recover capability with 4-bit on selected expert tensors plus low-rank correction branches. Your 12B-active, 512-expert LatentMoE design is the closest reference I have.
I have five questions, roughly in order of how much they would change what I do next.
Thanks, and congratulations again on the release.
1
u/Mr_Lucas2000 2d ago
Do you think you'll match the performance of sonnet 5.5 or better in hy4.5 or hy5? And what's your look on the future?
1
u/quiet_meadow_734 2d ago
How frequently will you aim to release new checkpoints?
How long does it take to train a checkpoint of an existing model?
And how do you improve your training data between checkpoints to improve the model's capabilities?
1
u/Easy_Refrigerator280 2d ago
What percentage of weights would you say might be considered bloat and could be trimmed if we were very precise with our training?
Like efficient reasoning to search up info vs baked info onto weights. Or just general irrelevant info in weights that does not help towards intelligence?
1
u/Aley701 2d ago
Where i can find some official tutorial video on implementing your model into our workflow
1
u/AIonyourface 2d ago
Coding plan when ?
1
u/yanhua_lab 2d ago
hi hy4 team, thanks for releasing the weights.
got a couple questions about the autonomous r&d part:
would love to hear any insights you can share.
1
u/Jeweloon 2d ago
Hello, Mr. Yao Shunyu.
You previously noted that Tencent AI has entered the second half of its development trajectory. Just days ago, Tencent unveiled its HY4 model, which has quickly cemented its place in the industry’s top tier.
I’m curious: what is the core strategic goal for Tencent AI in this next phase? And what will be your most critical priorities moving forward to deliver on that vision?
1
u/Loose_Being_8583 2d ago
Shunyu has often emphasized the importance of having good taste in data. What are your criteria for good training data, and how do you test whether a dataset meets them?
1
u/Lyelinn 2d ago
Any recent innovation you're looking for implementing for the future pipeline or models?
What are the worst bottlenecks of today in terms of making a new release from pre-training to finished, usable model?
1
u/Super-Ad2061 2d ago
1
u/Loose_Being_8583 2d ago
With Hy4 and Hyra 2.0, you’ve already been able to improve your training infrastructure and train better small models. What experiment would you run next to show that a model trained in one round is itself better at doing model R&D in the next? How can a model get better at learning itself?