• A
  • A
  • A
  • ABC
  • ABC
  • ABC
  • А
  • А
  • А
  • А
  • А
Regular version of the site

HSE and Yandex Propose Method to Speed Up Neural Networks for Image Generation

HSE and Yandex Propose Method to Speed Up Neural Networks for Image Generation

© iStock

A team of scientists at HSE FCS and Yandex Research has proposed a method that reduces computational costs and accelerates text-to-image generation in diffusion models without compromising quality. These models currently set the standard for text-to-image generation, but their use is limited by high computational loads, the company said in a statement.

It is further specified that the developed method—Scale-wise Distillation of Diffusion Models (SwD)—avoids redundant computations during image generation, allowing results to be produced in just 0.3–0.4 seconds.

According to one of the authors, the generation process in diffusion models typically requires dozens of steps involving high-resolution computations. However, in the early stages, only the general structure of the image is formed, and fine details are not yet distinguishable; as a result, some of these computations are redundant. The proposed SwD framework addresses this problem in two ways. First, generation begins at a low resolution and is progressively refined as noise is reduced, eliminating redundant computations in the early stages. Second, the method uses distillation of pre-trained models such as FLUX and Stable Diffusion 3.5, whereby a simpler student model learns to replicate the output of a more complex one, reducing the number of generation steps from dozens to just 4–6. 

The authors propose a new loss function for training—Maximum Mean Discrepancy (MMD), which compares how the teacher model 'sees' an image at its internal processing levels with how the student model represents the same image. Unlike traditional approaches, this method does not require auxiliary models, simplifying and accelerating training, the company emphasises. Moreover, MMD can be used as a standalone distillation (knowledge compression) technique: in experiments, the time per training iteration was reduced sevenfold compared to more complex combined approaches. 

The new approach reduces generation time from several seconds to just 0.3–0.4 seconds while maintaining visual quality. As a result, SwD makes modern diffusion models faster and more cost-efficient to use, improving their accessibility for practical applications, the company statement says.

The solution is described in a paper to be presented at ICLR 2026, one of the leading conferences on artificial intelligence.

See also:

Scientists Develop Algorithm for More Reliable Processors in Data Centres

Researchers from HSE MIEM and Samara University have developed the LRF-3D algorithm to automatically bypass idle nodes in three-dimensional networks-on-chip. Thanks to its hierarchical architecture, the algorithm outperforms existing solutions in both speed and path accuracy, improving processor reliability for use in data centres, supercomputers, and AI computing. The source code and test results are publicly available.

Researchers Rank Recommendation Algorithms Using Sports Tournament Model

Researchers from the AI and Digital Science Institute at the HSE Faculty of Computer Science have developed an approach for selecting recommendation algorithms more effectively. Their approach uses pairwise comparisons of algorithms to create a tournament table, with the overall ranking based on their performance across all datasets in the tournament. This can reduce the number of algorithms that need to be tested when developing new services, saving both time and money. The study was presented at the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD 2026).

Researchers Develop Method for Direct Generation of Regulatory DNA

Researchers at HSE University have developed a model for generating promoters and enhancers—DNA sequences that regulate gene activity. The model works directly with DNA nucleotides, without first transforming them into a continuous numerical representation. This solution could be useful for applications in synthetic biology and gene therapy. The study results were presented at the ICLR 2026 Workshop ‘Generative AI in Genomics (Gen^2): Barriers and Frontiers.’

Researchers at HSE University and Sber Train Neural Networks to Better Predict User Preferences

The HSE FCS AI and Digital Science Institute and Sber have introduced a new architecture for recommendation systems that combines two classes of models, enabling algorithms to better predict users’ interests and needs. A preprint of the paper has been published on arxiv.org and presented at Urban ML.

Physicists Discover What Happens Inside a Stable Vortex

Large vortices with characteristic spiral arms are often observed in the atmosphere and the ocean. Physicists from HSE University have explained how these structures form and why they retain their shape. The researchers found that velocities at points located along the same vortex arc remain correlated even over long distances. At the same time, this correlation weakens rapidly with increasing distance from the vortex centre. These differences help explain the formation of spiral arms and may improve models of atmospheric and oceanic currents. The findings have been published in Physical Review Fluids.

HSE Computer Science Researchers Win Gold Medal at International Machine Learning Competition

A team comprising HSE International Laboratory of Statistical and Computational Genomics researchers Aleksei Shmelev and Nikita Chervov, 2025 graduate of the HSE Faculty of Computer Science’s Master’s programme in Data Analysis in Biology and Medicine Ivan Gevorkov, and two students from the United States achieved an outstanding result at the 2026 NeuroGolf international machine learning championship. The team won a gold medal and placed seventh overall.

‘Working with AI Solves a Wide Range of Engineering Problems’

Artificial intelligence is a working tool based on a balanced combination of algorithms and engineering. Experts and doctoral students from the HSE Moscow Institute of Electronics and Mathematics explain how AI technologies can improve an application, device, or system, and what engineering tasks are solved in the process.

‘The Peak of Stupidity’ and ‘The Valley of Despair’: HSE Economists Propose an Explanation for the Dunning–Kruger Effect

The Dunning–Kruger effect, which describes a sharp surge in self-confidence among beginners followed by an equally rapid decline as they gain experience, can be explained by the nature of the learning process and the acquisition of new knowledge. This conclusion was reached by Andrey Vorchik of the HSE Faculty of Economic Sciences together with independent researcher Murat Mamyshev. They developed a mathematical model of learning and demonstrated how subjective confidence is formed and changes as knowledge accumulates, as well as how teachers can reduce the ‘valley of despair’ experienced by learners.

Toffee and Risk: Scientists Discover Why People Who Crave Sweets Make More Impulsive Choices

Having a sweet tooth may be linked not only to eating habits but also to the way people make decisions. Researchers at HSE University have found that people with a preference for sweet foods tend to behave more impulsively—not because they want immediate rewards, but because they are less willing to tolerate uncertainty. These findings may help improve treatments for addiction. The study findings have been published in Frontiers in Psychology.

Advancing Collaboration: HSE Faculty of Computer Science and Harbin Institute of Technology Hold Joint Seminar

From July 13 to 16, 2026, the Faculty of Computer Science hosted the Russian–Sino Research Seminar on Machine Learning Applications, organised by the HSE Laboratory for Cloud and Mobile Technologies in partnership with the Harbin Institute of Technology (China). A delegation comprising seven students and three university representatives travelled to Moscow to take part in an intensive four-day programme.