Submit

Login Login

Register Register

Home / Journals / CMC / Online First / doi:10.32604/cmc.2025.062599
Journal Menu
Special Issues
Table of Content

All issues

Online First

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

Open Access

ARTICLE

HyTiFRec: Hybrid Time-Frequency Dual-Branch Transformer for Sequential Recommendation

Dawei Qiu1, Peng Wu1,*, Xiaoming Zhang2,*, Renjie Xu3
1 School of Information Science and Engineering, Zhejiang Sci-Tech University, Hangzhou, 310018, China
2 Department of Vehicle Engineering, Army Academy of Armored Forces, Beijing, 100072, China
3 Performance and Training Center, Army Academy of Armored Forces, Beijing, 100072, China
* Corresponding Author: Peng Wu. Email: email; Xiaoming Zhang. Email: email
(This article belongs to the Special Issue: Advances in Deep Learning and Neural Networks: Architectures, Applications, and Challenges)

Computers, Materials & Continua https://doi.org/10.32604/cmc.2025.062599

Received 22 December 2024; Accepted 08 February 2025; Published online 05 March 2025

Abstract

Recently, many Sequential Recommendation methods adopt self-attention mechanisms to model user preferences. However, these methods tend to focus more on low-frequency information while neglecting high-frequency information, which makes them ineffective in balancing users’ long- and short-term preferences. At the same time, many methods overlook the potential of frequency domain methods, ignoring their efficiency in processing frequency information. To overcome this limitation, we shift the focus to the combination of time and frequency domains and propose a novel Hybrid Time-Frequency Dual-Branch Transformer for Sequential Recommendation, namely HyTiFRec. Specifically, we design two hybrid filter modules: the learnable hybrid filter (LHF) and the window hybrid filter (WHF). We combine these with the Efficient Attention (EA) module to form the dual-branch structure to replace the self-attention components in Transformers. The EA module is used to extract sequential and global information. The LHF and WHF modules balance the proportion of different frequency bands, with LHF globally modulating the spectrum in the frequency domain and WHF retaining frequency components within specific local frequency bands. Furthermore, we use a time domain residual information addition operation in the hybrid filter module, which reduces information loss and further facilitates the hybrid of time-frequency methods. Extensive experiments on five widely-used real-world datasets show that our proposed method surpasses state-of-the-art methods.

Keywords

Sequential recommendation; frequency domain; efficient attention

  • 159

    View

  • 36

    Download

  • 0

    Like

Related articles

Share Link