Open Access
ARTICLE
Adaptive Fixed-Time Synchronization of Delayed Memristor-Based Neural Networks with Discontinuous Activations
1
School of Automation and Electrical Engineering, and Key Laboratory of Complex Systems and Intelligent Computing in Universities of Shandong, Linyi University, Linyi, 276005, China
2
The Hubei Key Laboratory of Advanced Control and Intelligent Automation for Complex Systems, and School of Automation,
China University of Geosciences, Wuhan, 430074, China
* Corresponding Authors: Xiangyong Chen. Email: ; Xiurong Yao. Email:
(This article belongs to the Special Issue: Modeling and Analysis of Autonomous Intelligence)
Computer Modeling in Engineering & Sciences 2023, 134(1), 221-239. https://doi.org/10.32604/cmes.2022.020780
Received 11 December 2021; Accepted 11 February 2022; Issue published 24 August 2022
Abstract
Fixed-time synchronization (FTS) of delayed memristor-based neural networks (MNNs) with discontinuous activations is studied in this paper. Both continuous and discontinuous activations are considered for MNNs. And the mixed delays which are closer to reality are taken into the system. Besides, two kinds of control schemes are proposed, including feedback and adaptive control strategies. Based on some lemmas, mathematical inequalities and the designed controllers, a few synchronization criteria are acquired. Moreover, the upper bound of settling time (ST) which is independent of the initial values is given. Finally, the feasibility of our theory is attested by simulation examples.Keywords
Memristor is nonlinear resistance having memory function, which represents relationship between magnetic flux and charge. Based on the connections between circuits, Chua proposed the existence of it in 1971 [1]. The first physical memristor is made by Hewlett-Packard Laboratory in 2008 [2]. Unlike ordinary resistors, memristors retain data after a power failure. At present, there are two main applications of memristors: data storage and class brain calculation. Due to the characteristics of small size, low power consumption and fast operation, memristor can be combined with artificial neural networks(NNs) to produce MNNs with more diverse functions and more complex structures. Research on MNNs or NNs have been going on, such as stability [3,4],
Due to the chaotic characteristics of MNNs, it appeared in many fields, such as image protection [8] and random number generation [9]. Therefore, the study about synchronization of MNNs is particularly important. Exponential synchronization of MNNs with impulsive and perturbations were put forward by [10], and given a impulsive controller. Li et al. [11] proposed synchronization within finite-time of BAM MNNs and provided a switching control scheme. FTS of MNNs with fractional order was realized in [12] by using a fractional sliding mode control scheme with no singular terms.
In engineering practice, people always expect the system to realize synchronization as soon as possible. Finite time synchronization attracted people’s attention because of its fast error convergence rate and robustness [13,14]. Finite-time synchronization can make the error go to zero for a short time. So many of research on finite-time synchronization. Hua et al. [15] used delay-independent controller to settle synchronization of MNNs with inertial item in finite time without using variable transformation while studing from MNNs themselves. Shi et al. [16] put forward finite-time synchronization of Cohen-Grossberg MNNs and divide error into two states. What needs to be noted is that finite-time synchronization is connected with initial value but it is difficult to acquire for large or complex systems. So this is very limited for applications of finite-time synchronization. While, the limitation was solved by FTS which proposed by [17]. Different from finite-time synchronization, the ST of FTS is not connected with initial values, which greatly improves the application range of FTS in complex dynamicalnetworks [18] and MNNs. So more and more scholars began to study the FTS of MNNs or NNs in recent years. Based on a new proposed lemma, Li et al. [19] realized the fixed time synchronization problem of coupled NNs, and simultaneously the discontinuity and parameters mismatch of the system were considered. And Ren et al. [20] put forward the FTS of stochastic NNs and got the synchronization criteria. Besides, many achievements about FTS of complex-valued and quaternion-valued MNNs or NNs had also been made in [21,22].
The connection weights of MNNs are switchable, so it belongs to a switching system, which is of great significance to the research of switching systems [23]. Meanwhile, it is known that valid control tactics can make the synchronization faster, more stable and easier to meet the needs of practical production applications. Sliding mode control is an effective control method to suppress interference and ensure the stable operation of the nonlinear system [24]. Under the sliding model control method, Xiao et al. [25] realized the FTS of NNs. In addition, with the aid of event-triggered algorithm, Bao et al. [26] studied the synchronization of MNNs. Adaptive control is a resultful control schemes [27,28], it has good robustness and has effective suppression of external interference. Especially when the system has unknown parameters and external disturbance, the adaptive control algorithm can track them, so as to ensure the stable operation of the system. Time delay is universal for nonlinear systems. Especially in engineering practice, when the system signal transmission volume is large, it will lead to channel congestion, resulting in discrete time delay, and when there are parallel channels in the signal transmission path, it will lead to distributed time delay. Time delay will affect the stability of the system and hinder the synchronization of the system. In addition, systems with time delay have complex chaotic characteristics and show complex dynamic behaviors, which are very worthy of study. While some previous literatures [6,12,20,25,26] only considered the constant delay or discrete delay but ignored the distributed delay. For NNs, the activation function realizes the nonlinear transformation of data and solves some problems that the linear model cannot solve. Activation functions are mainly divided into continuous and discontinuous types, but discontinuous activation functions are seldom considered by researchers due to the complexity of analysis.
From above discussion, we find that few people have studied FTS of MNNs, especially the case with mixed delays and discontinuous activation functions. Hence, inspired by above conditions, the adaptive FTS of delayed MNNs with discontinuous activations are studied in this study. And our contributions are enumerated in following aspects. (1) Complex MNNs model with mixed delay and discontinuous activations is considered. (2) A feedback control scheme and an adaptive control algorithm are proposed for continuous and discontinuous activations, respectively, and the FTS criterion is obtained. Besides, the results are extended to finite-time synchronization. (3) The ST is not affected by the initial value of system and can be adjusted by the controller and system parameters.
2 Model Formulations and Preliminaries
The drive system of MNNs is
where
There exist constants k′ij, k″ij, l′ij, l″ij, m′ij, m″ij, such that
where
Recur to set-valued mappings, it acquires
where
If the activation functions are continuous, one can obtain
then we set
There also exist
where the
The error is
where
If activation functions are discontinuous, we set
The error is calculated as
where
Definition 1. [30] For any original value, the FTS of MNNs will be attained if the ST function
where
Lemma 1. [31] (1) and (4) will attain FTS if a continuous radically unbounded function
(i)
(ii)
for any solution
where d1 > 0, d2 > 0, 0 < r1 < 1, r2 > 1. And the ST is calculated as
Lemma 2. [32] There are some inequalities as follows:
The FTS of MNNs with continuous and discontinuous activations will be studied in this section.
3.1 The Continuous Activations for FTS of MNNs
Lemma 3. [33] If
where
To realize FTS, control algorithm is given as
where
Theorem 1. Under the above assumptions and control scheme (7), the FTS of (1) and (4) will be carried out if the following conditions hold
and it can obtain
where
Proof. Construct Lyapunov function as
Along the error system (5), the derivative of (10) can be obtained as
By means of Assumption 1 and Lemma 3, we yield
and
One can also get
Substitute (12)–(14) into (11), we have
According to Throrem 1 and Lemma 2, it has
where
Remark 1. Especially, when
where
Corollary 1. Under the below control algorithm, (1) and (4) can reach to finite-time synchronization when Assumption 1 and following conditions hold:
and
where
Remark 2. Unlike the exponential or asymptotic [7–9,27,28] which time to synchronization is long or infinite, the FTS has faster convergence. In addition, the finite-time synchronization[14,26,30] has a fast convergence rate but relies on initial values of the system greatly. However, the starting values of some large and complex systems are hard to know, but FTS overcomes this problem and it can be used widely.
3.2 The Discontinuous Activations for FTS of MNNs
Assumption 1.
Assumption 2. There are constants
According to (6), one can get
And the nether control adaptive algorithm is designed to ensure the FTS of MNNs.
and adaptive law is
where
Theorem 2. FTS with discontinuous activations will be attained under Assumptions 3 and 4 and control (24) if following conditions are met.
Proof. Choose Lyapunov function as
Take derivative of
With Assumption 3, it gets
and
Besides, one can obtain
and
So it yields
According to Theorem 2, it has
where
Remark 3. If
where
Corollary 2. Under Assumptions 3 and 4, (1) and (4) attain finite-time synchronization with control scheme (37) if following conditions hold
and adaptive law is
and
where b 1i to b 4i are positive constants and
Remark 4. Compared with continuous activation functions [20,25], our study considers the more complicated discontinuous activation functions and mixed delays. Besides, it is known that the gain of feedback control is always larger than the practical application, so the adaptive control are used for FTS in this subjection. The adaptive control has robustness, anti-interference and good suppression effect on external interference, even in the case of some unknown system parameters can also achieve good control effect.
Remark 5. The synchronization criteria of FTS and the upper bound of ST are obtained in our study. Besides, we also derive the relevant criteria for finite-time synchronization, which is more comprehensive than the paper that only studies FTS or finite-time synchronization. From (17) and (35), it’s pretty obvious that ST does not rely on starting values and can be adjusted by changing controller paramaters:
Examples are offered in this section verifing validity and superiority of above theoretical derivation.
Example 1. This example to verify the FTS of MNNs with continuous activations.
Consider drive system of MNNs with two neurons as
The weighted matrices are
where i, j = 1, 2, the switching threshold L j = 1. The delays are set as
To attain FTS, the parameters are selected as
The chaotic trajectory with control is showen in Fig. 1. Under the action of the controller, the chaotic orbits of the driving system
Example 2. This example to illustrate the FTS of MNNs with discontinuous activations.
The initial values are set as
Fig. 5 shows the chaotic trajectory of the driving system, and Fig. 6 shows the chaotic trajectory of the response system without the action of the controller. It can be found that the curves in the two pictures are different. The chaos diagram of the response system under the action of the controller can be seen in Fig. 10. It can be found that Fig. 10 is consistent with Fig. 5.
Figs. 7 to 9 show the state curves and error curves without the action of the controller. It can be found that the curves are not synchronized. Under the action of the adaptive control algorithm, Figs. 11 and 12 show that the state trajectories of the drive and response system realize finite-time synchronization, and Fig. 13 shows that the system errors eventually approache to zero. In addition, the evolution curves of adaptive gains for the proposed adaptive control scheme are shown in Fig. 14.
The FTS of delayed MNNs with two kinds of activations are discussed. A feedback control algorithm is given for continuous activations and an adaptive control scheme is given for discontinuous activations. Besides, the Filippov theory is used to solove the noncontinuity of MNNs and obtain the synchronization criteria. In addition, through formula derivation, we also draw the conclusion of finite-time synchronization under the same model, so our results are more comprehensive. Finally, two simulation results to prove the feasibility of theoretical derivation. Compared with integer-order MNNs, fractional-order MNNs have more complex dynamic behavior and show stronger chaos. Therefore, the synchronization of fractional-order MNNs are our research direction in the future.
Acknowledgement: The authors would like to thanks the editor office for the deep advice to improve our work.
Funding Statement: This work was supported by National Natural Science Foundation of China under (Grant Nos. 62173175, 12026235, 12026234, 61903170, 11805091, 61877033, 61833005), and by 111 Project under Grant B17040, and by the Natural Science Foundation of Shandong Province under Grant Nos. ZR2019BF045, ZR2019MF021, ZR2019QF004, and by the Project of Shandong Province Higher Educational Science and Technology Program No. J18KA354, and by the Key Research and Development Project of Shandong Province of China, No. 2019GGX101003.
Conflicts of Interest: The authors declare that they have no conflicts of interest to report regarding the present study.
References
1. Chua, L. (1971). Memristor-the missing circuit element. IEEE Transactions on Circuit Theory, 18(5), 507–519. DOI 10.1109/TCT.1971.1083337. [Google Scholar] [CrossRef]
2. Strukov, D. B., Snider, G. S., Stewart, D. R., Williams, R. S. (2008). The missing memristor found. Nature, 453(7191), 80–83. DOI 10.1038/nature06932. [Google Scholar] [CrossRef]
3. Liu, W., Huang, J., Yao, Q. (2021). Stability analysis for quaternion-valued inertial memristor-based neural networks with time delays. Neurocomputing, 448, 67–81. DOI 10.1016/j.neucom.2021.03.106. [Google Scholar] [CrossRef]
4. Sheng, Y., Huang, T., Zeng, Z., Li, P. (2021). Exponential stabilization of inertial memristive neural networks with multiple time delays. IEEE Transactions on Cybernetics, 51(2), 579–588. DOI 10.1109/TCYB.2019.2947859. [Google Scholar] [CrossRef]
5. Shen, H., Hu, X., Wang, J., Cao, J., Qian, W. (2021). Non-fragile H
6. Gong, S., Guo, Z., Wen, S., Huang, T. (2021). Finite-time and fixed-time synchronization of coupled memristive neural networks with time delay. IEEE Transactions on Cybernetics, 51(6), 2944–2955. DOI 10.1109/TCYB.2019.2953236. [Google Scholar] [CrossRef]
7. Kao, Y., Li, Y., Park, J. H., Chen, X. (2020). Mittag-leffler synchronization of delayed fractional memristor neural networks via adaptive control. IEEE Transactions on Neural Networks and Learning Systems, 32(5), 2279–2284. DOI 10.1109/TNNLS.2020.2995718. [Google Scholar] [CrossRef]
8. Yuan, M., Wang, W., Wang, Z., Luo, X., Kurths, J. (2020). Exponential synchronization of delayed memristor-based uncertain complex-valued neural networks for image protection. IEEE Transactions on Neural Networks and Learning Systems, 32(1), 151–165. DOI 10.1109/TNNLS.5962385. [Google Scholar] [CrossRef]
9. Wen, S., Zeng, Z., Huang, T., Zhang, Y. (2013). Exponential adaptive lag synchronization of memristive neural networks via fuzzy method and applications in pseudorandom number generators. IEEE Transactions on Fuzzy Systems, 22(6), 1704–1713. DOI 10.1109/TFUZZ.91. [Google Scholar] [CrossRef]
10. Li, H., Fang, J. A., Li, X., Huang, T. (2020). Exponential synchronization of multiple impulsive discrete-time memristor-based neural networks with stochastic perturbations and time-varying delays. Neurocomputing, 392, 86–97. DOI 10.1016/j.neucom.2020.01.110. [Google Scholar] [CrossRef]
11. Li, L., Xu, R., Gan, Q., Lin, J. (2020). A switching control for finite-time synchronization of memristor-based bam neural networks with stochastic disturbances. Nonlinear Analysis: Modelling and Control, 25(6), 958–979. DOI 10.15388/namc.2020.25.20557. [Google Scholar] [CrossRef]
12. Wang, W., Jia, X., Wang, Z., Luo, X., Li, L. et al. (2020). Fixed-time synchronization of fractional order memristive mam neural networks by sliding mode control. Neurocomputing, 401, 364–376. DOI 10.1016/j.neucom.2020.03.043. [Google Scholar] [CrossRef]
13. Li, S., Ahn, C. K., Xiang, Z. (2020). Command-filter-based adaptive fuzzy finite-time control for switched nonlinear systems using state-dependent switching method. IEEE Transactions on Fuzzy Systems, 29(4), 833–845. DOI 10.1109/TFUZZ.2020.2965917. [Google Scholar] [CrossRef]
14. Cai, M., Xiang, Z. (2017). Adaptive practical finite-time stabilization for uncertain nonstrict feedback nonlinear systems with input nonlinearity. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 47(7), 1668–1678. DOI 10.1109/TSMC.2017.2660761. [Google Scholar] [CrossRef]
15. Hua, L., Zhu, H., Shi, K., Zhong, S., Tang, Y. et al. (2021). Novel finite-time reliable control design for memristor-based inertial neural networks with mixed time-varying delays. IEEE Transactions on Circuits and Systems I: Regular Papers, 68(4), 1599–1609. DOI 10.1109/TCSI.8919. [Google Scholar] [CrossRef]
16. Shi, Y., Cao, J. (2020). Finite-time synchronization of memristive cohen–grossberg neural networks with time delays. Neurocomputing, 377, 159–167. DOI 10.1016/j.neucom.2019.10.036. [Google Scholar] [CrossRef]
17. Polyakov, A. (2011). Nonlinear feedback design for fixed-time stabilization of linear control systems. IEEE Transactions on Automatic Control, 57(8), 2106–2110. DOI 10.1109/TAC.2011.2179869. [Google Scholar] [CrossRef]
18. Li, N., Wu, X., Feng, J., Lü, J. (2020). Fixed-time synchronization of complex dynamical networks: A novel and economical mechanism. IEEE Transactions on Cybernetics, 1–11. DOI 10.1109/TCYB.2020.3026996. [Google Scholar] [CrossRef]
19. Li, N., Wu, X., Feng, J., Xu, Y., Lü, J. (2020). Fixed-time synchronization of coupled neural networks with discontinuous activation and mismatched parameters. IEEE Transactions on Neural Networks and Learning Systems, 32(6), 2470–2482. DOI 10.1109/TNNLS.2020.3005945. [Google Scholar] [CrossRef]
20. Ren, H., Peng, Z., Gu, Y. (2020). Fixed-time synchronization of stochastic memristor-based neural networks with adaptive control. Neural Networks, 130, 165–175. DOI 10.1016/j.neunet.2020.07.002. [Google Scholar] [CrossRef]
21. Feng, L., Hu, C., Yu, J., Jiang, H., Wen, S. (2021). Fixed-time synchronization of coupled memristive complex-valued neural networks. Chaos, Solitons & Fractals, 148, 110993. DOI 10.1016/j.chaos.2021.110993. [Google Scholar] [CrossRef]
22. Peng, T., Qiu, J., Lu, J., Tu, Z., Cao, J. (2021). Finite-time and fixed-time synchronization of quaternion-valued neural networks with/without mixed delays: An improved one-norm method. IEEE Transactions on Neural Networks and Learning Systems, pp. 1–13. DOI 10.1109/TNNLS.2021.3085253. [Google Scholar] [CrossRef]
23. Wang, J., Huang, Z., Wu, Z., Cao, J., Shen, H. (2020). Extended dissipative control for singularly perturbed pdt switched systems and its application. IEEE Transactions on Circuits and Systems I: Regular Papers, 67(12), 5281–5289. DOI 10.1109/TCSI.8919. [Google Scholar] [CrossRef]
24. Wang, J., Yang, C., Xia, J., Wu, Z. G., Shen, H. (2021). Observer-based sliding mode control for networked fuzzy singularly perturbed systems under weighted try-once-discard protocol. IEEE Transactions on Fuzzy Systems, pp. 1889–1899. DOI 10.1109/TFUZZ.2021.3070125. [Google Scholar] [CrossRef]
25. Xiao, J., Zeng, Z., Wu, A., Wen, S. (2020). Fixed-time synchronization of delayed cohen–grossberg neural networks based on a novel sliding mode. Neural Networks, 128, pp. 1–12. DOI 10.1016/j.neunet.2020.04.020. [Google Scholar] [CrossRef]
26. Bao, Y., Zhang, Y., Zhang, B. (2021). Fixed-time synchronization of coupled memristive neural networks via event-triggered control. Applied Mathematics and Computation, 411, 126542. DOI 10.1016/j.amc.2021.126542. [Google Scholar] [CrossRef]
27. Li, Y., Luo, B., Liu, D., Yang, Z., Zhu, Y. (2020). Adaptive synchronization of memristor-based neural networks with discontinuous activations. Neurocomputing, 381, 196–206. DOI 10.1016/j.neucom.2019.11.018. [Google Scholar] [CrossRef]
28. Li, S., Peng, X., Tang, Y., Shi, Y. (2018). Finite-time synchronization of time-delayed neural networks with unknown parameters via adaptive control. Neurocomputing, 308, 65–74. DOI 10.1016/j.neucom.2018.04.053. [Google Scholar] [CrossRef]
29. Filippov, A. F. (1988). Differential equations with discontinuous righthand sides. Dordrecht, The Netherlands: Springer. [Google Scholar]
30. Cao, J., Li, R. (2017). Fixed-time synchronization of delayed memristor-based recurrent neural networks. Science China Information Sciences, 60(3), 032201. DOI 10.1007/s11432-016-0555-2. [Google Scholar] [CrossRef]
31. Parsegov, S., Polyakov, A., Shcherbakov, P. (2012). Nonlinear fixed-time control protocol for uniform allocation of agents on a segment. Proceedings of 2012 IEEE 51st IEEE Conference on Decision and Control (CDC), pp. 7732–7737. New York. DOI 10.1109/CDC.2012.6426570. [Google Scholar] [CrossRef]
32. Hardy, G. H., Littlewood, J. E., Pólya, G., Pólya, G. (1952). Inequalities. Cambridge, UK: Cambridge University Press. [Google Scholar]
33. Chen, J., Zeng, Z., Jiang, P. (2014). Global mittag-leffler stability and synchronization of memristor-based fractional-order neural networks. Neural Networks, 51, 1–8. DOI 10.1016/j.neunet.2013.11.016. [Google Scholar] [CrossRef]
Cite This Article
This work is licensed under a Creative Commons Attribution 4.0 International License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.