A Multi-Attribute Decision-Making Method Using Belief-Based Probabilistic Linguistic Term Sets and Its Application in Emergency Decision-Making
School of Management, Harbin Institute of Technology, Harbin, 150001, China
* Corresponding Author: Liguo Fei. Email:
(This article belongs to this Special Issue: Linguistic Approaches for Multiple Criteria Decision Making and Applications)
Computer Modeling in Engineering & Sciences 2023, 136(2), 2039-2067. https://doi.org/10.32604/cmes.2023.024927
Received 14 June 2022; Accepted 21 September 2022; Issue published 06 February 2023
AbstractProbabilistic linguistic term sets (PLTSs) are an effective tool for expressing subjective human cognition that offer advantages in the field of multi-attribute decision-making (MADM). However, studies have found that PLTSs have lost their ability to accurately capture the views of decision-makers (DMs) in certain circumstances, such as when the DM hesitates between multiple linguistic terms or the decision information is incomplete, thus affecting their role in the decision-making process. Belief function theory is a leading stream of thought in uncertainty processing that is suitable for dealing with the limitations of PLTS. Therefore, the purpose of this study is to extend PLTS to incorporate belief function theory. First, we provide the basic concepts of the extended PLTS (i.e., belief-based PLTS) through case analyses. Second, the aggregation operator of belief-based PLTS is defined with the ordered weighted average (OWA)-based soft likelihood function, which is improved by considering the reliability of the information source. Third, to measure the magnitude of different belief-based PLTSs, the belief interval of singleton is calculated, and the comparison method of belief-based PLTS is constructed based on probabilities. On the basis of the preceding discussion, we further develop an emergency decision framework that includes several novel techniques, such as attribute weight determination and decision information aggregation. Finally, the usefulness of the framework is demonstrated through a case study, and its effectiveness is illustrated through a series of comparisons.
Emergencies of various types are occurring increasingly frequently in the modern interconnected world, which is a phenomenon that has attracted great public attention . Emergencies are characterized by complexity, uncertainty and a high degree of destructiveness. Their occurrence causes great harm in terms of both public health and property damage . Proper awareness of disasters and effective coping strategies can help the public respond such that they do not become life-threatening . Therefore, actively engaging in disaster prevention education is of great significance in minimizing the damage caused by disasters .
Choosing a multiple-disaster risk reduction education plan is an emergency decision problem and therefore essentially a multi-attribute decision problem . Due to the randomness, multi-dimensionality and uncertainty of emergency decision-making, a disaster risk reduction education plan should also consider the complexity of the decision environment . Decision makers are the main participants in emergency decision-making, and their professional knowledge and experience play a key supporting role in evaluating events as they occur. Therefore, human subjectivity will inevitably be a factor in emergency decision-making. To avoid the decision error caused by fuzziness and uncertainty, a wide variety of information expression methods have been proposed to capture DMs’ subjectivity, such as the intuitionistic [7,8], hesitant [9,10], and Pythagorean fuzzy sets , among others.
Because of the lack of accurate information and the environmental uncertainty-as well as the urgency to make a decision-linguistic information and judgment are often employed as they represent the only means through which to represent DMs’ point of view in linguistic terms, such as , which is commonly applied to decision problems . In particular, probabilistic linguistic term sets , which have achieved great success in decision-making, have been proposed as an extension of hesitant fuzzy linguistic term sets as a means to capture information inaccuracy and event randomness.
Since PLTSs were first proposed in , the research on PLTS and MADM based on PLTS has attracted considerable attention. Liao et al.  proposed a comprehensive approach for multi-expert MADM problems that considers both quantitative and qualitative criteria and has been implemented to address green enterprise ranking issues. Jiang et al.  combined PLTS and the fuzzy least absolute regression to construct a fuzzy regression model capable of handling mixed types of inputs. Nie et al.  developed a group decision-making support model using prospect theory-based consistency recovery strategies based on PLTS. Wang et al.  extended TOPSIS, VIKOR and TODIM methods based on PLTS to be applicable to multi-expert MADM issues. An integrated MADM method based on PLTS was presented in  to determine the best medical product supplier. Li et al.  applied PLTS to determine variable weights in solving multi-attribute two-sided matching problems. To evaluate web celebrity shops, Liang et al.  employed long short-term memory and PLTSs to describe customers’ satisfaction. Several novel aggregation operators of PLTSs were defined in  to solve multi-attribute group decision-making problems. A MADM model was presented in  based on incomplete dual probabilistic linguistic preference relations to help enterprises select their 5G partners.
Although traditional PLTSs have been applied to different types of decision problems, the existing approaches show certain limitations and weaknesses, which are reflected in three aspects. The first is in terms of information expression. As probability information is often incomplete, normalization is required in order to fill any gaps in the data [13,23,24]. Second, it only allows for the distribution of probabilities on the singleton and cannot express situations in which the DM hesitates over two or more linguistic terms [24–26]. Third, the PLTS-based decision methods mostly fail to consider the missing attribute values, which are often unavoidable in practice [12,27,28]. In terms of information aggregation, aggregation operators based on the traditional Dempster’s fusion rule or ER method may suffer from information explosion caused by too many linguistic terms, which implies that the complexity of the algorithm needs to be reduced. In terms of decision-making processes, there is no research on the extension of belief-based PLTSs to emergency management issues, and any related studies do not provide a complete decision-making framework. By recognizing these limitations, the motivation of this study is to overcome these defects to make PLTSs more applicable to long-term decision-making. In particular, as decision environments in many applications, such as responding to major emergencies, are highly uncertain and complex, more powerful tools are needed in order to capture how DMs evaluate information. To achieve such a goal, this paper proposes and develops an uncertain information representation and processing method using belief function theory [29,30], which has been widely used in information fusion [31–34] and decision-making [35–37].
In short, the purpose of this study is to extend PLTS by incorporating belief function theory to make it more flexible in terms of expressing opinions. The innovations of this paper can be summarized as follows:
• The new concept of belief-based PLTS is first introduced, and then the composition of its belief interval is proposed, which includes the belief and plausibility functions. Several examples are provided to facilitate understanding of how the extended belief-based PLTS is used.
• The novel aggregation operator for belief-based PLTS is proposed using an OWA-based soft likelihood function, which can effectively describe DMs subjective attitudes, and the aggregation process is demonstrated using numerical examples. The aggregation operator is upgraded by considering the reliability of information sources, and the aggregation process is demonstrated using numerical examples.
• To compare different belief-based PLTSs, a novel possibility degree method is defined based on the belief interval of the singleton. An illustrative example is provided to demonstrate how to determine the sizes of different belief-based PLTSs.
• Based on the proposed belief-based PLTS and its corresponding operations, a multi-attribute decision-making framework is constructed and applied to emergency decision-making, and the detailed process is developed and explained step by step.
To illustrate the applicability of the proposed approach and verify its usefulness, a complete case study is presented based on the defined emergency decision methodology for selecting the best emergency risk education program. Decision results and comparative analysis are given to demonstrate the usefulness and effectiveness of the method proposed in this paper.
The study is carried out according to the following organization. In Section 2, we introduce some preliminaries, including probabilistic linguistic term set, belief function theory, and OWA operator. In Section 3, we explore extending PLTS with belief function theory, introducing basic concepts, aggregation operators, and comparison function. In Section 4, we provide a framework for multi-attribute decision making and apply it to emergency decision problems. In Section 5, we give a case study to demonstrate the usefulness and effectiveness of the proposed emergency decision method. In Section 6, we summarize this study and provide future research.
Some basic prerequisites are introduced in this section, including linguistic term set, probabilistic linguistic term set, belief function theory, and OWA operator.
In practical decision problems, the linguistic term set is very common and useful, because it is more in line with the DM’s habit of thinking . A subscript-symmetric linguistic term set is defined as , in which is a positive integer, and satisfies the following characteristics :
• indicates “positive” when , indicates “neutral” when , and indicates “negative” when ;
• iff ;
• the negation operator of is defined as .
2.2 Probabilistic Linguistic Term Set (PLTS)
Probabilistic linguistic term set was presented by Pang et al.  to address the weakness that all linguistic term sets in hesitant fuzzy linguistic term set (HFLTS) have the same weight. To demonstrate the shortcomings of HFLTS, and to emphasize the need to introduce PLTS, an illustrative example is presented.
Example 1. In a serious mine accident, the DMs need to evaluate the emergency plans. With regard to an emergency plan , 100 experts use the LTS to evaluate its feasibility, among which 80 consider it is “good”, and 10 believe it is “medium”, so this case could be expressed as
which is not appropriate for HFLTS.
From the above example it can be concluded that the assessment information is expressed not only as a set of possible linguistic terms but also as their corresponding probabilities. To effectively express the opinions of DMs, the probabilistic linguistic term set is proposed and defined as follows:
Definition 2.1.  Let be a LTS, a PLTS is denoted as
where means the probability of , and is the number of nonzero linguistic terms. Note that if , the normalization process is started. The normalized PLTS is defined as , where .
Based on the above definition, we can represent the evaluation information in Example 1 by a PLTS as . The comparison method of two PLTSs was provided in literature .
Definition 2.2.  Let two normalized PLTSs be represented as and , we have
• If , then ;
• If , then
– If , then ;
– If , then ,where E(L(p)) and are the score and deviation degree of normalized PLTS L(p) respectively, and their specific definitions are as follows.
Definition 2.3.  Let a normalized PLTS be , and be the subscript of , the score of L(p) can be calculated as
Definition 2.4.  Let a normalized PLTS be , be the subscript of , and , then the deviation degree of L(p) can be calculated as
The theory of belief function is an uncertain reasoning one initiated by Dempster  and inherited and developed by Shafer , therefore also known as Dempster-Shafer theory (DST). After half a century of development, the theory has been well developed and played an important role in a wide variety of fields, such as decision-making [40–42] and information fusion [43–45]. Suppose that the answer to the question of concern consists of a finite set of mutually exclusive elements, called frame of discernement (FoD), expressed as . The power set of has all of the subsets of , which is expressed as . A piece of evidence or information is defined as a mapping that satisfies and , also known as the basic belief assignment (BBA). Two significant concepts in the belief function theory are introduced below, namely, belief function and plausibility function.
Definition 2.5. The belief function of propositions is defined as
And we have and .
Definition 2.6. The plausibility function of propositions is defined as
where , and . forms the belief interval of proposition A [46,47].
OWA operator, originally introduced by Yager et al. [48–50], is an information aggregation method between the maximum and minimum operators.
Definition 2.7.  Let be a data set. The ordered weighted average operator is defined as
where is the weighting vector that satisfies and , and is the jth largest value in . Let be an index function, and is the index of jth largest value, then the OWA operator can be described as
Definition 2.8.  OWA operators are highly dependent on weighting vector . When weight distributions are special, several types of OWA operators are expressed as follows.
• , the OWA operator can be denoted as
• , the OWA operator can be denoted as
• , the OWA operator can be denoted as
• , the OWA operator can be denoted as
Definition 2.9. The weighting vector for OWA operator can be determined as
where f is a monotonic function that satisfies and .
In , a useful function , was given, and then a parameter was proposed to measure the degree of optimism satisfies . So for a given , the weighting vector can be determined as
Note that the larger attitudinal character is, the more optimistic the DM is.
3 Belief-Based Probabilistic Linguistic Term Sets
In this section, the belief-based probabilistic linguistic term sets are developed to overcome the issues of PLTSs by expressing and dealing with more uncertainty. We first give the basic concept of belief-based PLTSs, then provide the aggregation operator and finally define the score function in order to effectively complete the emergency decision-making process.
The probabilistic linguistic term set effectively solves the problem that the HFLTS cannot assign weight to the possible linguistic terms according to the DM’s preference. However, the PLTS has also been criticized for its limitations in decision-making . According to Definition 2.1, PLTS allows probability information to be incomplete, but other operations of the PLTS can only be performed after the probability is normalized. Allowing incomplete information expression is conducive to contain more uncertainty, but the normalization for subsequent calculations directly distributes the uncertainty to each linguistic term, which artificially removes some unknown uncertainties and weakens the effectiveness of the modeling uncertainty.
In complex decision-making, especially emergency problems, there may be various uncertainties, including randomness, vagueness and incompleteness . Randomness comes from non-deterministic conditions, ambiguity is caused by unclear classification of things, and incompleteness is caused by incomplete information. PLTS has some potential limitations in the expression of uncertainty, such as the aforementioned normalization problem, the inability to express simultaneity, and the lack of attribute values that are not considered. The belief function theory is a powerful tool for expressing and dealing with uncertainty, which has been widely declared and recognized by authoritative literature [29,34,35,46]. In order to solve the potential limitation of PLTS in MADM, the concept of belief-based PLTS is introduced.
For instance, in Example 1, the evaluation is represented by PLTS as , in which 10 experts have not expressed their opinions. This part of information can be regarded as unknown or uncertain. Based on belief function theory, the evaluation can be represented as
where S is FoD, indicating unknown or uncertain.
It is worth noting that incompleteness of information is also seen in another scenario in decision making. For example, in multi-attribute emergency decision making, the DM has completed the evaluation of the performance of an emergency plan under other attributes, but only in the aspect of attribute “response speed” is unknown. The traditional PLTS-based emergency decision making method rarely considers this situation, which leads to the interruption of the emergency procedure. Within the frame of belief function theory, the missing attribute value can be represented as . The ability of the belief function theory to express uncertain information can ensure that the decision can proceed even with the incomplete information.
Another motivation that we have to extend PLTS with belief function theory is to deal with a decision scenario where a DM is hesitant between two or more linguistic terms. In other words, the probability distribution on the single term no longer meets the expression requirements of DMs, but needs to allocate the belief on multiple subsets. Take the decision scenario in Example 1, where 80 experts evaluate it “good”, 10 evaluate it “medium”, and 10 hesitate between the terms “good” and “medium”. Obviously, PLTS is powerless to describe this case, but the theory of belief function can handle and represent such a case well with the expression
Through the above analysis and discussion, we identify some limitations of PLTS in expressing DMs’ views, and analyze the advantages of belief function theory in solving these problems. This is therefore an appropriate time to present the belief-based probabilistic linguistic term set as below:
Definition 3.1. Let be a LTS, a belief-based PLTS is defined as
where means the basic belief assignment (BBA) of proposition (a subset of LTS S). Note that the belief-based PLTS is denoted by for convenience.
Based on Definition 3.1, the evaluations in Eqs. (15) and (16) can be represented by belief-based PLTSs as and , which can also be written as and . According to the above definitions and examples, we can conclude that the belief-based PLTS has the following desired properties and advantages: (1) for PLTS with incomplete information, the operation of normalization is no longer necessary, and the uncertainty is represented by the universal set (i.e., LTS S, can also be interpreted as FoD), thus unifying the information expression mode based on linguistic term sets from the mathematical form (2) belief-based PLTS has the ability to capture DMs’ hesitations among possible linguistic terms, can more fully allow DMs to express opinions. It is worth noting that belief-based PLTS degrades to the traditional PLTS when the belief is all assigned to the singleton, i.e., it is backward compatible. Naturally, the belief function and plausibility function of belief-based PLTS can be defined.
Definition 3.2. The belief function of belief-based PLTS is defined as
And we have and .
Definition 3.3. The plausibility function of belief-based PLTS is defined as
where , and . So forms the belief interval of proposition A.
3.2 A Novel Aggregation Operator for Belief-Based PLTS
In decision problems, an aggregation operator is inevitably employed, which is an approach combining two or more single information expressions. The above manifests the advantages of the belief-based PLTS in representing uncertain information. To make it exert maximum in decision making, this section provides a novel aggregation operator for belief-based PLTS ground on soft likelihood function.
Soft likelihood function was originally proposed by Yager et al.  for calculating likelihood functions of probabilistic evidence in the context of forensic crime investigations. It breaks the limitations of traditional likelihood functions that use logical “anding” to aggregate elements, and has been extended to uncertain decision environments by D numbers , power OWA [55,56], and Pythagorean fuzzy sets [57,58]. With the flexible and reliable combination ability of soft likelihood function, in this section, an aggregation operator for belief-based PLTS is proposed.
Definition 3.4. Let be n belief-based PLTSs on . The likelihood value of is defined as
The above definition multiplies the belief of in each belief-based PLTS to determine the value of aggregated . It is easy to find that this definition is a logical “and”, that is, the aggregated depends on the minimum in each belief-based PLTS. This means, however, that no matter how many belief-based PLTSs have a large value, as long as in one belief-based PLTS, which is obviously not true in most applications. This kind of likelihood function is called hard likelihood function. To fix the defect, a soft likelihood function based on OWA operator has been developed , which is used to define the aggregation operator for belief-based PLTS.
Definition 3.5. Let be an index function of , and indicate the index of the kth largest belief of in . The product operation of the j largest belief of can be defined as
where is the kth largest belief of . Note that when , Eq. (21) degenerates into the hard likelihood function, i.e., . In addition, it is easy to tell that Prod is a monotonically decreasing function, i.e., if , then .
Definition 3.6. The OWA-based soft likelihood function of is defined as
where is the weighting vector that satisfies .
According to Definition 2.8, we analyze the OWA-based soft likelihood function corresponding to the special forms of weight distribution.
• For , . In this case, the aggregated belief of is equal to the largest one in .
• For , , which degenerates into the hard likelihood function.
• For , , which is a simple average of .
Definition 3.7. Based on Definition 2.9, the attitudinal character can be employed to calculate the soft likelihood value of . Therefore the aggregated belief of can be calculated as
To ensure that the aggregated result is still a belief-based PLTS, it needs to be normalized as
Therefore, the aggregation operator of n belief-based PLTSs can be defined as
To demonstrate the usage of the above-proposed aggregation operator, the following example is given.
Example 2. Let be a LTS, and five belief-based PLTSs on S be represented by Definition 3.1 as , , , , and . We take as an example to show the solution of OWA-based soft likelihood function.
According to Definition 3.5, the product of the j largest belief of can be calculated as , , , , .
Now we discuss the soft likelihood value of with different .
• When , based on Eq. (14), the weighting vector is , the soft likelihood value can be obtained by using Eq. (23) as .
• When , based on Eq. (14), the weighting vector is , the soft likelihood value can be obtained by using Eq. (23) as .
• When , based on Eq. (14), the weighting vector is , the soft likelihood value can be obtained by using Eq. (23) as .
According to the above process, soft likelihood values of other propositions (, , and ) under different can be calculated and normalized by using Eq. (31). The results are manifested in Table 1. The conclusion is that (1) when , , (2) when , , (3) when , .
3.3 The Aggregation Operator Considering the Reliability of Belief-Based PLTS
In practical decision problems, different belief-based PLTSs generally have different importance, i.e., weight, also known as reliability. The aggregation operator proposed in the previous section assumes that all belief-based PLTSs have the same reliability, which leads to certain limitations in decision making. To solve this problem, this section develops an aggregation operator considering reliability.
From the definitions in the previous section, it can be concluded that the advantages of soft likelihood function-based aggregation operator mainly come from two aspects: cumulative multiplication and OWA. Reliability will affect the order determination and weight vector generation.
Definition 3.8. The reliability of is denoted as that satisfies and . Let be an index function of , and indicate the index of the kth largest product of . The product operation of the j largest belief of is defined as
where is the kth largest belief of . Note that is also a monotonically decreasing function, i.e., if , then .
Definition 3.9. The OWA-based soft likelihood function of considering reliability is defined as
where and is the weighting vector.
Definition 3.10. To determine the OWA weighting vector, the sum of reliability of the j largest product is defined as
Consequently, the OWA weighting vector of the soft likelihood function considering reliability can be defined as
Note that if the reliability of all belief-based PLTSs is equal, i.e., , is reduced to .
Definition 3.11. The aggregation operator of n belief-based PLTSs considering reliability is defined as
where is defined as
The case in Example 2 is used to demonstrate the aggregation operator considering reliability.
Example 3. Let the reliability of be . Let’s take as an example, because , , , , and , so , , , , and . Based on Definition 3.8, the product of the j largest belief of can be calculated as , , , , and . According to Definitions 3.9 and 3.10, the soft likelihood values of with different are calculated considering reliability, and the results are manifested in Table 2.
According to the above process, soft likelihood values of other propositions (, , and ) under different can be calculated and normalized by using Definition 3.11. Finally, the conclusion is that (1) when , (2) when , (3) when , .
In Examples 2 and 3, we present several special cases to reflect the impact of parameter on the result of aggregation. In order to further highlight the effect, the experiment is carried of aggregation operator based on soft likelihood function (with ans without) considering reliability. As can be seen from Fig. 1, with the increase of , the belief of is decreasing while the other belief is increasing, from which we can see the influence of DM’s attitude on the aggregation result.
3.4 The Comparison between Belief-Based PLTSs
Belief-based PLTS is a new expression of uncertainty based on linguistic information. Due to its complexity, it is not easy to define score functions like PLTS. Therefore, by virtue of belief interval, we propose a novel possibility degree method for comparing belief-based PLTSs.
Definition 3.12. Let be a belief-based PLTS on , the belief interval of each singleton constitutes a belief interval vector of , expressed as
where means the belief interval of linguistic term .
Definition 3.13. Let be the belief interval vector of belief-based PLTS , the score of can be calculated as
Definition 3.14. Let and be two belief-based PLTSs, and be their belief interval vector, and the corresponding scores be and , the possibility degree for can be defined as
where and . The order relationship between and is denoted by .
Based on above definitions, under the assumption that , , are three belief-based PLTSs and their scores are , , , four theorems as below can be easily deduced.
Theorem 3.1. .
Theorem 3.2. iff .
Theorem 3.3. iff .
Theorem 3.4. . Particularly, .
The above theorems are obvious, so the proof is omitted. Definition 3.14 provides the possible degree calculation method for two belief-based PLTSs sorting, and we further extend it to the scenario of n belief-based PLTSs.
Definition 3.15. Let a set of belief-based PLTSs with n elements be represented as , and the score of is , . The possible degree matrix of can be obtained as , where , . Matrix contains the possible degree relations among all belief-based PLTSs, so sorting is transformed to solve the sorting vector problem of matrix P. Based on , the sort value of belief-based PLTS can be calculated as
which can be employed to sort .
The belief-based PLTSs in Example 2 are used to be sorted by using the above method in this section.
Example 4. We take as an example to demonstrate the calculation of its score of belief interval vector. Based on Definitions 3.2, 3.3 and 3.12, the belief interval vector of can be calculated as
Then the score of can be calculated by using Definition 3.13 as
So the scores of can be obtained as , , , and , respectively. The possible degree between two belief-based PLTSs is calculated based on Definition 3.14 below. Taking and as an example, can be obtained. Then the possible degree matrix can be obtained as
According to Definition 3.15, the sort value of the belief-based PLTSs can be calculated as , , , , and . So the order can be determined as .
4 Emergency Decision-Making Based on Belief-Based Probabilistic Linguistic Term Sets
In recent years, various unconventional emergencies have occurred frequently, which has become a major risk and disaster facing mankind. How to reduce the loss caused by a disaster and carry out effective rescue work based on emergency decision methods has become an important step in dealing with emergencies. In this section, we propose a multi-attribute decision making method for emergency decision based on the defined belief-based PLTS.
In a multi-attribute emergency decision making problem, the alternative set is , the attribute is represented as , the corresponding weight is , the set of decision experts is , with weight . Experts use belief-based PLTSs to evaluate alternatives under different attributes, and the resulting decision matrix is expressed as
where indicates the evaluation of alternative under attribute from expert .
4.2 Aggregation of Decision Information of Experts
After obtaining the experts’ decision matrices, the opinions need to be aggregated first. For the comprehensive performance of alternative under attribute , the evaluations provided by experts are aggregated by using the aggregation operator considering reliability proposed in Subsection 3.3. Note that the reliability here is the weight of the expert. According to Definition 3.11, the aggregated evaluation is calculated as , so the aggregated decision matrix is expressed as
where denotes the aggregated belief-based PLTS of .
4.3 Determination of Attribute Weight
The methods for determining attribute weights can be divided into the subjective, objective and combination weighting methods. The last method combines the characteristics of the former two, avoids the subjective arbitrariness, and captures the preference of DMs for the attribute. Therefore, based on the defined belief-based PLTS, this paper proposes a combination weighting method which aggregates both subjective and objective.
4.3.1 Determination of Subjective Weight Based on Belief-Based PLTSs
Humans are at a loss when asked to compare multiple attributes. But it is much easier for humans to compare pairs of attributes, an idea that has been repeated in the AHP and BWM approaches . Based on this consideration, we propose a method to determine the subjective weight of attributes.
Let the set of attributes be represented as . The pairwise comparison between and is expressed as a belief-based PLTS on . is the degree to which attribute is better than attribute , and if (subscript of ) indicates that is superior to , and vice versa. In particular, indicates that is equally important to , so the belief-based PLTS can be obtained as . Referring to literature [36,61], the concept of the negation of belief-based PLTSs is defined to express the comparison between and based on .
Definition 4.1. For a given belief-based PLTS on S, its negation is defined as
where is a singleton, and s is the focal element which has a cardinality greater than 1.
To demonstrate how to use the defined negation of belief-based PLTSs, the following example is given.
Example 5. The pairwise comparison between and is expressed by a belief-based PLTS on , then the comparison between and can be calculated in the following cases based on the above definition.
• Case 1: when , based on Eq. (41), we have .
• Case 2: when , based on Eq. (41), we have .
• Case 3: when , which is a special case, indicating that is of equal importance to . By using Eq. (41), we have , which means that belief-based PLTSs and have the same semantics in this case.
A pairwise comparison matrix can be obtained based on the above definitions, and the actual number of comparisons of the DM is . Then the score of belief interval vector of can be calculated by using Definition 3.13 as . To make all the values participating in the normalization positive, the scores will be shifted to ensure that the minimum lower limit of the interval values corresponding to each attribute is 0, which is expressed as . Then the support degree of attribute can be determined as . Therefore, the subjective weight of attribute is denoted by an interval value as .
4.3.2 Determination of Objective Weight Based on Interval Entropy Weight Method
The basic idea of the entropy weight method is to determine the objective weight according to the magnitude of the attribute variability. Generally, entropy is employed to reflect uncertainty. In decision-making problems, the lower the entropy, the greater the uncertainty, the greater the degree of variation of the attribute, the greater the degree of differentiation, and the greater the weight, and vice versa.
For decision matrix shown in Eq. (40), the score of belief interval vector of can be calculated by using Definition 3.13 as
To make all the values participating in the normalization positive, the scores will be shifted to ensure that the minimum lower limit of the interval values corresponding to each attribute is 0. The interval entropy weight method is carried out in the following steps.
Step 1: Normalize data. Since there may be negative numbers in the matrix, we first translate the data to get , and ensure that the minimum interval number under each attribute is 0. For each attribute, we compute the interval by linear normalization as
Step 2: Calculate the entropy of based on Shannon entropy as
Step 3: Calculate the diversification of as
Step 4: Obtain the objective weight as
4.3.3 Determination of Final Weight by Combining Subjectivity and Objectivity
The subjective weight and objective weight of attribute are obtained in Sections 4.3.1 and 4.3.2, then the comprehensive weight of attribute can be calculated by combining subjectivity and objectivity as
4.4 Decision Information Aggregation
Based on the attribute weights obtained in the previous subsection and the decision matrix in Eq. (40), the evaluations of alternative under different attributes needs to be aggregated based on the aggregation operator provided in Section 3.2. Since the attribute weight obtained is given in the form of intervals, we first propose a transformation method to map them to real values. The golden rule is an appropriate alternative for mapping interval numbers to real numbers, which has been used and developed in many literature . The interval weight conversion method based on the golden rule is defined below.
Definition 4.2. Let the interval weight of attribute be , the representation of can be defined based on golden rule as
where is the midpoint of the interval , and is the range of . denotes the attitude of DMs, means that the DM is positive, the closer it is to 1, the more positive the DM is, and vice versa, especially indicates that the DM is neutral.
The normalized weight representative value defined above can be considered as the reliability of the attribute, then different attribute values can be aggregated based on the aggregation operator in Section 3.2.
Definition 4.3. Let the belief-based PLTSs of alternative under different attributes be , and the corresponding reliability be , the aggregated evaluation of can be calculated as
4.5 Calculation of the Final Ranking of Alternatives
According to the aggregated results, the final ranking of alternatives can be calculated by comparing the corresponding belief-based PLTSs. Let the belief-based PLTSs of alternative be , the sort value of can be calculated based on Definition 4.3.1 as . The final ranking result of each alternative is determined according to the magnitude of .
The above proposed approach can be summarized as the emergency decision-making framework based on belief-based probabilistic linguistic term sets as shown in Fig. 2.
The emergency management bureau of municipality S (EMB-SM) is the agency responsible for the local government’s emergency management strategies. It coordinates and guides all districts in the city in responding to emergencies such as production safety, natural disasters, and comprehensive disaster prevention, mitigation and relief efforts. Citizen emergency education is an important step toward modernizing the emergency management system of municipality S. To this end, EMB-SM formulates three plans, namely, carrying out field exercises, developing emergency education apps, and disseminating emergency knowledge through propaganda manuals. In order to choose the most suitable of these three options, this section will demonstrate the effect of our proposed method based on a case study.
Based on the decision-making method in Section 4, the decision process of this case is shown as follows.
Three options (denoted as ) have been identified to educate citizens about disaster reduction, and the most suitable one needs to be selected. To select the best solution, three experts from EMB-SM (denoted as ) evaluate them based on four attributes [4,63] (denoted as = ‘influence’, = ‘coverage’, = ‘interestingness’, = ‘efficiency’}), and the results are recorded in the decision matrix, as shown in Table 3.
To measure the level of suitability of emergency education plans, let the LTS be Not at all, Not suitable for, General, Suitable for, Extremely suitable for}, and belief-based PLTSs are used to express the evaluations in this study.
5.1.2 Aggregation of Decision Matrices from Different Experts
The decision matrices of , and shown in Table 3 will be aggregated by using Definition 3.7, and in this case it is assumed that the experts have equal weight and . The aggregated results are manifested in Table 4, which is the basis for subsequent decisions.
5.1.3 Determination of Attribute Weight
According to Section 4.3, the determination of attribute weight is divided into two parts: subjective and objective. We first determine the subjective weight of the attribute. The pair comparison between attributes and () is provided by DMs, expressed as belief-based PLTSs. Based on Eq. (41), it is easy to calculate the negation of and , as shown in blue font in Table 5.
Based on Definition 3.13, the score of can be calculated as , which are shown in Table 6. The support degree of an attribute can be determined as , , , and . Then the subjective weight of attribute can be obtained as , , , and .
In what follows, the objective weight will be determined based on the interval entropy weight method. Based on the aggregated decision matrix in Table 4, the score of the evaluation of alternative under can be calculated by employing Definition 3.13 and the results are shown in Table 7. The entropy of each attribute can be calculated based on Eq. (44) as , , , and . Next, the diversification of each attribute can be calculated based on Eq. (45) as , , , and . Therefore, the objective weight of each attribute can be calculated by using Eq. (46) as , , , and . Finally, the comprehensive weight of each attribute can be calculated based on Eq. (47) by combining subjectivity and objectivity as , , , and .
5.1.4 Aggregation of Attribute Information
Based on the attribute weights obtained and the decision matrix in Table 4, the evaluations of each alternative under different attributes can be aggregated by the aggregation operator in Section 3.2. First, the golden rule is used to transform the interval weight, without loss of generality, let , the normalized weight is , , , and . The weight obtained can be considered as reliability, and the aggregated result of each alternative can be further calculated as , , .
5.1.5 Calculation of the Ranking of Alternatives
According to the aggregated results, the final ranking of alternatives can be calculated by comparing the corresponding belief-based PLTSs. The sort value of can be calculated based on Definition 4.3.1 as , , . Therefore, the alternatives are sorted as . Based on the method proposed in this study, it can be concluded that option is the most suitable for emergency education, followed by and . It was clear that option has the highest priority, but the relationship between and is less obvious. Note that APP is indeed selected as the platform in the actual emergency education in S City, which is consistent with the results obtained in this paper and can demonstrate the effectiveness of the proposed method.
The decision method proposed in this study involves several parameters, in OWA operator and in the golden rule, respectively. In this section, the influence of parameters on the decision will be analyzed.
The parameter in the golden rule will be analyzed first. The function of the golden rule is to convert the interval weights into single values, where the parameter reflects the attitude of DMs. As can be seen from Fig. 3a, as the attitude of DMs becomes optimistic, more weight is allocated to , while the weights of other attributes decrease.
In addition, we analyze the influence of parameters and on the decision result. In this case, we need to prioritize 3 options, and there are 6 possible results, respectively (1) , (2) , (3) , (4) , (5) and (6) . In Fig. 3b, we present the sorting result under the joint action of and . It can be found that under different parameters, there is only one sorting result, namely , indicating that in this case, the sorting result is insensitive to parameters.
To further verify the effectiveness of the decision making method proposed in this paper, we conduct a group of comparative experiments and analyze the experimental results. We choose several decision methods with PLTS as the information expression to apply in the case in this paper. Since the data type in this study is belief-based PLTS, to adapt it to PLTS environment, we propose the following conversion method.
Definition 5.1. Let be a belief-based PLTS on , it can be converted to a PLTS as
where denotes the cardinality of .
Based on Definition 5.1, the belief-based PLTSs in Table 3 can be converted to PLTSs, as shown in Table 8. We will compare and analyze the different methods from the following aspects: aggregation operator, score function, attribute weight, applications, and ranking. The results of the comparison are shown in Table 9.
Through comparison, it can be seen that the advantages of the proposed method in this paper are as follows. First, the scope of expression of probabilistic linguistic information is extended, and the related operations that can be used in decision-making, including the aggregation operator and score functions, are proposed. Further, a decision-making framework is developed. In addition, in the determination of attribute weights, we take both subjective and objective aspects into consideration to avoid deviations caused by subjective weighting and make use of all decision information. Although other methods have their own unique characteristics, the superiority of the method presented in this study is quite obvious. From the ranking of the results, all methods suggest that option should be given the highest priority. Except for methods  and , is superior to ; all other methods rank last. The above findings also verify the usefulness of our approach. In conclusion, this study offers many unique advantages in terms of its methods and results.
6 Conclusions and Future Directions
Through a careful analysis of the relevant literature, we found that the traditional PLTS method has deficiencies in its expression of uncertain information. To overcome this limitation, we incorporated the belief function theory into PLTS to construct belief-based PLTS and proposed a corresponding decision analysis approach that is able to address the aforementioned deficiencies through methods such as probability allocation on multiple linguistic terms. We found that the OWA-based soft likelihood function can be employed to define the aggregation operator of belief-based PLTS, which has the advantage of being able to fully describe decision makers’ attitudes. In the actual decision-making environment, belief-based PLTSs are usually reliable, so we also put forward an aggregation operator that considers reliability. We found that the belief interval can express more complete linguistic information, so we defined a score function that uses the belief interval to compare different belief-based PLTSs. According to the results, a multi-attribute decision-making framework was constructed for linguistic environments that is suitable for emergency decisions and can potentially be applied to other areas. Finally, an example was given to demonstrate the usefulness and effectiveness of the proposed method.
In future research, we aim to further develop these theories and methods based on belief-based PLTS. First, we will study a variety of operations to further refine their mathematical forms. Second, more methods, such as the analytic network process and the best-worst method, will be used to determine attribute weights in the decision-making framework. Third, the decision problem presented by the heterogeneous attributes of the belief-based PLTS environment will be further studied. Finally, attribute interactivity should be taken into account in future research.
Funding Statement: The work is partially supported by National Social Science Foundation of China (Grant No. 17ZDA030).
Conflicts of Interest: The authors declare that they have no conflicts of interest to report regarding the present study.
- Xu, X., Wang, L., Chen, X., & Liu, B. (2019). Large group emergency decision-making method with linguistic risk appetites based on criteria mining. Knowledge-Based Systems, 182, 104849. [Google Scholar] [CrossRef]
- Hao, Z., Xu, Z., Zhao, H., & Fujita, H. (2017). A dynamic weight determination approach based on the intuitionistic fuzzy Bayesian network and its application to emergency decision making. IEEE Transactions on Fuzzy Systems, 26(4), 1893-1907. [Google Scholar] [CrossRef]
- Karanci, A. N., Aksit, B., & Dirik, G. (2005). Impact of a community disaster awareness training program in Turkey: Does it influence hazard-related cognitions and preparedness behaviors. Social Behavior and Personality: An International Journal, 33(3), 243-258. [Google Scholar] [CrossRef]
- Tsai, M. H., Chang, Y. L., Shiau, J. S., & Wang, S. M. (2020). Exploring the effects of a serious game-based learning package for disaster prevention education: The case of battle of flooding protection. International Journal of Disaster Risk Reduction, 43, 101393. [Google Scholar] [CrossRef]
- Sun, B., Qi, C., Ma, W., Wang, T., & Zhang, L. (2020). Variable precision diversified attribute multigranulation fuzzy rough set-based multi-attribute group decision making problems. Computers & Industrial Engineering, 142, 106331. [Google Scholar] [CrossRef]
- Xu, X., Zhang, Q., & Chen, X. (2020). Consensus-based non-cooperative behaviors management in large-group emergency decision-making considering experts’ trust relations and preference risks. Knowledge-Based Systems, 190, 105108. [Google Scholar] [CrossRef]
- Zeng, S., Chen, S. M., & Fan, K. Y. (2020). Interval-valued intuitionistic fuzzy multiple attribute decision making based on nonlinear programming methodology and topsis method. Information Sciences, 506, 424-442. [Google Scholar] [CrossRef]
- Ding, W., Wang, J., Wang, J. (2020). Multigranulation consensus fuzzy-rough based attribute reduction. Knowledge-Based Systems, 105945. DOI 10.1016/j.knosys.2020.105945. [CrossRef]
- Zavadskas, E. K., Bausys, R., Lescauskiene, I., & Usovaite, A. (2021). Multimoora under interval-valued neutrosophic sets as the basis for the quantitative heuristic evaluation methodology hebin. Mathematics, 9(1), 66. [Google Scholar] [CrossRef]
- Meng, F., Chen, S. M., & Tang, J. (2020). Group decision making based on acceptable multiplicative consistency of hesitant fuzzy preference relations. Information Sciences, 524, 77-96. [Google Scholar] [CrossRef]
- Garg, H. (2020). Linguistic interval-valued pythagorean fuzzy sets and their application to multiple attribute group decision-making process. Cognitive Computation, 12(6), 1313-1337. [Google Scholar] [CrossRef]
- Li, P., & Wei, C. (2019). An emergency decision-making method based on ds evidence theory for probabilistic linguistic term sets. International Journal of Disaster Risk Reduction, 37, 101178. [Google Scholar] [CrossRef]
- Pang, Q., Wang, H., & Xu, Z. (2016). Probabilistic linguistic term sets in multi-attribute group decision making. Information Sciences, 369, 128-143. [Google Scholar] [CrossRef]
- Liao, H., & Wu, X. (2020). DNMA: A double normalization-based multiple aggregation method for multi-expert multi-criteria decision making. Omega, 94, 102058. [Google Scholar] [CrossRef]
- Jiang, L., & Liao, H. (2020). Mixed fuzzy least absolute regression analysis with quantitative and probabilistic linguistic information. Fuzzy Sets and Systems, 387, 35-48. [Google Scholar] [CrossRef]
- Nie, R. X., & Wang, J. Q. (2020). Prospect theory-based consistency recovery strategies with multiplicative probabilistic linguistic preference relations in managing group decision making. Arabian Journal for Science and Engineering, 45(3), 2113-2130. [Google Scholar] [CrossRef]
- Wang, X., Wang, J., & Zhang, H. (2019). Distance-based multicriteria group decision-making approach with probabilistic linguistic term sets. Expert Systems, 36(2), e12352. [Google Scholar] [CrossRef]
- Wei, G., Wei, C., Wu, J., & Wang, H. (2019). Supplier selection of medical consumption products with a probabilistic linguistic mabac method. International Journal of Environmental Research and Public Health, 16(24), 5082. [Google Scholar] [CrossRef]
- Li, B., Zhang, Y., & Xu, Z. (2020). The medical treatment service matching based on the probabilistic linguistic term sets with unknown attribute weights. International Journal of Fuzzy Systems, 22, 1487-1505. [Google Scholar] [CrossRef]
- Liang, D., Dai, Z., Wang, M., & Li, J. (2020). Web celebrity shop assessment and improvement based on online review with probabilistic linguistic term sets by using sentiment analysis and fuzzy cognitive map. Fuzzy Optimization and Decision Making, 19, 561-586. [Google Scholar] [CrossRef]
- Feng, X., Zhang, Q., & Jin, L. (2019). Aggregation of pragmatic operators to support probabilistic linguistic multi-criteria group decision-making problems. Soft Computing, 24, 7735-7755. [Google Scholar]
- Xie, W., Xu, Z., Ren, Z., Herrera-Viedma, E. (2020). A new multi-criteria decision model based on incomplete dual probabilistic linguistic preference relations. Applied Soft Computing, 106237. DOI 10.1016/j.asoc.2020.106237. [CrossRef]
- Yang, J. B., Wang, Y. M., Xu, D. L., & Chin, K. S. (2006). The evidential reasoning approach for mada under both probabilistic and fuzzy uncertainties. European Journal of Operational Research, 171(1), 309-343. [Google Scholar] [CrossRef]
- Fang, R., Liao, H., Yang, J. B., & Xu, D. L. (2021). Generalised probabilistic linguistic evidential reasoning approach for multi-criteria decision-making under uncertainty. Journal of the Operational Research Society, 72(1), 130-144. [Google Scholar] [CrossRef]
- Lin, M., Xu, Z., Zhai, Y., & Yao, Z. (2017). Multi-attribute group decision-making under probabilistic uncertain linguistic environment. Journal of the Operational Research Society, 68, 1-15. [Google Scholar]
- Mi, X., Liao, H., Wu, X., & Xu, Z. (2020). Probabilistic linguistic information fusion: A survey on aggregation operators in terms of principles, definitions, classifications, applications, and challenges. International Journal of Intelligent Systems, 35(3), 529-556. [Google Scholar] [CrossRef]
- Liao, H., Mi, X., & Xu, Z. (2020). A survey of decision-making methods with probabilistic linguistic information: Bibliometrics, preliminaries, methodologies, applications and future directions. Fuzzy Optimization and Decision Making, 19(1), 81-134. [Google Scholar] [CrossRef]
- Fei, L., & Feng, Y. (2021). Modeling interactive multiattribute decision-making via probabilistic linguistic term set extended by Dempster–Shafer theory. International Journal of Fuzzy Systems, 23(2), 599-613. [Google Scholar] [CrossRef]
- Dempster, A. P. (1967). Upper and lower probabilities induced by a multivalued mapping. Annals of Mathematics and Statistics, 38(2), 325-339. [Google Scholar] [CrossRef]
- Shafer, G. (1976). A mathematical theory of evidence. Princeton: Princeton University Press.
- Wu, X., Liao, H., Zavadskas, E. K., & Antuchevičienė, J. (2022). A probabilistic linguistic vikor method to solve mcdm problems with inconsistent criteria for different alternatives. Technological and Economic Development of Economy, 28(2), 559-580. [Google Scholar] [CrossRef]
- Deng, Y. (2020). Information volume of mass function. International Journal of Computers, Communications & Control, 15(6), [Google Scholar] [CrossRef]
- Xiao, F. (2021). CEQD: A complex mass function to predict interference effects. IEEE Transactions on Cybernetics, 52(8), 7402-7414. [Google Scholar]
- Deng, Y. (2020). Uncertainty measure in evidence theory. Science China Information Sciences, 63(11), 1-19. [Google Scholar] [CrossRef]
- Xiao, F. (2021). CaFtR: A fuzzy complex event processing method. International Journal of Fuzzy Systems, 1–14. DOI 10.1007/s40815–021–01118–6. [CrossRef]
- Deng, X., & Jiang, W. (2020). On the negation of a Dempster–Shafer belief structure based on maximum uncertainty allocation. Information Sciences, 516, 346-352. [Google Scholar] [CrossRef]
- Zhang, H., Jiang, W., & Deng, X. (2020). Data-driven multi-attribute decision-making by combining probability distributions based on compatibility and entropy. Applied Intelligence, 50(11), 4081-4093. [Google Scholar] [CrossRef]
- Mahmood, T., & Ali, Z. (2020). Aggregation operators and vikor method based on complex q-rung orthopair uncertain linguistic informations and their applications in multi-attribute decision making. Computational and Applied Mathematics, 39(4), 1-44. [Google Scholar] [CrossRef]
- Xu, Z. (2005). Deviation measures of linguistic preference relations in group decision making. Omega, 33(3), 249-254. [Google Scholar] [CrossRef]
- Deng, Y. (2022). Random permutation set. International Journal of Computers Communications & Control, 17(1), 4542. [Google Scholar] [CrossRef]
- Ding, W., Lin, C. T., Liew, A. W. C., Triguero, I., & Luo, W. (2020). Current trends of granular data mining for biomedical data analysis. Information Sciences, 510, 341-343. [Google Scholar] [CrossRef]
- Fang, R., Liao, H., & Mardani, A. (2022). How to aggregate uncertain and incomplete cognitive evaluation information in lung cancer treatment plan selection? A method based on dempster-shafer theory. Information Sciences, 603, 222-243. [Google Scholar] [CrossRef]
- Qiang, C., Deng, Y., & Cheong, K. H. (2022). Information fractal dimension of mass function. Fractals, 30(6), 2250110. [Google Scholar] [CrossRef]
- Zhou, Q., Deng, Y., & Pedrycz, W. (2022). Information dimension of Galton board. Fractals, 30(4), 2250079. [Google Scholar] [CrossRef]
- Liu, R., Fei, L., & Mi, J. (2022). An evidential multimoora approach to assessing disaster risk reduction education strategies under a heterogeneous linguistic environment. International Journal of Disaster Risk Reduction, 78, 103114. [Google Scholar] [CrossRef]
- Denoeux, T., & Shenoy, P. P. (2020). An interval-valued utility theory for decision making with dempster-shafer belief functions. International Journal of Approximate Reasoning, 124, 194-216. [Google Scholar] [CrossRef]
- Deng, Z., & Wang, J. (2020). A novel decision probability transformation method based on belief interval. Knowledge-Based Systems, 208, 106427. [Google Scholar] [CrossRef]
- Yager, R. R. (1988). On ordered weighted averaging aggregation operators in multicriteria decisionmaking. IEEE Transactions on Systems, Man, and Cybernetics, 18(1), 183-190. [Google Scholar] [CrossRef]
- Jin, L., Mesiar, R., Kalina, M., & Yager, R. R. (2020). Canonical form of ordered weighted averaging operators. Annals of Operations Research, 295(2), 605-631. [Google Scholar] [CrossRef]
- Jin, L., Mesiar, R., & Yager, R. (2020). Parameterized preference aggregation operators with improved adjustability. International Journal of General Systems, 49(8), 843-855. [Google Scholar] [CrossRef]
- Yager, R. R. (1996). Quantifier guided aggregation using owa operators. International Journal of Intelligent Systems, 11(1), 49-73. [Google Scholar] [CrossRef]
- Klir, G. J., Wierman, M. J. (2013). Uncertainty-based information: Elements of generalized information theory, vol. 15. New York: Physica.
- Yager, R. R., Elmore, P., & Petry, F. (2017). Soft likelihood functions in combining evidence. Information Fusion, 36, 185-190. [Google Scholar] [CrossRef]
- Zhu, R., Liu, Q., Huang, C., & Kang, B. (2022). Z-ACM: An approximate calculation method of z-numbers for large data sets based on kernel density estimation and its application in decision-making. Information Sciences, 610, 440-471. [Google Scholar] [CrossRef]
- Flores-Sosa, M., Avilés-Ochoa, E., Merigó, J. M., & Yager, R. R. (2021). Volatility garch models with the ordered weighted average (OWA) operators. Information Sciences, 565, 46-61. [Google Scholar] [CrossRef]
- Mi, X., Tian, Y., & Kang, B. (2020). A modified soft-likelihood function based on powa operator. International Journal of Intelligent Systems, 35(5), 869-890. [Google Scholar] [CrossRef]
- Fei, L., Wang, Y. (2022). An optimization model for rescuer assignments under an uncertain environment by using dempster-shafer theory. Knowledge-Based Systems, 109680. DOI 10.1016/j.knosys.2022.109680. [CrossRef]
- Fei, L., & Feng, Y. (2021). A dynamic framework of multi-attribute decision making under pythagorean fuzzy environment by using Dempster–Shafer theory. Engineering Applications of Artificial Intelligence, 101, 104213. [Google Scholar] [CrossRef]
- Xu, Z., & Da, Q. (2003). Possibility degree method for ranking interval numbers and its application. Journal of Systems Engineering, 18(1), 67-70. [Google Scholar]
- Lin, M., Huang, C., Xu, Z., & Chen, R. (2020). Evaluating iot platforms using integrated probabilistic linguistic mcdm method. IEEE Internet of Things Journal, 7(11), 11195-11208. [Google Scholar] [CrossRef]
- Yager, R. R. (2014). On the maximum entropy negation of a probability distribution. IEEE Transactions on Fuzzy Systems, 23(5), 1899-1902. [Google Scholar] [CrossRef]
- Fei, L. (2019). On interval-valued fuzzy decision-making using soft likelihood functions. International Journal of Intelligent Systems, 34(7), 1631-1652. [Google Scholar] [CrossRef]
- Kraiger, K., Ford, J. K., & Salas, E. (1993). Application of cognitive, skill-based, and affective theories of learning outcomes to new methods of training evaluation. Journal of Applied Psychology, 78(2), 311-328. [Google Scholar] [CrossRef]
- Lei, F., Wei, G., Lu, J., Wu, J., & Wei, C. (2019). Gra method for probabilistic linguistic multiple attribute group decision making with incomplete weight information and its application to waste incineration plants location problem. International Journal of Computational Intelligence Systems, 12(2), 1547-1556. [Google Scholar] [CrossRef]