Concept learning via granular computing: A cognitive viewpoint · 2014. 12. 18. · 1 3 Concept...

21
1 3 Concept learning via granular computing: A cognitive viewpoint 4 5 6 Jinhai Li Q1 a,, Changlin Mei b , Weihua Xu c , Yuhua Qian d 7 a Faculty of Science, Kunming University of Science and Technology, Kunming 650500, Yunnan, PR China 8 b School of Mathematics and Statistics, Xi’an Jiaotong University, Xi’an 710049, Shaanxi, PR China 9 c School of Mathematics and Statistics, Chongqing University of Technology, Chongqing 400054, PR China 10 d Key Laboratory of Computational Intelligence and Chinese Information Processing of Ministry of Education, School of Computer and Information 11 Technology, Shanxi University, Taiyuan 030006, Shanxi, PR China 12 13 15 article info 16 Article history: 17 Received 28 April 2014 18 Received in revised form 16 November 2014 19 Accepted 3 December 2014 20 Available online xxxx 21 Keywords: 22 Concept learning 23 Granular computing 24 Cognitive computing 25 Rough set theory 26 Cognitive computing system 27 Set approximation 28 29 abstract 30 Concepts are the most fundamental units of cognition in philosophy and how to learn 31 concepts from various aspects in the real world is the main concern within the domain 32 of conceptual knowledge presentation and processing. In order to improve efficiency and 33 flexibility of concept learning, in this paper we discuss concept learning via granular com- 34 puting from the point of view of cognitive computing. More precisely, cognitive mecha- 35 nism of forming concepts is analyzed based on the principles from philosophy and 36 cognitive psychology, including how to model concept-forming cognitive operators, define 37 cognitive concepts and establish cognitive concept structure. Granular computing is then 38 combined with the cognitive concept structure to improve efficiency of concept learning. 39 Furthermore, we put forward a cognitive computing system which is the initial environ- 40 ment to learn composite concepts and can integrate past experiences into itself for enhanc- 41 ing flexibility of concept learning. Also, we investigate cognitive processes whose aims are 42 to deal with the problem of learning one exact or two approximate cognitive concepts from 43 a given object set, attribute set or pair of object and attribute sets. 44 Ó 2014 Published by Elsevier Inc. 45 46 47 48 1. Introduction 49 Cognitive computing is the development of computer systems modeled on the human brain [38]. It embodies major nat- 50 ural intelligence behaviors of the brain including perception, attention, thinking, etc. As an emerging paradigm of intelligent 51 computing methodologies, cognitive computing has the characteristic of integrating past experiences into itself [22]. Now- 52 adays, this theory has become an interdisciplinary research and application field and absorbed methods from psychology, 53 information theory, mathematics and so on [37,39]. 54 Concepts are the most fundamental units of cognition in philosophy and they carry certain meanings in almost all cogni- 55 tive processes such as inference, learning and reasoning [37,50]. In this sense, a concept is in fact a cognitive unit to identify 56 and/or model a real-world concrete entity and a perceived-world abstract subject. As is well known, how to efficiently learn 57 concepts from various aspects in the real world is the main concern within the domain of conceptual knowledge presenta- 58 tion and processing. Up to now, for meeting the requirements of data analysis and knowledge manipulation, all kinds of con- 59 cepts which carry certain meanings have been proposed such as abstract concepts [37], Wille’s concepts [42], object-oriented 60 concepts [48,49] and property-oriented concepts [9]. http://dx.doi.org/10.1016/j.ins.2014.12.010 0020-0255/Ó 2014 Published by Elsevier Inc. Corresponding author. Tel./fax: +86 0871 65916703. E-mail addresses: [email protected] (J. Li Q1 ), [email protected] (C. Mei), [email protected] (W. Xu), [email protected] (Y. Qian). Information Sciences xxx (2014) xxx–xxx Contents lists available at ScienceDirect Information Sciences journal homepage: www.elsevier.com/locate/ins INS 11294 No. of Pages 21, Model 3G 16 December 2014 Please cite this article in press as: J. Li Q1 et al., Concept learning via granular computing: A cognitive viewpoint, Inform. Sci. (2014), http:// dx.doi.org/10.1016/j.ins.2014.12.010

Transcript of Concept learning via granular computing: A cognitive viewpoint · 2014. 12. 18. · 1 3 Concept...

Page 1: Concept learning via granular computing: A cognitive viewpoint · 2014. 12. 18. · 1 3 Concept learning via granular computing:A cognitive viewpoint 4 5 6 Q1 Jinhai Li a,⇑, Changlin

1

3

4

5

6 Q1

789

1011

1213

1 5

1617181920

2122232425262728

2 9

47

48

49

50

51

52

53

54

55

56

57

58

59

60

Q1

Information Sciences xxx (2014) xxx–xxx

INS 11294 No. of Pages 21, Model 3G

16 December 2014

Q1

Contents lists available at ScienceDirect

Information Sciences

journal homepage: www.elsevier .com/locate / ins

Concept learning via granular computing: A cognitive viewpoint

http://dx.doi.org/10.1016/j.ins.2014.12.0100020-0255/� 2014 Published by Elsevier Inc.

⇑ Corresponding author. Tel./fax: +86 0871 65916703.E-mail addresses: [email protected] (J. Li), [email protected] (C. Mei), [email protected] (W. Xu), [email protected] (Y. Qian).

Please cite this article in press as: J. Li et al., Concept learning via granular computing: A cognitive viewpoint, Inform. Sci. (2014)dx.doi.org/10.1016/j.ins.2014.12.010

Jinhai Li a,⇑, Changlin Mei b, Weihua Xu c, Yuhua Qian d

a Faculty of Science, Kunming University of Science and Technology, Kunming 650500, Yunnan, PR Chinab School of Mathematics and Statistics, Xi’an Jiaotong University, Xi’an 710049, Shaanxi, PR Chinac School of Mathematics and Statistics, Chongqing University of Technology, Chongqing 400054, PR Chinad Key Laboratory of Computational Intelligence and Chinese Information Processing of Ministry of Education, School of Computer and InformationTechnology, Shanxi University, Taiyuan 030006, Shanxi, PR China

a r t i c l e i n f o a b s t r a c t

30313233343536373839404142

Article history:Received 28 April 2014Received in revised form 16 November 2014Accepted 3 December 2014Available online xxxx

Keywords:Concept learningGranular computingCognitive computingRough set theoryCognitive computing systemSet approximation

434445

Concepts are the most fundamental units of cognition in philosophy and how to learnconcepts from various aspects in the real world is the main concern within the domainof conceptual knowledge presentation and processing. In order to improve efficiency andflexibility of concept learning, in this paper we discuss concept learning via granular com-puting from the point of view of cognitive computing. More precisely, cognitive mecha-nism of forming concepts is analyzed based on the principles from philosophy andcognitive psychology, including how to model concept-forming cognitive operators, definecognitive concepts and establish cognitive concept structure. Granular computing is thencombined with the cognitive concept structure to improve efficiency of concept learning.Furthermore, we put forward a cognitive computing system which is the initial environ-ment to learn composite concepts and can integrate past experiences into itself for enhanc-ing flexibility of concept learning. Also, we investigate cognitive processes whose aims areto deal with the problem of learning one exact or two approximate cognitive concepts froma given object set, attribute set or pair of object and attribute sets.

� 2014 Published by Elsevier Inc.

46

1. Introduction

Cognitive computing is the development of computer systems modeled on the human brain [38]. It embodies major nat-ural intelligence behaviors of the brain including perception, attention, thinking, etc. As an emerging paradigm of intelligentcomputing methodologies, cognitive computing has the characteristic of integrating past experiences into itself [22]. Now-adays, this theory has become an interdisciplinary research and application field and absorbed methods from psychology,information theory, mathematics and so on [37,39].

Concepts are the most fundamental units of cognition in philosophy and they carry certain meanings in almost all cogni-tive processes such as inference, learning and reasoning [37,50]. In this sense, a concept is in fact a cognitive unit to identifyand/or model a real-world concrete entity and a perceived-world abstract subject. As is well known, how to efficiently learnconcepts from various aspects in the real world is the main concern within the domain of conceptual knowledge presenta-tion and processing. Up to now, for meeting the requirements of data analysis and knowledge manipulation, all kinds of con-cepts which carry certain meanings have been proposed such as abstract concepts [37], Wille’s concepts [42], object-orientedconcepts [48,49] and property-oriented concepts [9].

, http://

Page 2: Concept learning via granular computing: A cognitive viewpoint · 2014. 12. 18. · 1 3 Concept learning via granular computing:A cognitive viewpoint 4 5 6 Q1 Jinhai Li a,⇑, Changlin

61

62

63

64

65

66

67

68

69

70

71

72

73

74

75

76

77

78

79

80

81

82

83

84

85

86

87

88

89

90

91

92

93

94

95

96

97

98

99

100

101

102

103

104

105

106

107

108

109

110

111

112

113

114

115

116

117

118

119

120

121

2 J. LiQ1 et al. / Information Sciences xxx (2014) xxx–xxx

INS 11294 No. of Pages 21, Model 3G

16 December 2014

Q1

In philosophy, a concept can generally be identified by its extension part (often called extent) and intension part (oftencalled intent) which can be determined with each other [9,37,42,48,49]. The extent of a concept is the set of all objects orinstances that the concept denotes, and the intent of a concept is the set of attributes or properties that a concept connotes[37,42]. In order to reflect the relationship of specialization and generalization among concepts, a structure of concepts canfurther be built by defining a partial order on the concepts under consideration. By this means, the obtained concept struc-ture often forms a complete lattice no matter what kinds of meanings we give to the concepts, and hence some scholars fromthe community of formal concept analysis [42] called it certain concept lattice instead. For example, different concept struc-tures have been proposed by specifying certain meanings of the concepts in the real world such as Wille’s concept lattice[42], object-oriented concept lattice [48,49], property-oriented concept lattice [9], AFS-concept lattice [40], power concept lat-tice [11] and others [6,15,16,20,21]. Note that these certain concept structures or lattices establish rigorous mathematicalmodels and provide formal semantics for data analysis in practice. In other words, meanings of real-world concrete entitiescan be represented and semantics of abstract subjects can be embodied by these certain concept structures. All in all, learn-ing concepts (sometimes including their corresponding structure) has been investigated from various aspects. However, thecurrent paper focuses on this issue from a novel aspect (i.e., a cognitive viewpoint).

Note that, generally speaking, learning a certain concept structure from a given dataset is computationally expensivewhen its size is large. The reason is that the number of concepts in the structure will increase exponentially in the worstcase. Considering that granular computing gives rise to processing that is less time demanding than the one required whendealing with detailed numeric processing [2–4]. Information granule, the basic notion in the theory of granular computingwhich can broadly be viewed as a collection of information granules and the area of intelligent computing revolving aroundthem [26], was introduced into Wille’s concept lattice as an attempt to decrease computation time [43]. In a general sense,by information granule, one regards a collection of elements drawn together by their closeness (resemblance, proximity,functionality, etc.) articulated in terms of some useful spatial, temporal, or functional relationships [52,53]. In fact, informa-tion granules are intuitively appealing constructs, which play a pivotal role in human cognitive and decision-making activ-ities [24]. It is also worth stressing that information granules permeate almost all human endeavors [2–5,24,25,27,53,54]. Forexample, information granules have been studied in rough set theory [17,23,29,30,35,44,46,47] extensively which is consid-ered as one of the approaches of granular computing, and applied in formal concept analysis [10], evidence analysis [33], etc.Recently, studies on combination of granular computing with formal concept analysis have been made by several researchers[7,12,19,31,41,43,45,56]. And what is particularly worth mentioning is that information granules in formal concept analysismean granular concepts [43] which are the basic concepts used to deduce others. As a matter of fact, in order to improveefficiency sharply, learning concept structure indeed needs the idea of granular computing no matter how we specify thecertain meanings of the concepts in the real world, no exception to cognitive concepts to be discussed in the current paper.

Note that the aforementioned concepts were learned using constructive methods, which means that the concepts wereformed by defining certain concept-forming operators [9,11,16,40,42,48,49]. In the meanwhile, axiomatic methods are alsoneeded in terms of learning methodologies in which concepts are learned by establishing axiomatic systems (i.e., sets of axi-oms). To the best of our knowledge, axiomatic systems of concept learning were often called concept systems instead. Inrecent years, there have been several concept systems proposed for certain concept learning such as cognitive system [45],concept granular computing system [31], generalized concept system [19] and generalized dual concept system [18]. At the sametime, it should be pointed out that these concept systems can also be used to learn the certain concepts which were obtainedby using the constructive methods in [9,11,16,40,42,48,49]. Compared with constructive methods, axiomatic methods try tolook beyond appearance for the essence of concept learning. However, the existing concept systems cannot integrate pastexperiences into itself. In other words, they are not able to deal with e.g., dynamic data and thereby are lack of flexibilityfor data analysis in practice. Besides, no explanation was provided to the background of the axioms of the existing conceptsystems, which means that they are too abstract to be understood. But, as far as we know, it is possible to solve these prob-lems to some extent by means of concept learning based on cognitive computing because this kind of computing approachhas the characteristic of integrating past experiences into itself and the background of simulating intelligence behaviors ofthe brain including perception, attention and learning.

To sum up, concept learning deserves to be studied based on granular computing from the perspective of cognitive com-puting, which may be beneficial to understanding and describing human cognitive processes in a conceptual knowledge way.Our current study mainly focuses on this issue. More precisely, the problems to be discussed are analysis of cognitive mech-anism of forming concepts, integration of granular computing into cognitive concept structure, establishment of cognitivecomputing system, and implementation of cognitive processes. Note that the proposed cognitive computing system not onlycan integrate past experiences into itself by recursive thinking, but also is easy to be understood because cognitive mecha-nism of forming concepts is analyzed in advance based on the principles from philosophy and cognitive psychology.

The rest of this paper is organized as follows. In Section 2, cognitive mechanism of forming concepts is analyzed based onthe principles from philosophy and cognitive psychology, including how to define concept-forming cognitive operators, con-struct cognitive concepts and induce their hierarchical structure. In Section 3, granular computing is integrated into theinduced cognitive concept structure. In Section 4, we put forward a cognitive computing system in which the notions of acognitive computing state, an object-oriented cognitive computing state and an attribute-oriented cognitive computing stateare proposed. In Section 5, we investigate the cognitive processes whose aims are to deal with the problem of learning oneexact or two approximate cognitive concepts from a given object set, attribute set or pair of object and attribute sets. In Sec-tion 6, we discuss the main differences and relations between the proposed concept learning approach and the existing ones,

Please cite this article in press as: J. Li et al., Concept learning via granular computing: A cognitive viewpoint, Inform. Sci. (2014), http://dx.doi.org/10.1016/j.ins.2014.12.010

Page 3: Concept learning via granular computing: A cognitive viewpoint · 2014. 12. 18. · 1 3 Concept learning via granular computing:A cognitive viewpoint 4 5 6 Q1 Jinhai Li a,⇑, Changlin

122

123

124

125

126

127

128

129

130

131

132

133

134135137137

138140140

141

142

143

144

145

146147149149

150

151

152

153

154

155

156157159159

160

161

162

163

164

165

166

167

168

169

Table 1A SARS dataset.

Patient Fever Cough Headache Difficulty breathing

1 Yes Yes No Yes2 No Yes No Yes3 No No Yes No4 Yes No Yes No

J. LiQ1 et al. / Information Sciences xxx (2014) xxx–xxx 3

INS 11294 No. of Pages 21, Model 3G

16 December 2014

Q1

and give explanations on some obtained results in our study. The paper is then concluded with a brief summary and an out-look for further research.

2. Cognitive mechanism of forming concepts

In this section, we analyze cognitive mechanism of forming concepts based on the principles from philosophy and cog-nitive psychology.

Let U be an object set and A be an attribute set. We denote the power sets of U and A by 2U and 2A, respectively. Here-inafter, suppose L : 2U ! 2A and H : 2A ! 2U are two set-valued mappings which are rewritten as L and H for short whenthere is no confusion. If the mappings L andH are used to derive concepts from a given object-attribute relation in the senseof cognition, then what do they need to obey? In what follows, we address this problem based on the principles from phi-losophy and cognitive psychology.

From the point of view of philosophy, a concept has two constituent parts: extent X and intent B, where X is a set ofobjects and B is a set of attributes. In general, the more objects a concept denotes, the less attributes it connotes, and viceversa. By this principle, given object sets X1; X2 and attribute sets B1, B2, we have

Pleasedx.doi

X1 # X2 ) LðX2Þ#LðX1Þ; ð1Þ

B1 # B2 ) HðB2Þ#HðB1Þ; ð2Þ

where LðX1Þ and LðX2Þ denote the corresponding intents of X1 and X2, respectively; HðB1Þ andHðB2Þ denote the correspond-ing extents of B1 and B2, respectively.

From the perspective of cognitive psychology, the principle for perception can be used to restrain the mapping L, whilethat for attention can be used to restrain the mapping H. The details are described below.

According to Gestalt psychology [13,14], the perception of the whole is more than the integration of those of its parts. Bythis principle, we obtain

LðX1 [ X2Þ � LðX1Þ \ LðX2Þ: ð3Þ

Here, the intersection of attribute sets on the right side represents ‘‘the integration of perceptions of parts’’.

Remark 1. By considering that the value on the left of Eq. (3) will equal the one on the right when X1 ¼ X2, the properinclusion ‘‘�’’ which should have been used between the left and right sides so as to strictly obey the principle for perception,has to be weakened to ‘‘�’’.

Moreover, in terms of the principle for attention in cognitive psychology, the selection model of Deutsch and Deutsch [8]says that all information (attended and unattended) should be analyzed for meaning in order to select some inputs for fullawareness. Whether or not the information is selected is dependent on how relevant it is at the time. By this principle, we get

HðBÞ ¼ fx 2 UjB #LðfxgÞg: ð4Þ

That is, the information at least relevant to all attributes in B will be selected.It is easy to verify that Eq. (2) can be implied by Eq. (4). Thus, combining the principles from philosophy with those from

cognitive psychology for perception and attention, we claim that Eqs. (1), (3) and (4) should be satisfied by the set-valuedmappings L and H when they are used to learn concepts from a given object-attribute relation.

Definition 1. Let L and H be two set-valued mappings. If for any X1;X2 # U and B # A, the following properties hold:

(i) X1 # X2 ) LðX2Þ#LðX1Þ,(ii) LðX1 [ X2Þ � LðX1Þ \ LðX2Þ,

(iii) HðBÞ ¼ fx 2 UjB #LðfxgÞg,

then L and H are called concept-forming cognitive operators (or simply cognitive operators).

cite this article in press as: J. Li et al., Concept learning via granular computing: A cognitive viewpoint, Inform. Sci. (2014), http://.org/10.1016/j.ins.2014.12.010

Page 4: Concept learning via granular computing: A cognitive viewpoint · 2014. 12. 18. · 1 3 Concept learning via granular computing:A cognitive viewpoint 4 5 6 Q1 Jinhai Li a,⇑, Changlin

170

171

172

173

174175

177177

178179

181181

182

183

184

185

186187

189189

190

192192

193

194

195

196

197

198

199

200

201202204204

205207207

208

209

210

211

212

213

214

215

216

217

218

219

4 J. LiQ1 et al. / Information Sciences xxx (2014) xxx–xxx

INS 11294 No. of Pages 21, Model 3G

16 December 2014

Q1

Example 1. Table 1 depicts a dataset of four patients who suffer from severe acute respiratory syndrome (SARS) [1].Let U be the set of four patients and A be the set of four symptoms. For convenience, we denote the four patients by 1, 2, 3

and 4, respectively, and the four symptoms (Fever, Cough, Headache, Difficulty breathing) by a, b; c and d, respectively. That is,U ¼ f1;2;3;4g and A ¼ fa; b; c; dg. Then, by intuitive perception and attention, we can obtain the following set-valuedmappings:

Pleasedx.doi

L : ;# fa; b; c; dg; f1g# fa; b;dg; f2g# fb;dg; f3g# fcg;f4g# fa; cg; f1;2g# fb;dg; f1;3g# ;; f1;4g# fag;f2;3g# ;; f2;4g# ;; f3;4g# fcg; f1;2;3g# ;;f1;2;4g# ;; f1;3;4g# ;; f2;3;4g# ;; f1;2;3;4g# ;

and

H : ;# f1;2;3;4g; fag# f1;4g; fbg# f1;2g; fcg# f3;4g;fdg# f1;2g; fa; bg# f1g; fa; cg# f4g; fa; dg# f1g;fb; cg# ;; fb;dg# f1;2g; fc; dg# ;; fa; b; cg# ;;fa; b;dg# f1g; fa; c; dg# ;; fb; c;dg# ;; fa; b; c; dg# ;;

where LðXÞ ¼ B means that B is the set of symptoms possessed by all patients in X, and HðBÞ ¼ X means that X is the set ofpatients at least suffering from all symptoms in B. Then, by Definition 1, it is easy to verify that L and H are cognitiveoperators.

For brevity, hereinafter we write LðfxgÞ (x 2 U) as LðxÞ and HðfagÞ (a 2 A) as HðaÞ.

Proposition 1. Let L and H be cognitive operators. Then for any X # U and B # A, we have

LðXÞ ¼\x2X

LðxÞ; ð5Þ

HðBÞ ¼\a2B

HðaÞ: ð6Þ

Proof. It is immediate from Definition 1. h

The formula in Eq. (5) can be explained as ‘‘the perception of the whole is equal to the integration of those of its parts’’,which is not surprising for the cognitive operator L. The reason is that on one hand the principle ‘‘the perception of the wholeis more than the integration of those of its parts’’ is weakened to ‘‘the perception of the whole is more than or equal to theintegration of those of its parts’’ in Eq. (3), and on the other hand the principle for a concept in philosophy has also beenembodied into the cognitive operator L. Similarly, the formula in Eq. (6) can be explained as ‘‘the information at least rel-evant to all attributes under consideration is equal to the integration of those at least relevant to its parts’’.

Proposition 2. Let L and H be cognitive operators. Then for any X # U and B # A, we have

X #HLðXÞ; ð7Þ

B #LHðBÞ; ð8Þ

where HLð�Þ and LHð�Þ represent the compositions HðLð�ÞÞ and LðHð�ÞÞ, respectively.

Proof. It is immediate from Definition 1. h

The formula in Eq. (7) can be explained as ‘‘other objects (if any) analogous to X can be recognized by HL-cognition of X’’,and the formula in Eq. (8) can be explained as ‘‘other attributes (if any) analogous to B can be recognized by LH-cognition ofB’’.

Here, we are extremely interested in the pair ðX;BÞ satisfying X ¼ HðBÞ and B ¼ LðXÞ since in this case both X and B reachthe balance with respect to HL and LH-cognitions, respectively. In other words, X ¼ HLðXÞ and B ¼ LHðBÞ can be satisfiedsimultaneously. In fact, such pairs ðX;BÞ satisfying X ¼ HðBÞ and B ¼ LðXÞ are a kind of useful conceptual knowledge in thesense of cognition.

Definition 2. Let L andH be cognitive operators. For X # U and B # A, if LðXÞ ¼ B andHðBÞ ¼ X, we say that the pair ðX;BÞ is aconcept under the cognitive operators L and H (or simply a cognitive concept). In this case, X and B are referred to as theextent and intent of the cognitive concept ðX;BÞ, respectively.

cite this article in press as: J. Li et al., Concept learning via granular computing: A cognitive viewpoint, Inform. Sci. (2014), http://.org/10.1016/j.ins.2014.12.010

Page 5: Concept learning via granular computing: A cognitive viewpoint · 2014. 12. 18. · 1 3 Concept learning via granular computing:A cognitive viewpoint 4 5 6 Q1 Jinhai Li a,⇑, Changlin

220

221

222

223

224

225

226

227

228

229230

232232

233

234

235

236

237

238

239

240

241

242

243

244

245

246

247

248

249

250

251252

254254

255

256

257

258

259

260

261

262

263

264

265

266

267

J. LiQ1 et al. / Information Sciences xxx (2014) xxx–xxx 5

INS 11294 No. of Pages 21, Model 3G

16 December 2014

Q1

Example 2. Let L and H be the cognitive operators shown in Example 1. Then by Definition 2, it is easy to verify thatðf1;2;3;4g; ;Þ, ðf1;2g; fb; dgÞ; ðf1;4g; fagÞ; ðf3;4g; fcgÞ, ðf1g; fa; b; dgÞ; ðf4g; fa; cgÞ and ð;; fa; b; c; dgÞ are cognitive conceptswhich can be viewed to some extent as the learning results after perception and attention.

Moreover, in the real world, it is necessary to make the correlation analysis between cognitive concepts. This motivates usto establish generalization and specialization relationships between the cognitive concepts. More precisely, for two cognitiveconcepts ðX1;B1Þ and ðX2;B2Þ under L andH, if X1 # X2, then ðX1;B1Þ is called a subconcept of ðX2;B2Þ, or equivalently, ðX2;B2Þis called a superconcept of ðX1;B1Þ, which is denoted by ðX1;B1Þ � ðX2;B2Þ. The set of all cognitive concepts together with thepartial order relation � forms a complete lattice. We call it a cognitive concept structure or a cognitive concept lattice whichis denoted by BðU;A;L;HÞ. The infimum (

V) and supremum (

W) of a set of cognitive concepts fðXt ;Bt � �Þj t 2 Tg (T is an

index set) are respectively defined as:

Pleasedx.doi

^t2T

Xt ;Btð Þ ¼\t2T

Xt ;LH[t2T

Bt

! !;

_t2T

Xt ;Btð Þ ¼ HL[t2T

Xt

!;\t2T

Bt

!:

ð9Þ

3. Integrating granular computing into cognitive concept lattice

According to the discussion in Section 2, given cognitive operators L and H, we can find in theory all cognitive concepts.However, in practice, it may be hard to implement such an action since the exhaustion of all elements of L and H is difficultwhen the cardinalities of U and A are large, let alone finding all cognitive concepts. For instance, in Example 1, the total num-ber of Xi # LðXiÞ (Xi # U) in L and Bj #HðBjÞ (Bj # A) in H is 2jUj þ 2jAj, which is exponential with respect to the cardinalitiesjUj and jAj. However, fortunately, according to Eqs. (5) and (6), every LðXiÞ can be represented as the intersection of LðxÞ(x 2 Xi) and every HðBjÞ can be represented as the intersection of HðaÞ (a 2 Bj), which means that it is sufficient to listfxg# LðxÞ (x 2 U) in the mapping L and fag#HðaÞ (a 2 A) in the mapping H. In other words, fxg# LðxÞ (x 2 U) are basicbut sufficient enough for inducing L, and fag# HðaÞ (a 2 A) are basic but sufficient enough for inducing H. Therefore,fxg# LðxÞ (x 2 U) and fag#HðaÞ (a 2 A) can respectively be viewed as the information granules of L and H in terms ofknowledge representation. Moreover, by considering that information granules are the basic notion in the theory of granularcomputing, it is natural for us to integrate granular computing into cognitive concept lattice for decreasing the computationtime. Besides, such an integration is also in accordance with characteristics of human thinking in which complex informationis often divided into pieces, classes and groups [28].

In what follows, we put forward the notion of information granules of cognitive operators and that of a granular concept.

Definition 3. Let L and H be cognitive operators. Then LG ¼ ffxg# LðxÞj x 2 Ug and HG ¼ ffag#HðaÞj a 2 Ag are calledinformation granules of L and H, respectively.

According to Eqs. (5) and (6), the information granules LG and HG can respectively be used to form any X # LðXÞ andB #HðBÞ as follows:

LðXÞ ¼\x2X

LGðxÞ;

HðBÞ ¼\a2B

HGðaÞ:

It should be pointed out that X # LðXÞ and B # HðBÞ may not be information granules when X and B are not singleton sets.Take Example 1 for instance, LðXÞ ¼ ; when X ¼ f2;4g, and HðBÞ ¼ ; when B ¼ fb; cg. Thus, X # LðXÞ R LG andB #HðBÞ R HG.

Considering that the exhaustion of all elements of L and H is quite hard in practice when the cardinalities of U and A arelarge, we store and remember the information of L and H in their granular forms, i.e., LG and HG.

Moreover, in preparation for presenting the notion of a granular concept, we need the following proposition.

Proposition 3. Let L and H be cognitive operators. Then for any X # U and B # A, both ðHLðXÞ;LðXÞÞ and ðHðBÞ;LHðBÞÞ arecognitive concepts.

Proof. It is immediate from Definitions 1 and 2 and Proposition 2. h

Definition 4. Let L and H be cognitive operators. Then for any x 2 U and a 2 A, we say that ðHLðxÞ;LðxÞÞ and ðHðaÞ;LHðaÞÞare granular concepts.

It is easy to observe that granular concepts are basic but sufficient enough to induce others, and we can confirm this bythe following proposition.

cite this article in press as: J. Li et al., Concept learning via granular computing: A cognitive viewpoint, Inform. Sci. (2014), http://.org/10.1016/j.ins.2014.12.010

Page 6: Concept learning via granular computing: A cognitive viewpoint · 2014. 12. 18. · 1 3 Concept learning via granular computing:A cognitive viewpoint 4 5 6 Q1 Jinhai Li a,⇑, Changlin

268

269270

272272

273

274

275

276

277

278

279

280281283283

284

285

286

287288

290290

291292

294294

295

296

297

298

299

300

301

302

303

304

305

306

307

308

309

310

312312

313

314

6 J. LiQ1 et al. / Information Sciences xxx (2014) xxx–xxx

INS 11294 No. of Pages 21, Model 3G

16 December 2014

Q1

Proposition 4. Let L and H be cognitive operators and BðU;A;L;HÞ be the cognitive concept lattice. Then for anyðX;BÞ 2 BðU;A;L;HÞ, we have

Pleasedx.doi

ðX;BÞ ¼_x2X

ðHLðxÞ;LðxÞÞ ¼^a2B

ðHðaÞ;LHðaÞÞ: ð10Þ

Proof. It follows directly from Eqs. (5), (6) and (9). h

Considering that the exhaustion of all cognitive concepts under L and H is quite hard in practice, we store and rememberthe conceptual knowledge BðU;A;L;HÞ in the form of its granular concepts ðHLðxÞ;LðxÞÞ (x 2 U) and ðHðaÞ;LHðaÞÞ (a 2 A)which are able to induce BðU;A;L;HÞ.

Note that in fact either ðHLðxÞ;LðxÞÞ (x 2 U) or ðHðaÞ;LHðaÞÞ (a 2 A) is enough to induce all cognitive concepts based onEq. (10). However, we still need both of them since in practice it may start with an object set, an attribute set or a pair ofobject and attribute sets for concept learning or set approximation (see Section 5 for details).

To facilitate subsequent discussion, we denote

GLH ¼ ðHLðxÞ;LðxÞÞj x 2 Uf g [ ðHðaÞ;LHðaÞÞj a 2 Af g: ð11Þ

That is, GLH is the set of all granular concepts under the cognitive operators L and H.

Example 3. Let L and H be the cognitive operators shown in Example 1. By Definition 3, we have that LG ¼ ff1g#

fa; b; dg; f2g# fb; dg; f3g# fcg; f4g# fa; cgg andHG ¼ ffag# f1;4g; fbg# f1;2g; fcg# f3;4g; fdg# f1;2gg are the infor-mation granules of L and H, respectively. With these information granules, we can obtain

Lð1Þ ¼ LGð1Þ ¼ fa; b;dg; HLð1Þ ¼ Hðfa; b;dgÞ ¼ HGðaÞ \ HGðbÞ \ HGðdÞ ¼ f1g;Lð2Þ ¼ LGð2Þ ¼ fb; dg; HLð2Þ ¼ Hðfb;dgÞ ¼ HGðbÞ \ HGðdÞ ¼ f1;2g;Lð3Þ ¼ LGð3Þ ¼ fcg; HLð3Þ ¼ HðcÞ ¼ HGðcÞ ¼ f3;4g;Lð4Þ ¼ LGð4Þ ¼ fa; cg; HLð4Þ ¼ Hðfa; cgÞ ¼ HGðaÞ \ HGðcÞ ¼ f4g

and

HðaÞ ¼ HGðaÞ ¼ f1;4g; LHðaÞ ¼ Lðf1;4gÞ ¼ LGð1Þ \ LGð4Þ ¼ fag;HðbÞ ¼ HGðbÞ ¼ f1;2g; LHðbÞ ¼ Lðf1;2gÞ ¼ LGð1Þ \ LGð2Þ ¼ fb;dg;HðcÞ ¼ HGðcÞ ¼ f3;4g; LHðcÞ ¼ Lðf3;4gÞ ¼ LGð3Þ \ LGð4Þ ¼ fcg;HðdÞ ¼ HGðdÞ ¼ f1;2g; LHðdÞ ¼ Lðf1;2gÞ ¼ LGð1Þ \ LGð2Þ ¼ fb;dg:

Then, by Definition 4, we conclude that ðf1g; fa; b; dgÞ, ðf1;2g; fb; dgÞ; ðf3;4g; fcgÞ; ðf4g; fa; cgÞ and ðf1;4g; fagÞ are granularconcepts. That is, GLH ¼ fðf1g; fa; b; dgÞ; ðf1;2g; fb; dgÞ; ðf3;4g; fcgÞ; ðf4g; fa; cgÞ; ðf1;4g; fagÞg.

4. Cognitive computing system

In the previous section, we have discussed how to derive granular concepts from cognitive operators L and H. In the realworld, the information on the object set U and attribute set A will be updated as time goes by, which means that the obtainedgranular concepts need to be updated accordingly. For instance, in Example 1, four symptoms (Fever, Cough, Headache, Dif-ficulty breathing) related to SARS have been found from the current four patients. As time goes by, there will appear morepatients from whom additional symptoms (e.g., Diarrhea, Muscle aches, Nausea and vomiting) will be observed (see Example4 for details). So, it is necessary to update the granular concepts obtained in Example 3.

In what follows, we put forward a cognitive computing system which can be viewed as the initial environment to learncomposite concepts by updating the current granular concepts with the newly input information.

For convenience, hereinafter n object sets U1;U2; . . . ;Un with U1 # U2 # � � � # Un are denoted by fUtg", and similarly nattribute sets A1;A2; . . . ;An with A1 # A2 # � � � # An are denoted by fAtg".

Definition 5. Let Ui�1; Ui be object sets of fUtg" and Ai�1; Ai be attribute sets of fAtg". Denote DUi�1 ¼ Ui � Ui�1 andDAi�1 ¼ Ai � Ai�1. Suppose

ðiÞ Li�1 : 2Ui�1 ! 2Ai�1 ; Hi�1 : 2Ai�1 ! 2Ui�1 ;

ðiiÞ LDUi�1: 2DUi�1 ! 2Ai�1 ; HDUi�1

: 2Ai�1 ! 2DUi�1 ;

ðiiiÞ LDAi�1: 2Ui ! 2DAi�1 ; HDAi�1

: 2DAi�1 ! 2Ui ;

ðivÞ Li : 2Ui ! 2Ai ; Hi : 2Ai ! 2Ui

are four pairs of cognitive operators whose information granules: ði�Þ LGi�1, HG

i�1, ðii�Þ LGDUi�1

;HGDUi�1

, iii�Þ LGDAi�1

;HGDAi�1

and ðiv�ÞLG

i , HGi satisfy the following properties:

cite this article in press as: J. Li et al., Concept learning via granular computing: A cognitive viewpoint, Inform. Sci. (2014), http://.org/10.1016/j.ins.2014.12.010

Page 7: Concept learning via granular computing: A cognitive viewpoint · 2014. 12. 18. · 1 3 Concept learning via granular computing:A cognitive viewpoint 4 5 6 Q1 Jinhai Li a,⇑, Changlin

315

317317

319319

320

321322323

324

325

326

327

328

329

330

331

332

333

334

335

336

337

338

339

340

341

342

343

344

345

346

347

348

349

350

351

352353355355

356357359359

360361363363364365366

367368

370370

J. LiQ1 et al. / Information Sciences xxx (2014) xxx–xxx 7

INS 11294 No. of Pages 21, Model 3G

16 December 2014

PleaseQ1

dx.doi

LGi ðxÞ ¼

LGi�1ðxÞ [ L

GDAi�1ðxÞ; if x 2 Ui�1;

LGDUi�1ðxÞ [ LG

DAi�1ðxÞ; otherwise;

(ð12Þ

G G(

HGi ðaÞ ¼

Hi�1ðaÞ [ HDUi�1ðaÞ; if a 2 Ai�1;

HGDAi�1ðaÞ; otherwise;

ð13Þ

where LGDUi�1ðxÞ and HG

DUi�1ðaÞ are set to be empty when DUi�1 ¼ ;, and LG

DAi�1ðxÞ and HG

DAi�1ðaÞ are set to be empty when

DAi�1 ¼ ;. Then we say that Li and Hi are extended cognitive operators of Li�1 and Hi�1 with the newly input informationLDUi�1 , HDUi�1 and LDAi�1 , HDAi�1 .

As for the background of extended cognitive operators, Li�1; Hi�1 can be considered as last state of knowledge expressing,and Li; Hi can be considered as the current state of knowledge expressing which is the result of updating the last state ofknowledge expressing with the newly input information LDUi�1 ,HDUi�1 and LDAi�1 ,HDAi�1 . Under this background, from the laststate to the current state, granular concepts need to be updated once.

Definition 6. Let Ui�1; Ui be object sets of fUtg"; Ai�1; Ai be attribute sets of fAtg"; DUi�1 ¼ Ui � Ui�1; DAi�1 ¼ Ai � Ai�1 and(i) Li�1; Hi�1, (ii) LDUi�1 ; HDUi�1 , (iii) LDAi�1

; HDAi�1, (iv) Li,Hi be four pairs of cognitive operators. If Li andHi are the extended

cognitive operators of Li�1 and Hi�1 with the newly input information LDUi�1; HDUi�1

and LDAi�1; HDAi�1

, then we callSLiHi ¼ ðGLi�1Hi�1 ; LDUi�1 ; HDUi�1 ; LDAi�1

; HDAi�1Þ a cognitive computing state, where GLi�1Hi�1 is the set of all granular concepts

under the cognitive operators Li�1 and Hi�1. Moreover, a collection of cognitive computing states, denoted by S ¼Sni¼2fSLiHig,

is called a cognitive computing system.As for the background of cognitive computing system, every cognitive computing state can be viewed as the result of

updating the information under consideration once, and a collection of cognitive computing states can be viewed as theresult of updating a series of information successively.

Then it is important to compute the final granular concepts GLnHn of a cognitive computing system S ¼Sni¼2fSLiHi

g based on

the initial granular concepts GL1H1 and a series of newly input information ‘‘LDU1 ; HDU1 ; LDA1 ; HDA1 ’’, ‘‘LDU2 ; HDU2 ,

LDA2 ; HDA2 ’’, . . . , ‘‘LDUi�1; HDUi�1

; LDAi�1; HDAi�1

’’. Note that this problem is called transformation between information gran-

ules in the theory of granular computing. Moreover, considering that recursive approach can be applied here, it is sufficient

to solve the subproblem of determining GLiHiwith GLi�1Hi�1

; LDUi�1; HDUi�1

; LDAi�1and HDAi�1

. In other words, we only need to

discuss cognitive computing state SLiHi¼ ðGLi�1Hi�1

;LDUi�1;HDUi�1

;LDAi�1;HDAi�1

Þ. To achieve this task, we continue to propose

the notions of an object-oriented cognitive computing state and an attribute-oriented cognitive computing state.

Definition 7. Let Ui�1; Ui be object sets of fUtg"; Ai�1 be an attribute set, DUi�1 ¼ Ui � Ui�1 and (i) Li�1 : 2Ui�1 ! 2Ai�1 ,Hi�1 : 2Ai�1 ! 2Ui�1 , (ii) LDUi�1 : 2DUi�1 ! 2Ai�1 , HDUi�1 : 2Ai�1 ! 2DUi�1 , (iii) L0 : 2Ui ! 2Ai�1 , H0 : 2Ai�1 ! 2Ui be three pairs ofcognitive operators. If L0 and H0 are the extended cognitive operators of Li�1 and Hi�1 with the newly input informationLDUi�1 and HDUi�1 (i.e., only object information being updated), then OSL0H0 ¼ ðGLi�1Hi�1 , LDUi�1 ;HDUi�1 Þ is called an object-oriented cognitive computing state.

Proposition 5. Let OSL0H0 ¼ ðGLi�1Hi�1, LDUi�1

;HDUi�1Þ be an object-oriented cognitive computing state. Then the following state-

ments hold:

(i) For any x 2 Ui, if x 2 Ui�1, then

ðH0L0ðxÞ;L0ðxÞÞ ¼ ðHi�1Li�1ðxÞ [ HDUi�1Li�1ðxÞ;Li�1ðxÞÞ; ð14Þ

otherwise,

ðH0L0ðxÞ;L0ðxÞÞ ¼ ðHi�1LDUi�1ðxÞ [ HDUi�1

LDUi�1ðxÞ;LDUi�1

ðxÞÞ: ð15Þ

(ii) For any a 2 Ai�1, we have

ðH0ðaÞ;L0H0ðaÞÞ ¼ ðHi�1ðaÞ [ HDUi�1ðaÞ;Li�1Hi�1ðaÞ \ LDUi�1

HDUi�1ðaÞÞ: ð16Þ

Proof. (i) If x 2 Ui�1, by Definition 5, we have L0ðxÞ ¼ Li�1ðxÞ due to LDAi�1 ðxÞ ¼ ;. Based on Eqs. (6) and (13), we conclude� � � �

H0ðfa1; a2gÞ ¼ HG

0 ða1Þ \ HG0 ða2Þ ¼ HG

i�1ða1Þ [ HGDUi�1ða1Þ \ HG

i�1ða2Þ [ HGDUi�1ða2Þ

¼ HGi�1ða1Þ \ HG

i�1ða2Þ� �

[ HGDUi�1ða1Þ \ HG

i�1ða2Þ� �

[ HGi�1ða1Þ \ HG

DUi�1ða2Þ

� �[ HG

DUi�1ða1Þ \ HG

DUi�1ða2Þ

� �¼ HG

i�1ða1Þ \ HGi�1ða2Þ

� �[ HG

DUi�1ða1Þ \ HG

DUi�1ða2Þ

� �¼ Hi�1ðfa1; a2gÞ [ HDUi�1

ðfa1; a2gÞ:

cite this article in press as: J. Li et al., Concept learning via granular computing: A cognitive viewpoint, Inform. Sci. (2014), http://.org/10.1016/j.ins.2014.12.010

Page 8: Concept learning via granular computing: A cognitive viewpoint · 2014. 12. 18. · 1 3 Concept learning via granular computing:A cognitive viewpoint 4 5 6 Q1 Jinhai Li a,⇑, Changlin

371

372

373

374

375376

378378

379

380

381

382

383

384

385

386

387

388389391391

392393395395

396

397398400400401

402

403

404

405

406

407

408

409

410

411412414414

415416418418

419

420421423423

424425427427428

8 J. LiQ1 et al. / Information Sciences xxx (2014) xxx–xxx

INS 11294 No. of Pages 21, Model 3G

16 December 2014

Q1

Moreover, using recursive approach, we obtain H0L0ðxÞ ¼ H0Li�1ðxÞ ¼ Hi�1Li�1ðxÞ [ HDUi�1Li�1ðxÞ. To sum up, it follows

ðH0L0ðxÞ;L0ðxÞÞ ¼ ðHi�1Li�1ðxÞ [ HDUi�1Li�1ðxÞ;Li�1ðxÞÞ. In a similar manner, if x 2 DUi�1, we can prove

ðH0L0ðxÞ;L0ðxÞÞ ¼ ðHi�1LDUi�1ðxÞ [ HDUi�1

LDUi�1ðxÞ;LDUi�1

ðxÞÞ.(ii) By Definition 5, for any a 2 Ai�1, we have H0ðaÞ ¼ Hi�1ðaÞ [ HDUi�1 ðaÞ. Furthermore, based on Eqs. (5) and (12), we

conclude

Pleasedx.doi

L0ðH0ðaÞÞ ¼ L0ðHi�1ðaÞ [ HDUi�1ðaÞÞ ¼ L0ðHi�1ðaÞÞ \ L0ðHDUi�1

ðaÞÞ ¼\

x2Hi�1ðaÞLG

0 ðxÞ !\ \

x2HDUi�1ðaÞLG

0 ðxÞ

0@

1A

¼\

x2Hi�1ðaÞLG

i�1ðxÞ !\ \

x2HDUi�1ðaÞLG

DUi�1ðxÞ

0@

1A ¼ Li�1Hi�1ðaÞ \ LDUi�1

HDUi�1ðaÞ:

As a result, we obtain ðH0ðaÞ;L0H0ðaÞÞ ¼ ðHi�1ðaÞ [ HDUi�1ðaÞ;Li�1Hi�1ðaÞ \ LDUi�1

HDUi�1ðaÞÞ: h

Moreover, we put forward the notion of an attribute-oriented cognitive computing state.

Definition 8. Let Ui be an object set, Ai�1; Ai be attribute sets of fAtg"; DAi�1 ¼ Ai � Ai�1 and (i) L0 : 2Ui ! 2Ai�1 ,H0 : 2Ai�1 ! 2Ui , (ii) LDAi�1

: 2Ui ! 2DAi�1 , HDAi�1: 2DAi�1 ! 2Ui , (iii) Li : 2Ui ! 2Ai , Hi : 2Ai ! 2Ui be three pairs of cognitive

operators. If Li and Hi are the extended cognitive operators of L0 and H0 with the newly input information LDAi�1and HDAi�1

(i.e., only attribute information being updated), then ASLiHi ¼ ðGL0H0 , LDAi�1;HDAi�1

Þ is called an attribute-oriented cognitivecomputing state.

Proposition 6. Let ASLiHi¼ ðGL0H0 , LDAi�1

;HDAi�1Þ be an attribute-oriented cognitive computing state. Then the following state-

ments hold:

(i) For any a 2 Ai, if a 2 Ai�1, then

ðHiðaÞ;LiHiðaÞÞ ¼ ðH0ðaÞ;L0H0ðaÞ [ LDAi�1H0ðaÞÞ; ð17Þ

otherwise,

ðHiðaÞ;LiHiðaÞÞ ¼ ðHDAi�1ðaÞ;L0HDAi�1

ðaÞ [ LDAi�1HDAi�1

ðaÞÞ: ð18Þ

(ii) For any x 2 Ui, we have

ðHiLiðxÞ;LiðxÞÞ ¼ ðH0L0ðxÞ \ HDAi�1LDAi�1

ðxÞ;L0ðxÞ [ LDAi�1ðxÞÞ: ð19Þ

Proof. We can prove it in a manner similar to Proposition 5. h

Combining Definitions 7 and 8 with Propositions 5 and 6, we know that a cognitive computing stateSLiHi

¼ ðGLi�1Hi�1;LDUi�1

;HDUi�1;LDAi�1

;HDAi�1Þ can be decomposed into the object-oriented cognitive computing state OSL0H0

¼ ðGLi�1Hi�1;LDUi�1

;HDUi�1Þ and the attribute-oriented cognitive computing state ASLiHi

¼ ðGL0H0 , LDAi�1;HDAi�1

Þ. Such a decom-position is beneficial to the computation of granular concepts GLiHi

. More precisely, (1) we firstly decompose SLiHiinto

OSL0H0 and ASLiHi; (2) we further use Proposition 5 to calculate the granular concepts GL0H0 ; (3) we finally employ Propo-

sition 6 to compute GLiHi. The detailed results are shown in the following proposition.

Proposition 7. Let SLiHi ¼ ðGLi�1Hi�1 ;LDUi�1 ;HDUi�1 ;LDAi�1;HDAi�1

Þ be a cognitive computing state. Then the following statementshold:

(1) For any x 2 Ui, if x 2 Ui�1, then

ðHiLiðxÞ;LiðxÞÞ ¼ ðHi�1Li�1ðxÞ [ HDUi�1Li�1ðxÞÞ \ HDAi�1

LDAi�1ðxÞ;Li�1ðxÞ [ LDAi�1

ðxÞ� �

; ð20Þ

otherwise,

ðHiLiðxÞ;LiðxÞÞ ¼ ðHi�1LDUi�1ðxÞ [ HDUi�1

LDUi�1ðxÞÞ \ HDAi�1

LDAi�1ðxÞ;LDUi�1

ðxÞ [ LDAi�1ðxÞ

� �: ð21Þ

(2) For any a 2 Ai, if a 2 Ai�1, then

ðHiðaÞ;LiHiðaÞÞ ¼ Hi�1ðaÞ [ HDUi�1ðaÞ; ðLi�1Hi�1ðaÞ \ LDUi�1

HDUi�1ðaÞÞ [ ðLDAi�1

Hi�1ðaÞ \ LDAi�1HDUi�1

ðaÞÞ� �

; ð22Þ

otherwise,

ðHiðaÞ;LiHiðaÞÞ ¼ HDAi�1ðaÞ; ðLi�1ðHDAi�1

ðaÞ \ Ui�1Þ \ LDUi�1ðHDAi�1

ðaÞ \ DUi�1ÞÞ [ LDAi�1HDAi�1

ðaÞ� �

: ð23Þ

cite this article in press as: J. Li et al., Concept learning via granular computing: A cognitive viewpoint, Inform. Sci. (2014), http://.org/10.1016/j.ins.2014.12.010

Page 9: Concept learning via granular computing: A cognitive viewpoint · 2014. 12. 18. · 1 3 Concept learning via granular computing:A cognitive viewpoint 4 5 6 Q1 Jinhai Li a,⇑, Changlin

429

430

431

432

433

434

466

467

468

469

470

471

472

473

474

475

476

J. LiQ1 et al. / Information Sciences xxx (2014) xxx–xxx 9

INS 11294 No. of Pages 21, Model 3G

16 December 2014

Q1

Proposition 7 gives a simple transformation way from the information granules GLi�1Hi�1to GLiHi

with the newly inputinformation LDUi�1 ; HDUi�1 and LDAi�1 ; HDAi�1 .

Based on the above discussion, we are now ready to propose a procedure (called Algorithm 1 to compute the granular

concepts GLnHn of a cognitive computing system S ¼Sni¼2fSLiHi

g, where each SLiHi¼ ðGLi�1Hi�1

;LDUi�1;HDUi�1

;LDAi�1;HDAi�1

Þ rep-

resents a cognitive computing state.

Algorithm 1. Computing the granular concepts of a cognitive computing system

Require: S ¼[ni¼2

fSLiHig, where SLiHi ¼ ðGLi�1Hi�1 ;LDUi�1;HDUi�1

;LDAi�1;HDAi�1

Þ is a cognitive computing state.

Ensure The granular concepts GLnHn of S.1: Initialize GL1H1 ¼ fðH1L1ðxÞ;L1ðxÞÞj x 2 U1g [ fðH1ðaÞ;L1H1ðaÞÞj a 2 A1g and i ¼ 2;2: While i 6 n3: Denote the object-oriented cognitive computing state ðGLi�1Hi�1 ;LDUi�1 ;HDUi�1 Þ by OSL0H0 ;4: For each x 2 Ui

5: If x 2 Ui�1

6: set L0ðxÞ ¼ Li�1ðxÞ, HDUi�1Li�1ðxÞ ¼\

a2Li�1ðxÞHDUi�1 ðaÞ and H0L0ðxÞ ¼ Hi�1Li�1ðxÞ [ HDUi�1Li�1ðxÞ;

7: Else8: do L0ðxÞ ¼ LDUi�1 ðxÞ;Hi�1LDUi�1 ðxÞ ¼

\a2LDUi�1

ðxÞHi�1ðaÞ and H0L0ðxÞ ¼ Hi�1LDUi�1 ðxÞ [ HDUi�1LDUi�1 ðxÞ;

9: End If10: End For11: For each a 2 Ai�1

12: compute H0ðaÞ ¼ Hi�1ðaÞ [ HDUi�1ðaÞ and L0H0ðaÞ ¼ Li�1Hi�1ðaÞ \ LDUi�1

HDUi�1ðaÞ;

13: End For14: Denote the attribute-oriented cognitive computing state ðGL0H0 ;LDAi�1

;HDAi�1Þ by ASLiHi ;

15: For each a 2 Ai

16: If a 2 Ai�1

17: set HiðaÞ ¼ H0ðaÞ, LDAi�1H0ðaÞ ¼

\x2H0ðaÞ

LDAi�1ðxÞ and LiHiðaÞ ¼ L0H0ðaÞ [ LDAi�1

H0ðaÞ;

18: Else19: do HiðaÞ ¼ HDAi�1

ðaÞ;L0HDAi�1ðaÞ ¼

\x2HDAi�1

ðaÞL0ðxÞ and LiHiðaÞ ¼ L0HDAi�1

ðaÞ [ LDAi�1HDAi�1

ðaÞ;

20: End If21: End For22: For each x 2 Ui

23: let LiðxÞ ¼ L0ðxÞ [ LDAi�1ðxÞ and HiLiðxÞ ¼ H0L0ðxÞ \ HDAi�1

LDAi�1ðxÞ;

24: End For25: Set GLiHi ¼ fðHiLiðxÞ;LiðxÞÞj x 2 Uig [ fðHiðaÞ;LiHiðaÞÞj a 2 Aig;26: i iþ 1;27: End While28: Return GLiHi .

According to Propositions 5 and 6, the computations in Steps 3–13 are to find the granular concepts of the object-orientedcognitive computing state OSL0H0 , and those in Steps 14–24 are to find the granular concepts of the attribute-oriented cog-nitive computing state ASLiHi

. By Proposition 7, we know that GLiHiobtained in Step 25 is the granular concepts of the cog-

nitive computing state SLiHi. Consequently, GLnHn output by Algorithm 1 is the granular concepts of the input cognitive

computing system S ¼Sni¼2fSLiHi

g.

In fact, from the point of view of granular computing, Algorithm 1 can be viewed as a transformation way from the infor-mation granules GL1H1 to GLnHn by means of recursive approach.

Now, we analyze the time complexity of Algorithm 1. Suppose S ¼Sni¼2fSLiHi

g is the input cognitive computing system.

Then, based on the discussion in Section 2, running Step 1 takes OððjU1j þ jA1jÞj U1jjA1jÞ. Furthermore, we know that the timecomplexity of Steps 3–13 is OððjUij þ jAijÞj UijjAijÞ and so is that of Steps 14–24. Thus, running Steps 2–27 takes

Please cite this article in press as: J. Li et al., Concept learning via granular computing: A cognitive viewpoint, Inform. Sci. (2014), http://dx.doi.org/10.1016/j.ins.2014.12.010

Page 10: Concept learning via granular computing: A cognitive viewpoint · 2014. 12. 18. · 1 3 Concept learning via granular computing:A cognitive viewpoint 4 5 6 Q1 Jinhai Li a,⇑, Changlin

477

478

479

480

481

482

483

484

485

486

487

488

489

490

491

492

493

494495

497497

498499

501501

502

504504

505

506

507

508509

511511

512

513

514

515

516

517

518

519

520

10 J. LiQ1 et al. / Information Sciences xxx (2014) xxx–xxx

INS 11294 No. of Pages 21, Model 3G

16 December 2014

Q1

OðnðjUnj þ jAnjÞj UnjjAnjÞ, where n is the number of cognitive computing states. To sum up, the time complexity of Algorithm1 is OðnðjUnj þ jAnjÞj UnjjAnjÞ which is polynomial.

Example 4. In Example 1, four symptoms (Fever, Cough, Headache, Difficulty breathing) related to SARS have been found fromthe four patients. As time goes by, there will appear more patients (e.g., patients 5, 6, 7, 8 and 9) from whom additionalsymptoms (e.g., Diarrhea, Muscle aches, Nausea and vomiting) will be observed. We suppose the information updating on thepatients and symptoms is shown in Table 2. Note that in the table, the values of patients 1, 2, 3 and 4 under the newsymptoms Diarrhea, Muscle aches, and Nausea and vomiting being ‘‘No’’ are a very special assumption which cannot beapplied to all situations since four original patients with the four original symptoms may have gone and could not becontacted when additional symptoms can be tested using new technologies, i.e., sometimes no chance of obtaining thevalues of the new symptoms from them.

Now we update the granular concepts obtained in Example 3. We denote the set of original patients in Table 1 by U1 (i.e.,U1 ¼ f1;2;3;4g), that of original symptoms by A1 (i.e., A1 ¼ fa; b; c; dg), and the cognitive operators between 2U1 and 2A1 byL1 and H1 (see Example 1 for details). Then the information granules of L1 and H1 and their granular concepts GL1H1 can befound in Example 3.

Besides, we denote the new patients by 5, 6, 7, 8, 9, and the new symptoms by e; f and g, respectively. LetU2 ¼ f1;2;3;4;5;6;7;8;9g; A2 ¼ fa; b; c; d; e; f ; gg, DU1 ¼ U2 � U1 ¼ f5;6;7;8;9g; DA1 ¼ A2 � A1 ¼ fe; f ; gg. Similar to Exam-ple 1, by intuitive perception and attention, we can obtain the cognitive operators LDU1 : 2DU1 ! 2A1 , HDU1 : 2A1 ! 2DU1 andLDA1 : 2U2 ! 2DA1 , HDA1 : 2DA1 ! 2U2 . The information granules of LDU1 and HDU1 are

Table 2A SARS

Patie

123456789

Pleasedx.doi

LGDU1¼ ff5g# fa; cg; f6g# fbg; f7g# fa; dg; f8g# fbg; f9g# fcgg;

HGDU1¼ ffag# f5;7g; fbg# f6;8g; fcg# f5;9g; fdg# f7gg;

and those of LDA1 and HDA1 are

LGDA1¼ ff1g# ;; f2g# ;; f3g# ;; f4g# ;; f5g# feg; f6g# ffg; f7g# fgg; f8g# ff ; gg; f9g# fegg;

HGDA1¼ ffeg# f5;9g; ffg# f6;8g; fgg# f7;8gg:

We denote by L2 and H2 the extended cognitive operators of L1 and H1 with the newly input information LDU1 , HDU1 andLDA1 , HDA1 (see Eqs. (12) and (13) for construction of L2 and H2). Then SL2H2 ¼ ðGL1H1 ;LDU1 ;HDU1 ;LDA1 ;HDA1 Þ is a cognitivecomputing state which also forms a cognitive computing system S with n ¼ 2.

Using Algorithm 1, we obtain the granular concepts GL2H2 of the cognitive computing system S as follows:

ðf1g;fa;b;dgÞ; ðf1;2g;fb;dgÞ; ðf3;4;5;9g;fcgÞ; ðf4;5g;fa;cgÞ; ðf5g;fa;c;egÞ; ðf6;8g;fb; fgÞ; ðf7g;fa;d;ggÞ;ðf8g;fb; f ;ggÞ; ðf5;9g;fc;egÞ; ðf1;4;5;7g;fagÞ; ðf1;2;6;8g;fbgÞ; ðf1;2;7g;fdgÞ; ðf7;8g;fggÞ:

5. Cognitive processes

In the real world, it is important to learn cognitive concept(s) based on the current ones when additional information isgiven to object set, attribute set or both of them. Solving this problem is often called cognitive process [38,45]. For instance,continued with Example 4, we suppose patients 3, 4 and 5 are children suffering from SARS. Then which symptoms charac-terize these children exactly in terms of suffering from SARS? Unfortunately, the current granular concepts GL2H2 listed at theend of Example 4 cannot answer this question since no granular concept has the extent X1 ¼ f3;4;5g. In order to deal withthis issue, we need to learn additional cognitive concept(s) according to the given object set X1 ¼ f3;4;5g based on theobtained granular concepts GL2H2 . Similarly, it is also necessary to learn additional cognitive concept(s) when new informa-tion is given to an attribute set or a pair of object and attribute sets.

dataset with information updating on patients and symptoms.

nt Fever Cough Headache Difficulty breathing Diarrhea Muscle aches Nausea and vomiting

Yes Yes No Yes No No NoNo Yes No Yes No No NoNo No Yes No No No NoYes No Yes No No No NoYes No Yes No Yes No NoNo Yes No No No Yes NoYes No No Yes No No YesNo Yes No No No Yes YesNo No Yes No Yes No No

cite this article in press as: J. Li et al., Concept learning via granular computing: A cognitive viewpoint, Inform. Sci. (2014), http://.org/10.1016/j.ins.2014.12.010

Page 11: Concept learning via granular computing: A cognitive viewpoint · 2014. 12. 18. · 1 3 Concept learning via granular computing:A cognitive viewpoint 4 5 6 Q1 Jinhai Li a,⇑, Changlin

521

522

523

524

525

526

527

528

529

530

531532534534

535

536

537

538539

541541

542

543

544

545

546

547

548

549

550

551

552553

555555

556

557

558

559

560561

563563

564565

567567

568569

571571

J. LiQ1 et al. / Information Sciences xxx (2014) xxx–xxx 11

INS 11294 No. of Pages 21, Model 3G

16 December 2014

Q1

In this section, using set approximations, we discuss cognitive processes to learn one exact or two approximate cognitiveconcepts from a given object set, attribute set or pair of object and attribute sets based on the granular concepts GLnHn of acognitive computing system. Before embarking on this issue, we introduce some basic notions related to rough set theory(e.g., lower and upper approximations, rough set, etc) in order to explicitly show where the idea of our set approximationscomes from.

Formally, an information system can be considered as a pair I ¼ hU;ATi [23], where.

� U is a non-empty finite set of objects, called the universe.� AT is a non-empty finite set of attributes such that for any a 2 AT; Va is the domain of attribute a.

For any x 2 U, we denote by aðxÞ the value of x under the attribute a 2 AT. Given A # AT, an indiscernibility relation INDðAÞcan be defined as:

Pleasedx.doi

INDðAÞ ¼ fðx; yÞ 2 U UjaðxÞ ¼ aðyÞ forall a 2 Ag:

It is easy to verify that the relation INDðAÞ is reflexive, symmetric and transitive. In other words, INDðAÞ forms an equivalencerelation which can partition U into equivalence classes ½xA ¼ fy 2 Ujðx; yÞ 2 INDðAÞg. We denote this partition of U byU=INDðAÞ. That is, U=INDðAÞ ¼ f½xAjx 2 Ug. Then one can derive lower and upper approximations of an arbitrary subset Xof U which are respectively defined as:

AðXÞ ¼[

Y2U=INDðAÞ;Y # X

Y and AðXÞ ¼[

Y2U=INDðAÞ;Y\X–;Y:

In rough set theory [23], the pair ½AðXÞ;AðXÞ is referred to as the rough set of X with respect to the attribute set A.Note that the idea of lower and upper approximations in rough set theory was further extended by Saquer and Deogun

[32], Yao and Chen [51], and Zhang and Qiu [55] to Wille’s concept lattice, and by Shao et al. [34] to fuzzy concept lattice.

5.1. Concept learning from an object set

In this subsection, we investigate the problem of learning one exact or two approximate cognitive concepts from a givenobject set by means of set approximations. Firstly, we put forward an approach to approximate an object set.

Let GLnHn be the granular concepts of a cognitive computing system S ¼Sni¼2fSLiHi

g and BðUn;An;Ln;HnÞ be the correspond-ing cognitive concept lattice. Then, based on the discussion in Section 3, we know that GLnHn is the set of basic informationgranules of BðUn;An;Ln;HnÞ.

Motivated by the existing set approximation ideas [23,32,34,51,55], we respectively define the lower and upper approx-imations of an object set X0 in the cognitive concept lattice BðUn;An;Ln;HnÞ as follows:

AprðX0Þ ¼ extent_

ðX;BÞ2BðUn ;An ;Ln ;HnÞ;X # X0

ðX;BÞ

0@

1A;

AprðX0Þ ¼ extent^

ðX;BÞ2BðUn ;An ;Ln ;HnÞ;X0 # X

ðX;BÞ

0@

1A;

ð24Þ

where extentð�Þ denotes the extent of a cognitive concept.That is, the lower approximation AprðX0Þ is the extent of the supremum of the cognitive concepts which are specializa-

tions of ðHnLnðX0Þ;LnðX0ÞÞ, and the upper approximation AprðX0Þ is the extent of the infimum of the cognitive conceptswhich are generalizations of ðHnLnðX0Þ;LnðX0ÞÞ.

According to Eqs. (9) and (24), the lower and upper approximations of X0 can also be represented as:

AprðX0Þ ¼ HnLn

[ðX;BÞ2BðUn ;An ;Ln ;HnÞ;X # X0

X

0@

1A;

AprðX0Þ ¼\

ðX;BÞ2BðUn ;An ;Ln ;HnÞ;X0 # X

X:ð25Þ

Note that

HnLn

[ðX;BÞ2BðUn ;An ;Ln ;HnÞ;X # X0

X

0@

1A#HnLnðX0Þ#

\ðX;BÞ2BðUn ;An ;Ln ;HnÞ;X0 # X

X:

Then

ðAprðX0Þ;LnðAprðX0ÞÞÞ � ðHnLnðX0Þ;LnðX0ÞÞ � ðAprðX0Þ;LnðAprðX0ÞÞÞ: ð26Þ

cite this article in press as: J. Li et al., Concept learning via granular computing: A cognitive viewpoint, Inform. Sci. (2014), http://.org/10.1016/j.ins.2014.12.010

Page 12: Concept learning via granular computing: A cognitive viewpoint · 2014. 12. 18. · 1 3 Concept learning via granular computing:A cognitive viewpoint 4 5 6 Q1 Jinhai Li a,⇑, Changlin

572

573574

576576

577

578

579

580

581

582

583584

586586

587

589589

590

591

592593

595595

596

597

598

599

601601

602603

605605

12 J. LiQ1 et al. / Information Sciences xxx (2014) xxx–xxx

INS 11294 No. of Pages 21, Model 3G

16 December 2014

Q1

Thus, we consider ðAprðX0Þ;LnðAprðX0ÞÞÞ and ðAprðX0Þ;LnðAprðX0ÞÞÞ as the result of learning cognitive concepts from thegiven object set X0 by means of set approximations. Moreover, we define the (concept) learning accuracy as

Pleasedx.doi

aðX0Þ ¼ 1�jAprðX0Þj � jAprðX0Þj

jUnjð27Þ

which is used to measure the accuracy of learning cognitive concepts from X0. Obviously, the learning accuracy aðX0Þ equals1 if and only if AprðX0Þ ¼ AprðX0Þ.

Note that by Algorithm 1, we only obtain the granular concepts GLnHn of a cognitive computing system S ¼Sni¼2fSLiHi

g.

Although, according to Eq. (10), we are able to induce all cognitive concepts BðUn;An;Ln;HnÞ using GLnHn and then determinethe lower and upper approximations of X0. However, in practice, it is generally hard to implement such an action since thenodes of BðUn;An;Ln;HnÞ increase exponentially in the worst case. To solve this problem, we need the following proposition.

For convenience, we denote

G�LnHn¼

GLnHn [ fðUn; ;Þg; if ðUn; ;Þ 2 BðUn;An;Ln;HnÞ;GLnHn ; otherwise;

G#LnHn

¼GLnHn [ fð;;AnÞg; if ð;;AnÞ 2 BðUn;An;Ln;HnÞ;GLnHn ; otherwise:

Proposition 8. Let BðUn;An;Ln;HnÞ be the cognitive concept lattice of the cognitive operators Ln and Hn, and GLnHn be thecorresponding granular concepts. Then for any X0 # U, we have

AprðX0Þ ¼ extent_

ðX;BÞ2G#LnHn

;X # X0

ðX;BÞ

0B@

1CA;

AprðX0Þ ¼ extent^

ðX;BÞ2G�LnHn;X0 # X

ðX;BÞ

0@

1A:

ð28Þ

Proof. We denote by G#TLnHn

the complement of G#LnHn

with respect to BðUn;An;Ln;HnÞ and by G�TLnHnthe complement of G�LnHn

with respect to BðUn;An;Ln;HnÞ. That is, G#TLnHn

¼ BðUn;An;Ln;HnÞ � G#LnHn

and G�TLnHn¼ BðUn;An;Ln;HnÞ � G�LnHn

. Then by Eq.(10), we obtain

_ðX;BÞ2BðUn ;An ;Ln ;HnÞ;X # X0

ðX; BÞ ¼_

ðX;BÞ2G#LnHn

;X # X0

ðX;BÞ

0B@

1CA_ _

ðX;BÞ2G#TLnHn

;X # X0

ðX;BÞ

0B@

1CA

¼_

ðX;BÞ2G#LnHn

;X # X0

ðX;BÞ

0B@

1CA_ _

ðX;BÞ2G#TLnHn

;X # X0

_x2X

HnLnðxÞ;LnðxÞð Þ !0

B@1CA

¼_

ðX;BÞ2G#LnHn

;X # X0

ðX;BÞ

0B@

1CA

and

^ðX;BÞ2BðUn ;An ;Ln ;HnÞ;X0 # X

ðX; BÞ ¼^

ðX;BÞ2G�LnHn;X0 # X

ðX;BÞ

0@

1A^ ^

ðX;BÞ2G�TLnHn;X0 # X

ðX;BÞ

0B@

1CA

¼^

ðX;BÞ2G�LnHn;X0 # X

ðX;BÞ

0@

1A^ ^

ðX;BÞ2G�TLnHn;X0 # X

^a2B

ðHnðaÞ;LnHnðaÞÞ !0

B@1CA

¼^

ðX;BÞ2G�LnHn;X0 # X

ðX;BÞ

0@

1A:

cite this article in press as: J. Li et al., Concept learning via granular computing: A cognitive viewpoint, Inform. Sci. (2014), http://.org/10.1016/j.ins.2014.12.010

Page 13: Concept learning via granular computing: A cognitive viewpoint · 2014. 12. 18. · 1 3 Concept learning via granular computing:A cognitive viewpoint 4 5 6 Q1 Jinhai Li a,⇑, Changlin

606

607

608

609610

612612

613

614

615

616

617

618

619

620

621

J. LiQ1 et al. / Information Sciences xxx (2014) xxx–xxx 13

INS 11294 No. of Pages 21, Model 3G

16 December 2014

Q1

As a result, Eq. (28) is at hand. h

Proposition 8 says that the granular concepts GLnHn (exactly G�LnHnand G#

LnHn), which can easily be computed by Algorithm

1 from a cognitive computing system, are able to approximate an object set X0 with the same result as BðUn;An;Ln;HnÞ. Moreprecisely, 0 1

Pleasedx.doi

AprðX0Þ ¼ HnLn

[ðX;BÞ2G#

LnHn;X # X0

XB@ CA;AprðX0Þ ¼

\ðX;BÞ2G�LnHn

;X0 # X

X:

ð29Þ

This allows us to learn cognitive concept(s) from an object set X0 using the granular concepts GLnHn instead of the cognitiveconcept lattice BðUn;An;Ln;HnÞ.

Proposition 9. Let ðAprðX0Þ;LnðAprðX0ÞÞÞ and ðAprðX0Þ;LnðAprðX0ÞÞÞ be the learning cognitive concepts from an object set X0

based on GLnHn . If AprðX0Þ ¼ AprðX0Þ, there is only one learning cognitive concept from X0 which is ðHnLnðX0Þ;LnðX0ÞÞ.

Proof. It is immediate from Eq. (26). h

In summary, for a given object set X0, we learn an exact cognitive concept ðHnLnðX0Þ;LnðX0ÞÞ with the learning accuracyaðX0Þ ¼ 1 if AprðX0Þ ¼ AprðX0Þ; otherwise, we can only learn two approximate cognitive concepts ðAprðX0Þ, LnðAprðX0ÞÞÞ and

ðAprðX0Þ;LnðAprðX0ÞÞÞ with the learning accuracy aðX0Þ ¼ 1� jAprðX0Þj�jAprðX0ÞjjUn j . Algorithm 2 describes how to compute them.

Algorithm 2. Concept learning from an object set

Require: The granular concepts GLnHn of a cognitive computing system S ¼[ni¼2

fSLiHig and an object set X0.

Ensure: An exact or two approximate cognitive concepts with learning accuracy for X0.1: Initialize Px ¼ ;;Pa ¼ ;, Xx ¼ ;;Xa ¼ ;;aðX0Þ ¼ 1;m ¼ 1 and label the elements of GLnHn as

ðHnLnðx1Þ;Lnðx1ÞÞ; ðHnLnðx2Þ;Lnðx2ÞÞ; . . . ; ðHnLnðxsÞ;LnðxsÞÞ,ðHnða1Þ;LnHnða1ÞÞ; ðHnða2Þ;LnHnða2ÞÞ; . . . ; ðHnðatÞ;LnHnðatÞÞ;

2: For each i 2 f1;2; . . . ; sg3: If HnLnðxiÞ# X0

4: Px Px [ fðHnLnðxiÞ;LnðxiÞÞg;5: End If6: If X0 #HnLnðxiÞ7: Xx Xx [ fðHnLnðxiÞ;LnðxiÞÞg;8: End If9: End For

10: For each j 2 f1;2; . . . ; tg11: If HnðajÞ# X0

12: Pa Pa [ fðHnðajÞ;LnHnðajÞÞg;13: End If14: If X0 #HnðajÞ15: Xa Xa [ fðHnðajÞ;LnHnðajÞÞg;16: End If17: End For18: Let P ¼ Px [Pa;X ¼ Xx [Xa, add ð;;AnÞ into P when ð;;AnÞ is a cognitive concept and ðUn; ;Þ into X when ðUn; ;Þ

is a cognitive concept, and compute AprðX0Þ ¼ HnLn

[ðX;BÞ2P

X

0@

1A and AprðX0Þ ¼

\ðX;BÞ2X

X;

19: If AprðX0Þ ¼ AprðX0Þ20: B0 ¼

\x2AprðX0Þ

LnðxÞ;

21: Else

22: reset m ¼ 2 and compute B0 ¼\

x2AprðX0ÞLnðxÞ, B0 ¼

\x2AprðX0Þ

LnðxÞ and aðX0Þ ¼ 1� jAprðX0Þj�jAprðX0ÞjjUn j ;

23: End If24: Return ðAprðX0Þ; B0Þ and aðX0Þ when m ¼ 1; otherwise, ðAprðX0Þ; B0Þ, ðAprðX0Þ;B0Þ and aðX0Þ.

cite this article in press as: J. Li et al., Concept learning via granular computing: A cognitive viewpoint, Inform. Sci. (2014), http://.org/10.1016/j.ins.2014.12.010

Page 14: Concept learning via granular computing: A cognitive viewpoint · 2014. 12. 18. · 1 3 Concept learning via granular computing:A cognitive viewpoint 4 5 6 Q1 Jinhai Li a,⇑, Changlin

654

655

656

657

658

659

660

661

662

663664

666666

667

668

669

670

671

672

673

674

675

676677

679679

680

681

682

683

684685

687687

688689

691691

14 J. LiQ1 et al. / Information Sciences xxx (2014) xxx–xxx

INS 11294 No. of Pages 21, Model 3G

16 December 2014

Q1

According to Eq. (29), Steps 2–18 in Algorithm 2 are to compute the lower and upper approximations of the object

set X0. Furthermore, Steps 19–24 are to find an exact or two approximate cognitive concepts for X0 as well as thelearning accuracy aðX0Þ. What is more, it is easy to check that the time complexity of Algorithm 2 isOðjUnj2 þ jUnjjAnj þ jAnj2Þ.

Example 5. Continued with Example 4, we suppose patients 3, 4 and 5 are children suffering from SARS, while patients 5and 9 are old people suffering from SARS. Then which symptoms characterize these children (old people) exactly in terms ofsuffering from SARS? In order to answer this question, we need to learn cognitive concept(s) from the given object setsX1 ¼ f3;4;5g and X2 ¼ f5;9g based on the obtained granular concepts GL2H2 which can be found at the end of Example 4. ByEq. (29), we have

Pleasedx.doi

AprðX1Þ ¼ H2L2

[ðX;BÞ2G#

L2H2;X # X1

X

0B@

1CA ¼ H2L2ð; [ f5g [ f4;5gÞ ¼ f4;5g;

AprðX1Þ ¼\

ðX;BÞ2G�L2H2;X1 # X

X ¼ f3;4;5;9g \ U2 ¼ f3;4;5;9g;

AprðX2Þ ¼ H2L2

[ðX;BÞ2G#

L2H2;X # X2

X

0B@

1CA ¼ H2L2ð; [ f5g [ f5;9gÞ ¼ f5;9g;

AprðX2Þ ¼\

ðX;BÞ2G�L2H2;X2 # X

X ¼ f5;9g \ f3;4;5;9g \ U2 ¼ f5;9g:

Thus, we learn two approximate cognitive concepts ðf4;5g; fa; cgÞ and ðf3;4;5;9g; fcgÞ from X1 with the learning accuracyaðX1Þ ¼ 7

9. Then we know that there do not exist some symptoms characterizing these children exactly in terms of sufferingfrom SARS, but fever and headache can characterize them approximately and so can headache. Moreover, we learn an exactcognitive concept ðf5;9g; fc; egÞ from X2 with aðX2Þ ¼ 1, which means that headache and diarrhea can characterize the oldpeople exactly in terms of suffering from SARS.

5.2. Concept learning from an attribute set

In this subsection, we investigate the problem of learning one exact or two approximate cognitive concepts from a givenattribute set by means of set approximations. Similar to the case in Section 5.1, we first propose an approach to approximatean attribute set in preparation for concept learning here.

We define the lower and upper approximations of an attribute set B0 in BðUn;An;Ln;HnÞ as follows:

AprðB0Þ ¼ intent_

ðX;BÞ2BðUn ;An ;Ln ;HnÞ;B0 # B

ðX; BÞ

0@

1A;

AprðB0Þ ¼ intent^

ðX;BÞ2BðUn ;An ;Ln ;HnÞ;B # B0

ðX; BÞ

0@

1A;

ð30Þ

where intentð�Þ denotes the intent of a cognitive concept.That is, the lower approximation AprðB0Þ is the intent of the supremum of the cognitive concepts which are specializa-

tions of ðHnðB0Þ;LnHnðB0ÞÞ, and the upper approximation AprðB0Þ is the intent of the infimum of the cognitive conceptswhich are generalizations of ðHnðB0Þ;LnHnðB0ÞÞ.

According to Eqs. (9) and (30), the lower and upper approximations of an attribute set B0 can also be represented as:

AprðB0Þ ¼\

ðX;BÞ2BðUn ;An ;Ln ;HnÞ;B0 # B

B;

AprðB0Þ ¼ LnHn

[ðX;BÞ2BðUn ;An ;Ln ;HnÞ;B # B0

B

0@

1A:

ð31Þ

Note that

LnHn

[ðX;BÞ2BðUn ;An ;Ln ;HnÞ;B # B0

B

0@

1A#LnHnðB0Þ#

\ðX;BÞ2BðUn ;An ;Ln ;HnÞ;B0 # B

B:

cite this article in press as: J. Li et al., Concept learning via granular computing: A cognitive viewpoint, Inform. Sci. (2014), http://.org/10.1016/j.ins.2014.12.010

Page 15: Concept learning via granular computing: A cognitive viewpoint · 2014. 12. 18. · 1 3 Concept learning via granular computing:A cognitive viewpoint 4 5 6 Q1 Jinhai Li a,⇑, Changlin

692693

695695

696

697698

700700

701

702

703

704

705

706707

709709

710711

713713

714

715

716

717

718

719

720

J. LiQ1 et al. / Information Sciences xxx (2014) xxx–xxx 15

INS 11294 No. of Pages 21, Model 3G

16 December 2014

Q1

Then

Pleasedx.doi

ðHnðAprðB0ÞÞ;AprðB0ÞÞ � ðHnðB0Þ;LnHnðB0ÞÞ � ðHnðAprðB0ÞÞ;AprðB0ÞÞ: ð32Þ

Thus, we consider ðHnðAprðB0ÞÞ;AprðB0ÞÞ and ðHnðAprðB0ÞÞ;AprðB0ÞÞ as the result of learning cognitive concepts from theattribute set B0 by means of set approximations. Moreover, we define the (concept) learning accuracy as

bðB0Þ ¼ 1�jAprðB0Þj � jAprðB0Þj

jAnj; ð33Þ

which is used to measure the accuracy of learning cognitive concepts from B0. Obviously, the learning accuracy bðB0Þ equals 1if and only if AprðB0Þ ¼ AprðB0Þ.

Similarly, the granular concepts GLnHn of a cognitive computing system are able to approximate an attribute set with thesame result as the cognitive concept lattice BðUn;An;Ln;HnÞ. More precisely, we have the following proposition.

Proposition 10. Let BðUn;An;Ln;HnÞ be the cognitive concept lattice of the cognitive operators Ln and Hn, and GLnHn be thecorresponding granular concepts. Then for any B0 # A, we have0 1

AprðB0Þ ¼ intent_

ðX;BÞ2G#LnHn

;B0 # B

ðX; BÞB@ CA;

AprðB0Þ ¼ intent^

ðX;BÞ2G�LnHn;B # B0

ðX; BÞ

0@

1A:

ð34Þ

That is,

AprðB0Þ ¼\

ðX;BÞ2G#LnHn

;B0 # B

B;

AprðB0Þ ¼ LnHn

[ðX;BÞ2G�LnHn

;B # B0

B

0@

1A:

ð35Þ

Proposition 11. Let ðHnðAprðB0ÞÞ;AprðB0ÞÞ and ðHnðAprðB0ÞÞ;AprðB0ÞÞ be the learning cognitive concepts from an attribute set

B0 based on GLnHn . If AprðB0Þ ¼ AprðB0Þ, there is only one learning cognitive concept from B0 which is ðHnðB0Þ;LnHnðB0ÞÞ.

Proof. It is immediate from Eq. (32). h

In summary, for a given attribute set B0, we learn one exact cognitive concept ðHnðB0Þ;LnHnðB0ÞÞ with the learning accu-racy bðB0Þ ¼ 1 if AprðB0Þ ¼ AprðB0Þ; otherwise, we can only learn two approximate cognitive concepts ðHnðAprðB0ÞÞ;AprðB0ÞÞ

and ðHnðAprðB0ÞÞ;AprðB0ÞÞ with bðB0Þ ¼ 1� jAprðB0Þj�jAprðB0ÞjjAn j . Algorithm 3 describes how to compute them.

Algorithm 3. Concept learning from an attribute set

Require: The granular concepts GLnHn of a cognitive computing system S ¼[ni¼2

fSLiHig and an attribute set B0.

Ensure: An exact or two approximate cognitive concepts with learning accuracy for B0.1: Initialize Px ¼ ;;Pa ¼ ;, Xx ¼ ;;Xa ¼ ;; bðB0Þ ¼ 1;m ¼ 1 and label the elements of GLnHn as

ðHnLnðx1Þ;Lnðx1ÞÞ; HnLnðx2Þ;Lnðx2ÞÞ; . . . ; ðHnLnðxsÞ;LnðxsÞÞ,ðHnða1Þ;LnHnða1ÞÞ; ðHnða2Þ;LnHnða2ÞÞ; . . . ; ðHnðatÞ;LtHnðatÞÞ;

2: For each i 2 f1;2; . . . ; sg3: If B0 #LnðxiÞ4: Px Px [ fðHnLnðxiÞ;LnðxiÞÞg;5: End If6: If LnðxiÞ# B0

7: Xx Xx [ fðHnLnðxiÞ;LnðxiÞÞg;8: End If9: End For

10: For each j 2 f1;2; . . . ; tg

(continued on next page)

cite this article in press as: J. Li et al., Concept learning via granular computing: A cognitive viewpoint, Inform. Sci. (2014), http://.org/10.1016/j.ins.2014.12.010

Page 16: Concept learning via granular computing: A cognitive viewpoint · 2014. 12. 18. · 1 3 Concept learning via granular computing:A cognitive viewpoint 4 5 6 Q1 Jinhai Li a,⇑, Changlin

753

754

755

756

757

758

759

760

761762

764764

765

766

767

768

769

770

771

772

773

774

775

776

777

16 J. LiQ1 et al. / Information Sciences xxx (2014) xxx–xxx

INS 11294 No. of Pages 21, Model 3G

16 December 2014

PQ1

d

11: If B0 #LnHnðajÞ12: Pa Pa [ fðHnðajÞ;LnHnðajÞÞg;13: End If14: If LnHnðajÞ# B0

15: Xa Xa [ fðHnðajÞ;LnHnðajÞÞg;16: End If17: End For18: Let P ¼ Pa [Px;X ¼ Xa [Xx, add ð;;AnÞ into P when ð;;AnÞ is a cognitive concept and ðUn; ;Þ into X when ðUn; ;Þ

is a cognitive concept, and compute AprðB0Þ ¼\

ðX;BÞ2PB and AprðB0Þ ¼ LnHn

[ðX;BÞ2X

B

0@

1A;

19: If AprðB0Þ ¼ AprðB0Þ20: X0 ¼

\a2AprðB0Þ

HnðaÞ;

21: Else

22: reset m ¼ 2 and compute X0 ¼\

a2AprðB0ÞHnðaÞ, X0 ¼

\a2AprðB0Þ

HnðaÞ and bðB0Þ ¼ 1� jAprðB0Þj�jAprðB0ÞjjAn j ;

23: End If24: Return ðX0;AprðB0ÞÞ and bðB0Þ when m ¼ 1; otherwise, ðX0;AprðB0ÞÞ, ðX0;AprðB0ÞÞ and bðB0Þ.

According to Eq. (35), Steps 2–18 in Algorithm 3 are to compute the lower and upper approximations of the attribute setB0. Moreover, Steps 19–24 are to learn one exact or two approximate cognitive concepts from B0 as well as the learning accu-racy bðB0Þ. Moreover, it is easy to verify that the time complexity of Algorithm 3 is OðjUnj2 þ jUnjjAnj þ jAnj2Þ.

Example 6. Continued with Example 4, we suppose fever and diarrhea receive more attention from doctors and so doheadache and diarrhea. Then which patients as a whole suffer and only suffer from fever and diarrhea (headache anddiarrhea)? In order to answer this question, we need to learn cognitive concept(s) from the given attribute sets B1 ¼ fa; egand B2 ¼ fc; eg based on the obtained granular concepts GL2H2 which can be found at the end of Example 4. By Eq. (35), wehave

leasex.doi

AprðB1Þ ¼\

ðX;BÞ2G#L2H2

;B1 # B

B ¼ fa; c; eg \ A2 ¼ fa; c; eg;

AprðB1Þ ¼ L2H2

[ðX;BÞ2G�L2H2

;B # B1

B

0@

1A ¼ L2H2ð; [ fagÞ ¼ fag;

AprðB2Þ ¼\

ðX;BÞ2G#L2H2

;B2 # B

B ¼ fc; eg \ fa; c; eg \ A2 ¼ fc; eg;

AprðB2Þ ¼ L2H2

[ðX;BÞ2G�L2H2

;B # B2

B

0@

1A ¼ L2H2ðfcg [ fc; egÞ ¼ fc; eg:

Thus, we learn two approximate cognitive concepts ðf5g; fa; c; egÞ and ðf1;4;5;7g; fagÞ from B1 with bðB1Þ ¼ 57. Then we know

that there do not exist some patients as a whole suffering and only suffering from fever and diarrhea, but patient 5 suffersfrom fever, headache and diarrhea, and patients 1, 4, 5, 7 as a whole suffer from fever. Moreover, we learn an exact cognitiveconcept ðf5;9g; fc; egÞ from B2 with bðB2Þ ¼ 1, which means that patients 5 and 9 as a whole suffer and only suffer from head-ache and diarrhea.

5.3. Concept learning from a pair of object and attribute sets

In this subsection, we study the problem of learning one exact or two approximate cognitive concepts from a pair ofobject and attribute sets by means of set approximations.

For a pair ðX0; B0Þ of object and attribute sets, concept learning is quite different from that of an object set X0 or attributeset B0. More precisely, for a given object set X0, we can consider it as ðX0;LnðX0ÞÞ in which LnðX0Þ is an intent induced by X0.Similarly, for a given attribute set B0, we can consider it as ðHnðB0Þ;B0Þ in which HnðB0Þ is an extent induced by B0. However,for a given pair ðX0;B0Þ, it is not known whether B0 is an intent associated to X0, or X0 is an extent associated to B0. Evensometimes, X0 and B0 are less associated with each other with respect to the extent-intent relationship, which means that

cite this article in press as: J. Li et al., Concept learning via granular computing: A cognitive viewpoint, Inform. Sci. (2014), http://.org/10.1016/j.ins.2014.12.010

Page 17: Concept learning via granular computing: A cognitive viewpoint · 2014. 12. 18. · 1 3 Concept learning via granular computing:A cognitive viewpoint 4 5 6 Q1 Jinhai Li a,⇑, Changlin

778

779

780

781

782

783

784

785

786

787

788

789

790

791792

794794

795796

798798

799

800

801

802

803

804

805

806807

809809

810811

813813

814

815

816

817

818

819

820

821

822823

825825

826827

829829

830

831832

833

J. LiQ1 et al. / Information Sciences xxx (2014) xxx–xxx 17

INS 11294 No. of Pages 21, Model 3G

16 December 2014

Q1

in this case it may not be reasonable to learn cognitive concept(s) from the pair ðX0;B0Þ. Motivated by this problem, we putforward the notion of a concept-inducible pair of object and attribute sets.

Definition 9. Let BðUn;An;Ln;HnÞ be the cognitive concept lattice of the cognitive operators Ln and Hn, and GLnHn be thecorresponding granular concepts. For any X0 # Un and B0 # An, if AprðX0Þ#HnðB0Þ# AprðX0Þ and AprðB0Þ#LnðX0Þ# AprðB0Þ,then ðX0;B0Þ is said to be concept-inducible; otherwise, it is said to be concept-uninducible.

Example 7. Continued with Examples 4–6, it can be known from Definition 9 that the pair ðf3;4;5g; fa; egÞ is concept-unin-ducible since Aprðf3;4;5gÞ#Hnðfa; egÞ# Aprðf3;4;5gÞ does not hold due to Aprðf3;4;5gÞ ¼ f4;5g, Hnðfa; egÞ ¼ f5g andAprðf3;4;5gÞ ¼ f3;4;5;9g.

In what follows, we only focus on concept-inducible pairs for concept learning since concept-uninducible ones mean thatthe object set X0 and the attribute set B0 are less associated with each other with respect to the extent-intent relationship.

Proposition 12. Let BðUn;An;Ln;HnÞ be the cognitive concept lattice of the cognitive operators Ln and Hn, and GLnHn be the cor-responding granular concepts. Then, for any X0 # Un and B0 # An, ðX0;LnðX0ÞÞ and ðHnðB0Þ;B0Þ are concept-inducible pairs.

Proof. Firstly, we prove that the pair ðX0;LnðX0ÞÞ is concept-inducible. On one hand, by Eq. (26), we haveAprðX0Þ#HnðLnðX0ÞÞ# AprðX0Þ. On the other hand, by Eq. (31), we obtain

Pleasedx.doi

AprðLnðX0ÞÞ ¼\

ðX;BÞ2BðUn ;An ;Ln ;HnÞ;LnðX0Þ# B

B;

AprðLnðX0ÞÞ ¼ LnHn

[ðX;BÞ2BðUn ;An ;Ln ;HnÞ;B #LnðX0Þ

B

0@

1A:

Note that

LnHn

[ðX;BÞ2BðUn ;An ;Ln ;HnÞ;B #LnðX0Þ

B

0@

1A#LnðX0Þ#

\ðX;BÞ2BðUn ;An ;Ln ;HnÞ;LnðX0Þ# B

B:

Then it follows AprðLnðX0ÞÞ#LnðX0Þ# AprðLnðX0ÞÞ. To sum up, we conclude that ðX0;LnðX0ÞÞ is concept-inducible.In a similar manner, we can prove that the pair ðHnðB0Þ;B0Þ is also concept-inducible. h

Combining Proposition 12 with the discussion in the front of Section 5.3, we know that it is concept-inducible for the caseof an object set or attribute set. This is why we directly implement concept learning in Sections 5.1 and 5.2.

In what follows, we discuss how to learn cognitive concept(s) from a concept-inducible pair of object and attribute sets.

Proposition 13. For a concept-inducible pair ðX0;B0Þ, let ðAprðX0Þ;LnðAprðX0ÞÞÞ and ðAprðX0Þ;LnðAprðX0ÞÞÞ be the learningcognitive concepts from X0, and ðHnðAprðB0ÞÞ;AprðB0ÞÞ and ðHnðAprðB0ÞÞ;AprðB0ÞÞ be the learning cognitive concepts from B0.Then

ðHnðAprðB0ÞÞ;AprðB0ÞÞ � kðX0Þ � ðHnðAprðB0ÞÞ;AprðB0ÞÞ ð36Þ

and

ðAprðX0Þ;LnðAprðX0ÞÞÞ � lðB0Þ � ðAprðX0Þ;LnðAprðX0ÞÞÞ; ð37Þ

where kðX0Þ ¼ ðHnLnðX0Þ;LnðX0ÞÞ and lðB0Þ ¼ ðHnðB0Þ;LnHnðB0ÞÞ.

Proof. It follows directly from Definition 9. h

According to Eqs. (26), (32), (36) and (37), we have the following proposition.

Proposition 14. For a concept-inducible pair ðX0;B0Þ, let ðAprðX0Þ;LnðAprðX0ÞÞÞ and ðAprðX0Þ;LnðAprðX0ÞÞÞ be the learning

cognitive concepts from X0, and ðHnðAprðB0ÞÞ;AprðB0ÞÞ and ðHnðAprðB0ÞÞ;AprðB0ÞÞ be the learning cognitive concepts from B0.Then

ðAprðX0Þ;LnðAprðX0ÞÞÞ _ ðHnðAprðB0ÞÞ;AprðB0ÞÞ � kðX0Þ � ðAprðX0Þ;LnðAprðX0ÞÞÞ ^ ðHnðAprðB0ÞÞ;AprðB0ÞÞ ð38Þ

and

ðAprðX0Þ;LnðAprðX0ÞÞÞ _ ðHnðAprðB0ÞÞ;AprðB0ÞÞ � lðB0Þ � ðAprðX0Þ;LnðAprðX0ÞÞÞ ^ ðHnðAprðB0ÞÞ;AprðB0ÞÞ; ð39Þ

where kðX0Þ ¼ ðHnLnðX0Þ;LnðX0ÞÞ and lðB0Þ ¼ ðHnðB0Þ;LnHnðB0ÞÞ.

cite this article in press as: J. Li et al., Concept learning via granular computing: A cognitive viewpoint, Inform. Sci. (2014), http://.org/10.1016/j.ins.2014.12.010

Page 18: Concept learning via granular computing: A cognitive viewpoint · 2014. 12. 18. · 1 3 Concept learning via granular computing:A cognitive viewpoint 4 5 6 Q1 Jinhai Li a,⇑, Changlin

834835

837837

838839

841841

842

843

844845

847847

848

849

850

851

852

853

854

855

856

857

858

859

860

861

862

880

881

882

883

18 J. LiQ1 et al. / Information Sciences xxx (2014) xxx–xxx

INS 11294 No. of Pages 21, Model 3G

16 December 2014

Q1

Based on the above discussion, if a pair ðX0;B0Þ is concept-inducible, we consider

Pleasedx.doi

ðAprðX0Þ;LnðAprðX0ÞÞÞ_ðHnðAprðB0ÞÞ;AprðB0ÞÞ ð40Þ

and

ðAprðX0Þ;LnðAprðX0ÞÞÞ^ðHnðAprðB0ÞÞ;AprðB0ÞÞ ð41Þ

as the learning cognitive concepts from ðX0;B0Þ by means of set approximations. Note that the formulas in Eqs. (40) and (41)are equal to ðHnðAprðB0ÞÞ;AprðB0ÞÞ and ðAprðX0Þ;LnðAprðX0ÞÞÞ, respectively. Thus, we define the (concept) learning accuracyas

cðX0;B0Þ ¼ 1�jAprðX0Þj � jHnðAprðB0ÞÞj

2jUnjþjAprðB0Þj � jLnðAprðX0ÞÞj

2jAnj

!; ð42Þ

which is used to measure the accuracy of learning cognitive concepts from ðX0;B0Þ. Obviously, the learning accuracy cðX0;B0Þequals 1 if and only if AprðX0Þ ¼ HnðAprðB0ÞÞ and AprðB0Þ ¼ LnðAprðX0ÞÞ.

Proposition 15. For a concept-inducible pair ðX0;B0Þ, let ðAprðX0Þ;LnðAprðX0ÞÞÞ and ðAprðX0Þ;LnðAprðX0ÞÞÞ be the learning

cognitive concepts from X0, and ðHnðAprðB0ÞÞ;AprðB0ÞÞ and ðHnðAprðB0ÞÞ;AprðB0ÞÞ be the learning cognitive concepts from B0. If

AprðX0Þ ¼ HnðAprðB0ÞÞ and AprðB0Þ ¼ LnðAprðX0ÞÞ, there is only one learning cognitive concept from ðX0;B0Þ which isðHnðB0Þ;LnðX0ÞÞ.

Proof. It is immediate from Eqs. (38) and (39). h

In particular, if the concept-inducible pair ðX0;B0Þ is a cognitive concept, it is easy to verify that its learning cognitive con-cept is just itself.

In summary, for a given concept-inducible pair ðX0;B0Þ, we learn an exact cognitive concept ðHnðB0Þ;LnðX0ÞÞ with thelearning accuracy cðX0;B0Þ ¼ 1 if AprðX0Þ ¼ HnðAprðB0ÞÞ and AprðB0Þ ¼ LnðAprðX0ÞÞ; otherwise, we can only learn twoapproximate cognitive concepts (see Eqs. (40) and (41) for details) with the learning accuracy cðX0; B0Þ < 1 (see Eq. (42)for details).

Algorithm 4. Concept learning from a pair of object and attribute sets.

Require: The granular concepts GLnHn of a cognitive computing system S ¼[ni¼2

fSLiHig and the pair ðX0;B0Þ.

Ensure: An exact or two approximate cognitive concepts with learning accuracy for concept-inducible pair ðX0;B0Þ.1: Initialize m ¼ 0;2: Call Algorithm 2 to learn the cognitive concepts ðAprðX0Þ;LnðAprðX0ÞÞÞ and ðAprðX0Þ;LnðAprðX0ÞÞÞ from X0, and

Algorithm 3 to learn the cognitive concepts ðHnðAprðB0ÞÞ;AprðB0ÞÞ and ðHnðAprðB0ÞÞ;AprðB0ÞÞ from B0;

3: If AprðX0Þ#\

a2B0

HnðaÞ# AprðX0Þ or AprðB0Þ#\

x2X0

LnðxÞ# AprðB0Þ does not hold

4: Return ‘‘the pair ðX0;B0Þ is concept-uninducible’’;5: Else6: If AprðX0Þ ¼ HnðAprðB0ÞÞ and AprðB0Þ ¼ LnðAprðX0ÞÞ7: Return ðHnðB0Þ;LnðX0ÞÞ and cðX0;B0Þ ¼ 1;8: Else9: do

ðX1;B1Þ ðAprðX0Þ;LnðAprðX0ÞÞÞ _ ðHnðAprðB0ÞÞ;AprðB0ÞÞðX2;B2Þ ðAprðX0Þ;LnðAprðX0ÞÞÞ ^ ðHnðAprðB0ÞÞ;AprðB0ÞÞcðX0;B0Þ ¼ 1� jAprðX0Þj�jHnðAprðB0ÞÞj

2jUn j þ jAprðB0Þj�jLnðAprðX0ÞÞj2jAn j

� �Return ðX1;B1Þ; ðX2;B2Þ and cðX0;B0Þ;

10: End If11: End If

It can be known from Definition 9 and Eqs. (40) and (41) that Algorithm 4 is designed to learn an exact or two approx-imate cognitive concepts (if any) from a pair of object and attribute sets. Moreover, it is easy to verify that the time complex-ity of Algorithm 4 is OðjUnj2 þ jUnjjAnj þ jAnj2Þ.

cite this article in press as: J. Li et al., Concept learning via granular computing: A cognitive viewpoint, Inform. Sci. (2014), http://.org/10.1016/j.ins.2014.12.010

Page 19: Concept learning via granular computing: A cognitive viewpoint · 2014. 12. 18. · 1 3 Concept learning via granular computing:A cognitive viewpoint 4 5 6 Q1 Jinhai Li a,⇑, Changlin

884

885

886

887

888

889

890

891

892

893

894

895

896

897

898

899

900

901

902

903

904

905

906

907

908

909

910

911

912

913

914

915

916

917

918

919

920

921

922

923

924

925

926

927

928

929

930

931

932

933

934

935

936

937

938

J. LiQ1 et al. / Information Sciences xxx (2014) xxx–xxx 19

INS 11294 No. of Pages 21, Model 3G

16 December 2014

Q1

Example 8. Continued with Example 5, where patients 3, 4 and 5 were supposed to be children suffering from SARS.Moreover, it can be seen from Table 2 that these children have the common symptom headache. Then, can these children andthe symptom headache characterize each other in terms of suffering from SARS? In order to answer this question, we need tolearn cognitive concept(s) from the pair ðX0;B0Þ with X0 ¼ f3;4;5g and B0 ¼ fcg based on the obtained granular conceptsGL2H2 which can be found at the end of Example 4.

It is easy to verify that AprðX0Þ#H2ðB0Þ# AprðX0Þ and AprðB0Þ#L2ðX0Þ# AprðB0Þ can be satisfied simultaneously. By Def-inition 9, ðX0;B0Þ is concept-inducible. Furthermore, according to Algorithm 4, we learn an exact cognitive conceptðf3;4;5;9g; fcgÞ from ðX0;B0Þ with the learning accuracy cðX0;B0Þ ¼ 1. Thus, the children (i.e., patients 3, 4, 5) and the symp-tom headache cannot characterize each other in terms of suffering from SARS, but patients 3, 4, 5, 9 suffer and only sufferfrom headache and in the meanwhile the symptom headache characterizes patients 3, 4, 5 and 9 exactly.

6. Discussion

In this section, we discuss the differences and relations between the proposed method and the existing ones on conceptlearning, and give explanations on some obtained results in this paper.

Firstly, we analyze the differences from the following three aspects: (a) cognitive mechanism, (b) cognitive computingsystem, and (c) cognitive process.

� The existing literature mainly focused on concept learning via concept systems (e.g., [18,19,31,45]) which wereestablished by axiomatic ways, regardless of the analysis on cognitive mechanism. However, the current studyhas carefully analyzed the cognitive mechanism of forming concepts based on the principles from philosophyand cognitive psychology, and then naturally found the constraints for cognitive operators to better simulate intel-ligence behaviors of the brain including perception, attention and learning.

� The existing work put forward cognitive computing systems (e.g., [18,19,31,45]) by means of different axiomaticways, which cannot integrate past experiences into itself to deal with e.g., dynamic data. However, the currentstudy has proposed such a cognitive computing system that is composed of a series of cognitive computing statesand is able to integrate past experiences into itself through recursive thinking. In addition, granular computing hasalso been integrated into the proposed cognitive computing system to decrease the computation time sharply.

� The existing researches on cognitive process mainly investigated the problem of learning concept(s) from a givenpair of object and attribute sets by means of iterative algorithms [31,45], regardless of discussing whether the pairof object and attribute sets is concept-inducible or not, let alone the learning accuracy. However, the current paperhas put forward the notion of a concept-inducible pair of object and attribute sets and a simple way of learning con-cept(s) from the concept-inducible pair via set approximations. What is more, how to measure the concept learningaccuracy has been studied as well.

Secondly, we analyze the relations between the proposed method and the existing ones from the following two aspects:(1) cognitive computing, and (2) application.

� The existing work (e.g., [18,19,31,45]) showed to some extent pieces of the idea of cognitive computing in studyingconcept learning. For example, the importance of applying cognitive viewpoint to concept learning was mentionedin [45]. Learning concept(s) from a given pair of object and attribute sets by iterative algorithm was considered as anatural reflection of cognition. Motivated by these work, in this paper we have explicitly applied the idea of cog-nitive computing to concept learning based on granular computing, including a detailed discussion of cognitivemechanism, cognitive computing system and cognitive process.

� Both the proposed method and the existing ones allow users to specify the operators in the cognitive computingsystem. In other words, users can remould the operators according to their certain requirements of data analysisbefore learning concepts through the cognitive computing system.

Finally, we give explanations on some obtained results in this paper.

� Some basic propositions (e.g., Propositions 1–4) of the proposed cognitive operators L and H are similar to thoseobtained by Zhang Wenxiu’s research group [18,19,31] in formal concept analysis since L and H here form Galoisconnection as well. However, the difference is that the proposed cognitive operators are characterized by the axi-oms in Definition 1 which are from the principles in philosophy and cognitive psychology.

� Since the time complexities of Algorithms 1–4 are OðnðjUnj þ jAnjÞjUnjjAnjÞ;OðjUnj2 þ jUnjjAnj þ jAnj2Þ,OðjUnj2 þ jUnjjAnj þjAnj2Þ and OðjUnj2 þ jUnjjAnj þ jAnj2Þ, respectively, the proposed concept learning method canbe completed in polynomial time. However, the classical algorithms in [10] take exponential time in the worst casefor concept learning. So, granular computing integrated into cognitive concept lattice can indeed improve the effi-ciency of concept learning.

Please cite this article in press as: J. Li et al., Concept learning via granular computing: A cognitive viewpoint, Inform. Sci. (2014), http://dx.doi.org/10.1016/j.ins.2014.12.010

Page 20: Concept learning via granular computing: A cognitive viewpoint · 2014. 12. 18. · 1 3 Concept learning via granular computing:A cognitive viewpoint 4 5 6 Q1 Jinhai Li a,⇑, Changlin

939

940

941

942

943

944

945

946

947

948

949

950

951

952

953

954

955

956

957

958

959 Q2Q3

960

961

962

963964965966967968969970971972973974975976977978979980981982983984985986987988989990991992993994995996997998999

1000100110021003

20 J. LiQ1 et al. / Information Sciences xxx (2014) xxx–xxx

INS 11294 No. of Pages 21, Model 3G

16 December 2014

Q1

7. Conclusions

In order to improve efficiency and flexibility of concept learning, this paper mainly focuses on concept learning via gran-ular computing from the viewpoint of cognitive computing. To be more concrete, cognitive mechanism of forming conceptshas been analyzed based on the principles from philosophy and cognitive psychology. Then granular computing has beencombined with the cognitive concept lattice to improve the efficiency of concept learning. What is more, we have put for-ward a cognitive computing system which is the initial environment to learn composite concepts and can integrate pastexperiences into itself for enhancing the flexibility of concept learning. In addition, cognitive processes have also been inves-tigated to deal with the problem of learning one exact or two approximate cognitive concepts from a given object set, attri-bute set or pair of object and attribute sets. The obtained results in this paper may be beneficial to simulating intelligencebehaviors of the brain including perception, attention and learning, but it still needs to be further confirmed.

In fact, integrating the idea of cognitive computing into concept learning is a promising and challenging research direc-tion. Although in this paper we have discussed it from the aspects of cognitive mechanism, cognitive computing system andcognitive process, an in-depth study of this issue still needs to be made in our future work. For instance, (i) how to deal withthe problem of learning concept(s) from a concept-uninducible pair because in this paper we are only interested in concept-inducible pair in terms of concept learning from a pair of object and attribute sets; (ii) large databases in the real worldshould be conducted to show the effectiveness of the proposed concept learning method; (iii) motivated by the logical rea-soning work [36] in rough set theory, logical reasoning should also be integrated (if possible) into the proposed conceptlearning method for better simulating intelligence behaviors of the brain including perception, attention and learning.

Acknowledgements

The authors would like to thank anonymous reviewers for their valuable comments and helpful suggestions which lead toa significant improvement on the manuscript. This work was supported by the National Natural Science Foundation of China(Nos. 61305057, 61322211, 61202018 and 61203283) and the Natural Science Research Foundation of Kunming Universityof Science and Technology (No. 14118760).

References

[1] R.M. Anderson, C. Fraser, A.C. Ghani, et al, transmission dynamics and control of SARS: the 2002–2003 epidemic, Philos. Trans. Roy. Soc. Lond. Ser. B-Biol. Sci. 359 (2004) 1091–1105.

[2] A. Bargiela, W. Pedrycz, Granular Computing: An Introduction, Kluwer Academic Publishers, Dordrecht, 2003.[3] A. Bargiela, W. Pedrycz, Granular mappings, IEEE Trans. Syst. Man Cybern. Part A 35 (2) (2005) 292–297.[4] A. Bargiela, W. Pedrycz, A model of granular data: a design problem with the Tchebyschev FCM, Soft. Comput. 9 (2005) 155–163.[5] A. Bargiela, W. Pedrycz, Human-Centric Information Processing Through Granular Modelling, Springer-Verlag, Heidelberg, 2009.[6] R. Belohlávek, Concept lattice and order in fuzzy logic, Ann. Pure Appl. Logic 128 (1-3) (2004) 277–298.[7] R. Belohlávek, B.D. Baets, J. Konecny, Granularity of attributes in formal concept analysis, Inf. Sci. 260 (2014) 149–170.[8] J.A. Deutsch, D. Deutsch, Attention: some theoretical considerations, Psychol. Rev. 70 (1963) 80–90.[9] I. Düntsch, G. Gediga, Modal-style operators in qualitative data analysis, in: Proceedings of the 2002 IEEE International Conference on Data Mining,

Springer, Washington, D.C., 2002, pp. 155–162.[10] B. Ganter, R. Wille, Formal Concept Analysis: Mathematical Foundations, Springer, Berlin, 1999.[11] L.K. Guo, F.P. Huang, Q.G. Li, G.Q. Zhang, Power contexts and their concept lattices, Discrete Math. 311 (18-19) (2011) 2049–2063.[12] X.P. Kang, D.Y. Li, S.G. Wang, K.S. Qu, Formal concept analysis based on fuzzy granularity base for different granulations, Fuzzy Sets Syst. 203 (2012)

33–48.[13] D.B. King, M. Wertheimer, Max Wertheimer and Gestalt Theory, Transaction Publishers, Piscataway, 2004.[14] K. Koffka, Principles of Gestalt Psychology, Harcourt, San Diego, 1967.[15] J. Li, C. Mei, Y. Lv, Knowledge reduction in real decision formal contexts, Inf. Sci. 189 (2012) 191–207.[16] J. Li, C. Mei, Y. Lv, Incomplete decision contexts: approximate concept construction, rule acquisition and knowledge reduction, Int. J. Approx. Reason. 54

(1) (2013) 149–165.[17] C.H. Liu, D.Q. Miao, J. Qian, On multi-granulation covering rough sets, Int. J. Approx. Reason. 55 (6) (2014) 1404–1418.[18] J.M. Ma, W.X. Zhang, Axiomatic characterizations of dual concept lattices, Int. J. Approx. Reason. 54 (5) (2013) 690–697.[19] J.M. Ma, W.X. Zhang, Y. Leung, X.X. Song, Granular computing and dual Galois connection, Inf. Sci. 177 (23) (2007) 5365–5377.[20] J. Medina, Relating attribute reduction in formal, object-oriented and property-oriented concept lattices, Comput. Math. Appl. 64 (6) (2012) 1992–

2002.[21] J. Medina, M. Ojeda-Aciego, Dual multi-adjoint concept lattices, Inf. Sci. 225 (2013) 47–54.[22] D.S. Modha, R. Ananthanarayanan, S.K. Esser, et al, Cognitive computing, Commun. ACM 54 (8) (2011) 62–71.[23] Z. Pawlak, Rough sets, Int. J. Comput. Inf. Sci. 11 (5) (1982) 341–356.[24] W. Pedrycz, From granular computing to computational intelligence and human-centric systems, IEEE Connect. 3 (2) (2005) 6–11.[25] W. Pedrycz, Knowledge-Based Clustering: From Data to Information Granules, John Wiley, Hoboken, NJ, 2005.[26] W. Pedrycz, Granular Computing: Analysis and Design of Intelligent Systems, CRC Press/Francis Taylor, Boca Raton, 2013.[27] W. Pedrycz, A. Bargiela, Granular clustering: a granular signature of data, IEEE Trans. Syst. Man Cybern. Part B: Cybern. 32 (2002) 212–224.[28] W. Pedrycz, A. Skowron, V. Kreinovich, Handbook of Granular Computing, Wiley, 2008.[29] Y.H. Qian, J.Y. Liang, W. Pedrycz, C.Y. Dang, Positive approximation: an accelerator for attribute reduction in rough set theory, Artif. Intell. 174 (2010)

597–618.[30] Y.H. Qian, J.Y. Liang, Y.Y. Yao, C.Y. Dang, MGRS: a multi-granulation rough set, Inf. Sci. 180 (6) (2010) 949–970.[31] G.F. Qiu, J.M. Ma, H.Z. Yang, W.X. Zhang, A mathematical model for concept granular computing systems, Sci. China Inf. Sci. 53 (7) (2010) 1397–1408.[32] J. Saquer, J. Deogun, Concept approximations based on rough sets and similarity measures, Int. J. Appl. Math. Comput. Sci. 11 (3) (2001) 655–674.[33] G. Shafer, A Mathematical Theory of Evidence, Princeton University Press, Princeton, New Jersey, 1976.[34] M.W. Shao, M. Liu, W.X. Zhang, Set approximations in fuzzy formal concept analysis, Fuzzy Sets Syst. 158 (23) (2007) 2627–2640.[35] Y.H. She, X.L. He, On the structure of the multigranulation rough set model, Knowl.-Based Syst. 36 (2012) 81–92.

Please cite this article in press as: J. Li et al., Concept learning via granular computing: A cognitive viewpoint, Inform. Sci. (2014), http://dx.doi.org/10.1016/j.ins.2014.12.010

Page 21: Concept learning via granular computing: A cognitive viewpoint · 2014. 12. 18. · 1 3 Concept learning via granular computing:A cognitive viewpoint 4 5 6 Q1 Jinhai Li a,⇑, Changlin

10041005100610071008100910101011101210131014101510161017101810191020102110221023102410251026102710281029103010311032

1033

J. LiQ1 et al. / Information Sciences xxx (2014) xxx–xxx 21

INS 11294 No. of Pages 21, Model 3G

16 December 2014

Q1

[36] Y.H. She, On the rough consistency measures of logic theories and approximate reasoning in rough logic, Int. J. Approx. Reason. 55 (1) (2014) 486–499.[37] Y. Wang, On concept algebra: a denotational mathematical structure for knowledge and software modelling, Int. J. Cogn. Inform. Natural Intell. 2 (2)

(2008) 1–19.[38] Y. Wang, On cognitive computing, Int. J. Softw. Sci. Comput. Intell. 1 (3) (2009) 1–15.[39] Y. Wang, L.A. Zadeh, Y.Y. Yao, On the system algebra foundations for granular computing, J. Softw. Sci. Comput. Intell. 1 (1) (2009) 64–86.[40] L.D. Wang, X.D. Liu, Concept analysis via rough set and AFS algebra, Inf. Sci. 178 (21) (2008) 4125–4137.[41] L. Wei, X.H. Zhang, J.J. Qi, Granular reduction of property-oriented concept lattices, Lect. Notes Comput. Sci. 6208 (2010) 154–164.[42] R. Wille, Restructuring lattice theory: an approach based on hierarchies of concepts, in: I. Rival (Ed.), Ordered Sets, Reidel, Dordrecht-Boston, 1982, pp.

445–470.[43] W.Z. Wu, Y. Leung, J.S. Mi, Granular computing and knowledge reduction in formal contexts, IEEE Trans. Knowl. Data Eng. 21 (10) (2009) 1461–1474.[44] W.Z. Wu, Y. Leung, Theory and applications of granular labelled partitions in multi-scale decision tables, Inf. Sci. 181 (18) (2011) 3878–3897.[45] W.H. Xu, J.Z. Pang, S.Q. Luo, A novel cognitive system model and approach to transformation of information granules, Int. J. Approx. Reason. 55 (3)

(2014) 853–866.[46] W.H. Xu, Q.R. Wang, X.T. Zhang, Multi-granulation rough sets based on tolerance relations, Soft. Comput. 17 (7) (2013) 1241–1252.[47] X.B. Yang, Y.S. Qi, X.N. Song, J.Y. Yang, Test cost sensitive multigranulation rough set: model and minimal cost selection, Inf. Sci. 250 (2013) 184–199.[48] Y.Y. Yao, Concept lattices in rough set theory, in: Proceedings of 2004 Annual Meeting of the North American Fuzzy Information Processing Society,

IEEE Computer Society, Washington, D.C., 2004, pp. 796–801.[49] Y.Y. Yao, A comparative study of formal concept analysis and rough set theory in data analysis, in: Proceedings of 4th International Conference on

Rough Sets and Current Trends in Computing (RSCTC 2004), Uppsala, Sweden, 2004, pp. 59–68.[50] Y.Y. Yao, Interpreting concept learning in cognitive informatics and granular computing, IEEE Trans. Syst. Man Cybern. Part B: Cybern. 39 (4) (2009)

855–866.[51] Y.Y. Yao, Y.H. Chen, Rough set approximations in formal concept analysis, Lect. Notes Comput. Sci. 4100 (2006) 285–305.[52] L.A. Zadeh, Fuzzy Sets and Information Granularity, Advances in Fuzzy Set Theory and Applications, North-Holland Publishing, Amsterdam, 1979.[53] L.A. Zadeh, Towards a theory of fuzzy information granulation and its centrality in human reasoning and fuzzy logic, Fuzzy Sets Syst. 90 (1997) 111–

117.[54] L.A. Zadeh, From computing with numbers to computing with words-From manipulation of measurements to manipulation of perceptions, IEEE Trans.

Circ. Syst. 45 (1999) 105–119.[55] W.X. Zhang, G.F. Qiu, Uncertain Decision Making Based on Rough Sets, Tsinghua University Press, Beijing, 2005.[56] Q.H. Zhang, Y.K. Xing, Formal concept analysis based on granular computing, J. Comput. Inf. Syst. 6 (7) (2010) 2287–2296.

Please cite this article in press as: J. Li et al., Concept learning via granular computing: A cognitive viewpoint, Inform. Sci. (2014), http://dx.doi.org/10.1016/j.ins.2014.12.010