Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015

36
Fractally-organized Connectionist Networks Vincenzo De Florio MOSAIC: UniAntwerp iMinds

Transcript of Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015

Page 1: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015

Fractally-organized Connectionist Networks

VincenzoDe FlorioMOSAIC: UniAntwerp iMinds

Page 2: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015

2

Times, they are a-changin’…

Less resources

Higher peaks, harder

shocks

Higher number

of users…

ICT

Energy product-ion & distribution

Businesses

Transport ofgoods & people

HEALTHCARE

ORGANIZATIONALCRISIS

Understanding & rethinkingour organizations is crucial!

Page 3: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015

3

With the meter in the red zone…• …organizations that

appeared to work fine reveal their limitations!– lose too much –use up too many resources–do not scale well– intolerable to changes– fail to address new aspects→Traditional approaches are

reaching structural limits.

Page 4: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015

A little world with big problems• Scale has changed– Data are big; users are many; requests and

needs to be answered are too many• Complexity has arisen and is spreading

through the layers of our interconnected infrastructures

• Interdependence increases fragility• Our design assumptions systematically

introduce yielding points.

Page 5: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015

Challenges• How do we address pervasive societal

problems such as healthcare & crisis management?• How do we rethink our organizations?

Which tools, which software could help?

1.Examples & ingredients2.A recipe3.Discussion4.Conclusions

This ppt

Page 6: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015

Example: A LED Lamp• A collective system

made of a largenumber of simple units

• Simple-behavioured "Parts" producinga simple-behavioured"Whole"

• A simple organization!– No need to "connect"– Connection: managed "physically", through

the additive properties of physical light.

Page 7: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015

Simple Parts, Simple Whole... Complex Emergence!

• Complex emerging properties!– Low power consumption– Higher efficiency– Graceful degradation: "Fuzzy" failure

semantics!

→ Small is (sometimes!) beautiful!

Page 8: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015

Example: Telemonitoring Servicein Project "Little Sister"

• Low-cost non-intrusivetelemonitoring solution

• Specially designed low-res sensors• Battery powered• All resources wrapped as

manageable web services• Deployed into a smart

house.

Page 9: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015

Simple Parts, Complex "Glue":Complex Emergence!

• A middleware component manages the WS• Middleware turns on / off the nodes– in function of the context / situation / required

operation / "mode"– Energy vs. Safety trade-offs: Sensors are used

only when needed to guarantee safety→ Prolonging the sensors' "lives"

• Connectionism: small and connected is (sometimes!) even more beautiful.

Page 10: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015

Connectionism

• Our first "ingredient"!• aka Parallel and distributed processing;

aka ANN• Networks of tiny units• Complexity is in the network rather than in

the units• Units: feature-like entities.

Page 11: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015

Connectionism

• State of activation: unit is participating / it is in sleep-mode

• Output of the unit: percentage of involvement

• Patterns of activity: how involvement "spreads" through the network

• Activation rule: next configuration, given the current one + context change.

Page 12: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015

Connectionism

• Modifying patterns of connectivity as a function of experience

• Done in PhD work (outside the scope of LS)– Tracking the performance of individual units– Gradual penalization / rewarding– Enrollment = f( "score" )

→ A learning step!

Page 13: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015

Connectionism

• Biggest limitations:– absolute simplicity– flat organization.

Page 14: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015

Example: Little Sister'sFractal Organization

• Idea: moving from absolute simplicity to relative simplicity

• Units are simple w.r.t. their "level"• Hierarchical organization of "fractals"• Each fractal, a WS group of units led by a

coordinator/representative: the MW.

Page 15: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015

LS Middleware• Based on a fork of Apache MUSE– “a Java-based implementation of the WS-

ResourceFramework (WSRF), WS-BaseNotification (WSN), and WS-DistributedManagement (WSDM) specifications”

• On top of Axis2• Partially implements the WSDM-MOWS

specifications (Web Services Distributed Management: Management of Web Services).

Page 16: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015

Laye

r 0(R

aw

com

po-

nent

s)

Laye

r 1

(e.g

.,Sm

art

Hou

se)

Laye

r 2

(e.g

, Sm

art

Bui

ldin

g)

Laye

r 3

(e.g

., Sm

art H

ospi

tal)

..Upp

er

laye

rs...

Page 17: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015

LS' fractal social organization

• Multi-tier distributed architecture• Services structured within hierarchical

federation reflecting structure of deployment environment– rooms; flats; building; external application

• Each level, a "fractal"– Same rules, different units– Service-oriented community.

Page 18: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015

Bind

Local analysisand coordination Intra-level

processing

Member

Service and feature registry

Servicedescription

Publish PublishCapabilitiesPoliciesAvailabilityLocations…

Roles &situations

Member MemberLS sensors Units MemberMember MemberMember

SoC's…

Inter-levelprocessing

Service-oriented CommunityException → Event propagation

Page 19: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015

FSO: Fractal organization of SoC's

• "Principle of increasing inclusiveness, so that entities at one level are composed of parts at lower levels and are themselves nested within more extensive entities"

• Nature's way: nested compositional hierarchies.

Page 20: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015

FSO: Fractal organization of SoC's

• Simplified version in LS– Predefined number of levels– Predefined operations– No semantic description and matching– No definition of new inter-level SoC's.

Page 21: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015

Fractal connectionism• Our "recipe"!• Connectionism with– relative simplicity– increasing inclusiveness.

Page 22: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015

Fractal connectionism

• Networks of fractals• Complexity is in the network and in the

units• Units: entities simple w.r.t. the current

level.

Page 23: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015

Fractal connectionism• State of activation: as in connectionism– unit is participating / it is in sleep-mode

• Output of the unit: percentage of involvement– FSO: all or nothing

• Patterns of activity: how involvement "spreads" through the network– FSO: enrollment and exceptions.

Page 24: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015

Fractal connectionism• Modifying patterns of connectivity as a

function of experience• Tracking the performance of individual

units and compounds• Permanentification: from transient to

permanent response→ A learning step!

Page 25: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015

Fractal Social Orgs

• Mathematical model: http://goo.gl/gvVGH5

• Geometrical and audio representations–Modularity–Self-similarity–Fractal dimension!

http://goo.gl/vO8RKj

Page 26: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015

0011

2222

2222

Page 27: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015

0123

4567

8

Page 28: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015

0011

2334

4

Page 29: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015

Conservation of modularity

Page 30: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015

• Complex FSOs• With NetLogo

Simulations

Page 31: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015

Simulations

Page 32: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015

Preliminary results

Page 33: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015

Conclusions• Two "Gestalts"– Connectionism, fractal organization

• F → C– relative simplicity; increasing inclusiveness

• C → F–Many gaps are revealed!–More complex states of activation and outputs

of the unit: nature and percentage of involvement.

Page 34: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015

Conclusions

• Small is beautiful→Small and connected is more beautiful →Relatively small and fractally organized is

even more so!

Page 35: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015

Thank you for your attention!

Questions?

Page 36: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015

[email protected] / uantwerpen.be

Blog: eraclios.blogspot.be

LinkedIn group "Computational Antifragility"

ANTIFRAGILE workshop

twitter://@EnzoDeFlorio