Agent based simulation and electricity market

42
September 25th, 2007 Real Collegio Carlo Alberto 1 Agent based simulation and electricity market Pietro TERNA, Department of Economic and Financial Science, University of Torino [email protected], http://web.econ.unito.it/terna Politecnico di Torino - Ceris – Hermes - AEIT Electricity market performance under physical constraints

description

Politecnico di Torino - Ceris – Hermes - AEIT Electricity market performance under physical constraints. Agent based simulation and electricity market Pietro TERNA, Department of Economic and Financial Science, University of Torino [email protected] , http://web.econ.unito.it/terna. - PowerPoint PPT Presentation

Transcript of Agent based simulation and electricity market

Page 1: Agent based simulation and electricity market

September 25th, 2007 Real Collegio Carlo Alberto 1

Agent based simulation and electricity market

Pietro TERNA, Department of Economic and Financial Science,University of Torino

[email protected], http://web.econ.unito.it/terna    

Politecnico di Torino - Ceris – Hermes - AEITElectricity market performance under physical constraints

Page 2: Agent based simulation and electricity market

September 25th, 2007 Real Collegio Carlo Alberto 2

_______________________________________

Building models:

three ways

_______________________________________

Page 3: Agent based simulation and electricity market

September 25th, 2007 Real Collegio Carlo Alberto 3

Three different symbol systems:

• verbal argumentations

• mathematics

• computer simulation (agent based)

Page 4: Agent based simulation and electricity market

September 25th, 2007 Real Collegio Carlo Alberto 4

_______________________________________

How to use agents in simulation models:

a radical view

_______________________________________

Page 5: Agent based simulation and electricity market

September 25th, 2007 Real Collegio Carlo Alberto 5

The radical characterization of an ABM must be found

into the possibility of real – direct or indirect (via the environment) – interaction amid the agents …

avoiding simplifications coming from the use aggregate (simultaneous) equations (going back to the Walrasian auctioneer)

Page 6: Agent based simulation and electricity market

September 25th, 2007 Real Collegio Carlo Alberto 6

_______________________________________

Agent based simulation

and real world representation

_______________________________________

Page 7: Agent based simulation and electricity market

September 25th, 2007 Real Collegio Carlo Alberto 7

Social simulation as a computer based way

to execute complex mental experiments,

but also as a via to represent the complexity of real world

simulation = agent-based models

Page 8: Agent based simulation and electricity market

September 25th, 2007 Real Collegio Carlo Alberto 8

_______________________________________

A dictionary

_______________________________________

Page 9: Agent based simulation and electricity market

September 25th, 2007 Real Collegio Carlo Alberto 9

A dictionary, from Conte R, Edmonds B, Moss S., Sawyer R.K., Sociology and Social Theory in Agent Based Social Simulation: A Symposium Computational & Mathematical Organization Theory 7, 183-205,2001

“1. The purpose of Agent Based Social Simulation (ABSS) is to analyse the properties of social systems defined by dense patterns of interaction among autonomous, cognitive

individuals.2. The same modelling techniques that are intended to represent real social systems can

also represent software systems such as the Internet and large federated data bases populated by intelligent information agents or, indeed, any other large, complex multi agent system. Multi agent based simulations (MABS) of such systems share the techniques of ABSS.”

My note:

• we use frequently the name of Agent Based Model (ABM) or Agent Computational Ecomics (ACE) instead of ABSS;

• in computer science the attention is devoted to Multi Agent Systems, MAS; adding “simulation” we have MABS and, in some way, ABSS.

Page 10: Agent based simulation and electricity market

September 25th, 2007 Real Collegio Carlo Alberto 10

_______________________________________

A general structure for agent-based simulation models, the ERA scheme

_______________________________________

Page 11: Agent based simulation and electricity market

September 25th, 2007 Real Collegio Carlo Alberto 11

http://web.econ.unito.it/terna/ct-era/ct-era.html

NNCSGA

Avatar

ERA,

Environment,

Rules, Agents

Page 12: Agent based simulation and electricity market

September 25th, 2007 Real Collegio Carlo Alberto 12

_______________________________________

Tools

_______________________________________

Page 13: Agent based simulation and electricity market

September 25th, 2007 Real Collegio Carlo Alberto 13

Swarm, http://www.swarm.org

SLAPP, Swarm-Like Agent Protocol in Python, temporary at http://eco83.econ.unito.it/terna/slapp ; Python at www.python.org

JAS, http://jaslibrary.sourceforge.net/

Ascape, http://www.brook.edu/dynamics/models/ascape/

Repast, http://repast.sourceforge.net/

StarLogo, http://education.mit.edu/starlogo/

StarLogo TNG, http://education.mit.edu/starlogo-tng/

NetLogo, http://ccl.northwestern.edu/netlogo/

SDML (based upon SmallTalk, as a declarative programming tool): http://www.cpm.mmu.ac.uk/sdml/

See also ABLE, http://www.research.ibm.com/able/

JADE, http://jade.tilab.com/

or DAML, www.daml.org

didactical perspective

nearly videogames

Page 14: Agent based simulation and electricity market

September 25th, 2007 Real Collegio Carlo Alberto 14

We have also specialized agent based simulators, like

jES and jESOFhttp://web.econ.unito.it/terna/jes/

a simulator useful to reproduce enterprises behavior

Page 15: Agent based simulation and electricity market

September 25th, 2007 Real Collegio Carlo Alberto 15

_______________________________________

The surprising world of the Chameleons, with SLAPP

From an idea of Marco Lamieri, a project work with Riccardo Taormina

_______________________________________

Page 16: Agent based simulation and electricity market

September 25th, 2007 Real Collegio Carlo Alberto 16

The reinforcement learning algorithm

A direct tool: the reinforcement learning. We have

a set of states S, related to an environment;

a set of possible actions A;

a set of scalar rewards, in .

At any time t we have an agent in a state st of S and we can chose the action a in A(st). After the action it will be in st+1 with a reward rt+1. Reward are summed over time with a discount rate factor. Our agent develops the capability of mapping all the possible actions A in a state S to all the related rewards.

Page 17: Agent based simulation and electricity market

September 25th, 2007 Real Collegio Carlo Alberto 17

The metaphorical models we use here is that of the changing color chameleons

We have chameleons of three colors: red, green and blue

When two chameleons of different colors meet, they both change their color, assuming the third one (If all chameleons get the same color, we have a steady state situation)

The metaphor is interpreted in the following way: an agent diffusing innovation or ideas (or political ideas) can change itself via the interaction with other agents: as an example think about an academic scholar working in a completely isolated context or interacting with other scholars or with private entrepreneurs to apply the results of her work

Page 18: Agent based simulation and electricity market

September 25th, 2007 Real Collegio Carlo Alberto 18

A simple rule for a complex environment

Let play

Page 19: Agent based simulation and electricity market

September 25th, 2007 Real Collegio Carlo Alberto 19

Running or chasing for identity!

• Reinforcement learning and pattern recognition, with bounded rationality

• Agent brain built upon 9 Artificial Neural Networks

Page 20: Agent based simulation and electricity market

September 25th, 2007 Real Collegio Carlo Alberto 20

_______________________________________

The surprising world of the Chameleons, with NetLogo

_______________________________________

Page 21: Agent based simulation and electricity market

September 25th, 2007 Real Collegio Carlo Alberto 21

Page 22: Agent based simulation and electricity market

September 25th, 2007 Real Collegio Carlo Alberto 22

_______________________________________

Electricity market

_______________________________________

Page 23: Agent based simulation and electricity market

September 25th, 2007 Real Collegio Carlo Alberto 23

Leigh Tesf

atsion work

Page 24: Agent based simulation and electricity market

September 25th, 2007 Real Collegio Carlo Alberto 24

Leigh Tesf

atsion work

Page 25: Agent based simulation and electricity market

September 25th, 2007 Real Collegio Carlo Alberto 25

Leigh Tesf

atsion work

Page 26: Agent based simulation and electricity market

September 25th, 2007 Real Collegio Carlo Alberto 26

Leigh Tesf

atsion work

Page 27: Agent based simulation and electricity market

September 25th, 2007 Real Collegio Carlo Alberto 27

Leigh Tesf

atsion work

Page 28: Agent based simulation and electricity market

September 25th, 2007 Real Collegio Carlo Alberto 28

Leigh Tesf

atsion work

Page 29: Agent based simulation and electricity market

September 25th, 2007 Real Collegio Carlo Alberto 29

Leigh Tesf

atsion work

Page 30: Agent based simulation and electricity market

September 25th, 2007 Real Collegio Carlo Alberto 30

Leigh Tesf

atsion work

Page 31: Agent based simulation and electricity market

September 25th, 2007 Real Collegio Carlo Alberto 31

_______________________________________

From spin glasses to videogames:

representing our worlds and their complexity via the use of simple simulation tools, with agents

_______________________________________

Page 32: Agent based simulation and electricity market

September 25th, 2007 Real Collegio Carlo Alberto 32

_______________________________________

Scratch

http://weblogs.media.mit.edu/llk/scratch/

_______________________________________

Page 33: Agent based simulation and electricity market

September 25th, 2007 Real Collegio Carlo Alberto 33

Page 34: Agent based simulation and electricity market

September 25th, 2007 Real Collegio Carlo Alberto 34

The credit multiplier (money_supply.sb)

Page 35: Agent based simulation and electricity market

September 25th, 2007 Real Collegio Carlo Alberto 35

_______________________________________

StarLogo TNG

http://education.mit.edu/starlogo/

_______________________________________

Page 36: Agent based simulation and electricity market

September 25th, 2007 Real Collegio Carlo Alberto 36

StarLogo TNG

Page 37: Agent based simulation and electricity market

September 25th, 2007 Real Collegio Carlo Alberto 37

Sperimentiamo la complessità con StarLogo TNG

termites2

Page 38: Agent based simulation and electricity market

September 25th, 2007 Real Collegio Carlo Alberto 38

Sperimentiamo la complessità con StarLogo TNG

Fish and Plankton

Page 39: Agent based simulation and electricity market

September 25th, 2007 Real Collegio Carlo Alberto 39

_______________________________________

Squeak

http://www.squeak.org/

_______________________________________

Page 40: Agent based simulation and electricity market

September 25th, 2007 Real Collegio Carlo Alberto 40

Page 41: Agent based simulation and electricity market

September 25th, 2007 Real Collegio Carlo Alberto 41

_______________________________________

Second Life

http://secondlife.com/

_______________________________________

Page 42: Agent based simulation and electricity market

September 25th, 2007 Real Collegio Carlo Alberto 42