<p>Although I still don't understand what these "strengths" are all about, still, mechanically, step $4)$ is now clear.</p>

<p>At each point in time, there is a certain allocation of Strengths to actions, $\{S_i(t),\; i=1,2,...,A\}$. This allocation changes through time.  </p>

<p>The allocation is turned into a <em>relative frequency distribution</em> by dividing each $S_i(t)$ by their sum $C(t)$.</p>

<p>But then </p>

<p>$$\sum_{i=1}^A \frac {S_i(t)}{C(t)} =1 $$</p>

<p>and (I presume), $S_i(t) \geq 0,\; \forall i$. So indeed this relative frequency distribution can be treated as a probability distribution, and each $S_i(t)/C(t)$ can be treated as a probability that characterizes action $i$ in period $t$.  </p>

<p>So you have to <em>code</em> this probability distribution, and then have the software "randomly draw" from it, as though this distribution was part of  the distributions available in a "random number generator".  </p>

<p>The floor is yours now.  </p>

CC BY-SA 3.0
2015-05-12T01:06:14.557Z
2015-05-12T01:06:14.557Z
Alecos Papadopoulos
<p>I am implementing Arthur's paper "<a href="http://multiagent.martinsewell.com/Arth91.pdf" rel="nofollow">Designing economic agents that act like human agent: A behavioral approach to bounded rationality</a>" from 1991 in JAVA and I am having a problem understanding one part of the paper:</p>

<p>At one point it says: triggering actions randomly on the basis of their strengths and I don't know what this means.</p>

<p>The algorithm is described as follows:</p>

<p>1.) Actions are represented as $a = (1,2,...,A)$, these values represent the mean and all the actions have a fixed standard deviation. The mean of an action and its standard deviation help in plotting the normal distribution. The payoff of an action, which is unknown before is drawn after the action is chosen from the above described normal distribution.</p>

<p>2.) Ever action has a certain value of strength ($S(t)$) associated with it, the strength depends on prior beliefs (in my case it depends on prior skill set). The current sum of these strengths is C(t).</p>

<p>3.)At every time $t$ I calculate the probability vector $p(t) = S(t)/C(t)$</p>

<p>4.) Choose one action from the set according to the probability </p>

<p>5.) Update the strength of that action (point 3, page 354) </p>

<p>6.) Renormalized (point 4, page 354).</p>

<p>The problem occurs at point 4: choose an action according to the probability, what probability?</p>

<p>I don't know how to translate this statement into code.</p>

CC BY-SA 3.0
2015-05-10T09:28:33.863Z
I find it surprising that in a paper with such a task, the specific step is described in such vague terms. By the way, if I take "random" with its "usual" informal meaning, I would translate it as "uniformly (equiprobably) distributed". But then, it is a contradiction to also take into account the "strength" of the action, whatever that may mean. This is a very interesting question about translating economic/behavioral theory into software code, but we need much more input from you (CONTD):
Alecos Papadopoulos
CC BY-SA 3.0
2015-05-10T09:29:43.653Z
(CONTD) I would suggest to go into some more detail about what these "actions" are, in what sense they have different "strengths" and whether the paper provides any other hint about the meaning of "random". And it would be good to also provide a link to the paper.
Alecos Papadopoulos
CC BY-SA 3.0
2015-05-10T10:39:08.353Z
The link for the paper, I am writing the precise details of action in the second comment that follows : http://multiagent.martinsewell.com/Arth91.pdf
Sabachi
CC BY-SA 3.0
2015-05-10T10:43:25.643Z
Please go to page page 354, under the section: A parametrized learning automation, a timeline description is provided which says what is done at every time 't'. Then, on page 355, 3rd paragraph starting with "The algorithm is nonlinear...." provides more detail about how an action is selected.                                                                                       I have translated most if it in codes (JAVA) but I have a feeling that I am making a small mistake in coding the randomness, i.e. the stochastic nature with which actions are selected at time 't'. (CONTD)
Sabachi
CC BY-SA 3.0
2015-05-10T10:49:10.543Z
1.) Actions are represented as a = (1,2,...,A), these values represent the mean and all the actions have a fixed standard deviation. The mean of an action and its standard deviation help in plotting the normal distribution. The payoff of an action, which is unknown before is drawn after the action is chosen from the above described normal distribution.  2.) Ever action has a certain value of strength (S(t)) associated with it, the strength depends on prior beliefs (in my case it depends on prior skill set). The current sum of these strengths is C(t). (CONTD)
Sabachi
CC BY-SA 3.0
2015-05-10T10:57:26.843Z
3.)At  every time 't' I calculate the probablity vector p(t) = S(t)/C(t) 4.) Choose one action from the set according to the probablity 5.) Update the strength of that action (point 3, page 354) 6.) Reinormalize (point 4, page 354)    I have done all of this, now my doubt stems regaring point 4 and once I resolve that I have another one but I want to take a step at a time.(CONTD)
Sabachi
CC BY-SA 3.0
2015-05-10T11:00:16.217Z
Now, point 4 says, choose an action according to the probablity and then 3rd paragraph on page 355 says they are chosen randomly....I am confused ??? Before I continue further, please let me know if my explanation was clear, if yes, I will continue further...thanks a lot..!!!
Sabachi
CC BY-SA 3.0
2015-05-10T11:52:15.873Z
Welcome to SE, Sabachi! Every question here should be as self contained as possible, so I tried to copy your comment into the question. Furthermore, I tried to make clear what you are asking. I hope you are fine with my edits, otherwise just reverse them or change them.
The Almighty Bob
CC BY-SA 3.0
2015-05-10T13:24:39.230Z
Many thanks for the changes but I cant see them.
Sabachi
<microeconomics><bounded-rationality>
Doubts in modelling the Arthur(1991) paper: Designing economic agents that act like human agent
Sabachi
# Doubts in modelling the Arthur(1991) paper: Designing economic agents that act like human agent

(Asked by: username_0 on 2015-05-09)

I am implementing Arthur's paper "[Designing economic agents that act like human agent: A behavioral approach to bounded rationality](http://multiagent.martinsewell.com/Arth91.pdf)" from 1991 in JAVA and I am having a problem understanding one part of the paper:

At one point it says: triggering actions randomly on the basis of their strengths and I don't know what this means.

The algorithm is described as follows:

1.) Actions are represented as $a = (1,2,...,A)$, these values represent the mean and all the actions have a fixed standard deviation. The mean of an action and its standard deviation help in plotting the normal distribution. The payoff of an action, which is unknown before is drawn after the action is chosen from the above described normal distribution.

2.) Ever action has a certain value of strength ($S(t)$) associated with it, the strength depends on prior beliefs (in my case it depends on prior skill set). The current sum of these strengths is C(t).

3.)At every time $t$ I calculate the probability vector $p(t) = S(t)/C(t)$

4.) Choose one action from the set according to the probability

5.) Update the strength of that action (point 3, page 354)

6.) Renormalized (point 4, page 354).

The problem occurs at point 4: choose an action according to the probability, what probability?

I don't know how to translate this statement into code.

**Tags:** microeconomics, bounded-rationality
> **Comments:**
> **username_1**: I find it surprising that in a paper with such a task, the specific step is described in such vague terms. By the way, if I take "random" with its "usual" informal meaning, I would translate it as "uniformly (equiprobably) distributed". But then, it is a contradiction to also take into account the "strength" of the action, whatever that may mean. This is a very interesting question about translating economic/behavioral theory into software code, but we need much more input from you (CONTD):  
> **username_1**: (CONTD) I would suggest to go into some more detail about what these "actions" are, in what sense they have different "strengths" and whether the paper provides any other hint about the meaning of "random". And it would be good to also provide a link to the paper.  
> **username_0**: The link for the paper, I am writing the precise details of action in the second comment that follows : http://multiagent.martinsewell.com/Arth91.pdf  
> **username_0**: Please go to page page 354, under the section: A parametrized learning automation, a timeline description is provided which says what is done at every time 't'. Then, on page 355, 3rd paragraph starting with "The algorithm is nonlinear...." provides more detail about how an action is selected.                                                                                       I have translated most if it in codes (JAVA) but I have a feeling that I am making a small mistake in coding the randomness, i.e. the stochastic nature with which actions are selected at time 't'. (CONTD)  
> **username_0**: 1.) Actions are represented as a = (1,2,...,A), these values represent the mean and all the actions have a fixed standard deviation. The mean of an action and its standard deviation help in plotting the normal distribution. The payoff of an action, which is unknown before is drawn after the action is chosen from the above described normal distribution.  2.) Ever action has a certain value of strength (S(t)) associated with it, the strength depends on prior beliefs (in my case it depends on prior skill set). The current sum of these strengths is C(t). (CONTD)  
> **username_0**: 3.)At  every time 't' I calculate the probablity vector p(t) = S(t)/C(t) 4.) Choose one action from the set according to the probablity 5.) Update the strength of that action (point 3, page 354) 6.) Reinormalize (point 4, page 354)    I have done all of this, now my doubt stems regaring point 4 and once I resolve that I have another one but I want to take a step at a time.(CONTD)  
> **username_0**: Now, point 4 says, choose an action according to the probablity and then 3rd paragraph on page 355 says they are chosen randomly....I am confused ??? Before I continue further, please let me know if my explanation was clear, if yes, I will continue further...thanks a lot..!!!  
> **username_2**: Welcome to SE, Sabachi! Every question here should be as self contained as possible, so I tried to copy your comment into the question. Furthermore, I tried to make clear what you are asking. I hope you are fine with my edits, otherwise just reverse them or change them.  
> **username_0**: Many thanks for the changes but I cant see them.  

---

## 1 answers

### Answer by username_1 on 2015-05-12. Score: 2

Although I still don't understand what these "strengths" are all about, still, mechanically, step $4)$ is now clear.

At each point in time, there is a certain allocation of Strengths to actions, $\{S\_i(t),\; i=1,2,...,A\}$. This allocation changes through time.

The allocation is turned into a *relative frequency distribution* by dividing each $S\_i(t)$ by their sum $C(t)$.

But then

$$\sum\_{i=1}^A \frac {S\_i(t)}{C(t)} =1 $$

and (I presume), $S\_i(t) \geq 0,\; \forall i$. So indeed this relative frequency distribution can be treated as a probability distribution, and each $S\_i(t)/C(t)$ can be treated as a probability that characterizes action $i$ in period $t$.

So you have to *code* this probability distribution, and then have the software "randomly draw" from it, as though this distribution was part of the distributions available in a "random number generator".

The floor is yours now.


---

