<blockquote>
  <p>...the result of applying sup operator is a NUMBER...</p>
</blockquote>

<p>Read it carefully. The equation is </p>

<p><span class="math-container">$$
v(x_0) = \sup_{ \{x_t \}_{t \geq 1}} \cdots \quad (1)
$$</span>
This defines a function <span class="math-container">$v$</span>, called the value function, which is a type of indirect utility function. For given <span class="math-container">$x = x_0$</span>, the value of <span class="math-container">$v(x)$</span> is defined to be the sup on the RHS, taken over feasible sequences <span class="math-container">$\{ x_t \}$</span>.</p>

<blockquote>
  <p>...there is a functional equation, the result is a function...</p>
</blockquote>

<p>Yes, the function <span class="math-container">$v(\cdot)$</span> defined by <span class="math-container">$(1)$</span> satisfies the function (Bellman) equation. Equality is in the sense of functions. The LHS is <span class="math-container">$v(\cdot)$</span> defined by <span class="math-container">$(1)$</span>. The RHS is another function 
<span class="math-container">$$
\nu(x) = \sup_{y\in\Gamma(x)}[F(x,y)+\beta v(y)].
$$</span> 
The claim---the dynamic programming principle---is that they are equal, <span class="math-container">$v(\cdot) = \nu(\cdot)$</span>.  </p>

CC BY-SA 4.0
2020-05-31T20:19:29.797Z
Thanks Michael , one last thing to make it 100% clear, what you are saying is that the result of Bellman eq is a function which is the value function for the SP. As both are the same if I value themsame point they are the same number.
mmendina
CC BY-SA 4.0
2020-05-31T22:23:54.837Z
Yes, "the solution of Bellman eqn is a function which is the value function for the SP", in economics. To be more precise, the value function must necessarily satisfy the Bellman eqn, and conversely, if a solution of the Bellman eqn satisfies the tranversality condition, then it is the value function. But it's common in economics to ignore the 2nd statement, i.e. solve the Bellman eqn and just assume transversality condition holds for the found solution.
Michael
CC BY-SA 4.0
2020-05-31T00:29:33.317Z
2020-05-31T01:25:51.130Z
2020-05-31T01:25:51.130Z
Michael
<p>I'm just starting with dynamic optimization and although I understant the proof's of the theorem I'm not able to fully understand whether the bellman equation is a function , a function valuated at some number (therefore a number) or both. I'm using Stokey Lucas and Prescot Recursive methods for economics dynamics.
And they state in chapter 4.1 and 4.2:
Given some assumptions about the feasibility set and the <span class="math-container">$F(x_t,x_{t+1})$</span> This problems are equivalent:</p>

<p>1) Sequential problem (SP) <span class="math-container">$sup_{x_{t+1}}(\Sigma_{t=0}^\infty\beta^tF(x_t,x_{t+1}))$</span> st <span class="math-container">$x_{t+1}\in\Gamma(x_{t+1})$</span> for all t</p>

<p>2) Functional Equation (FE)<span class="math-container">$\ v(x)= sup_{y\in\Gamma(x)}[F(x,y)+\beta v(y)]$</span> </p>

<p>What is not clear to me is that:
In 1 the result of applying sup operator is a NUMBER (Value function valuated at <span class="math-container">$x_0$</span>
While in 2 as there is a functional equation, the result is a function. The authors seem to talk about a number (chapter 4.1) but then (in chapter 4.2) they state that applying the contraction mapping theorem to 2 we get the solution which is the unique fixed point in the set of continous bounded function, therefore the result is a function</p>

<p>So the solution is a number or a function?</p>

<p>Thanks in advance</p>

CC BY-SA 4.0
2020-05-31T01:20:00.497Z
Typos and misleading notations in the question.
Michael
<dynamic-programming><dynamic-optimization><bellman-equations>
What is the result of the Bellman Equation
mmendina
# What is the result of the Bellman Equation

(Asked by: username_0 on 2020-05-31)

I'm just starting with dynamic optimization and although I understant the proof's of the theorem I'm not able to fully understand whether the bellman equation is a function , a function valuated at some number (therefore a number) or both. I'm using Stokey Lucas and Prescot Recursive methods for economics dynamics.
And they state in chapter 4.1 and 4.2:
Given some assumptions about the feasibility set and the $F(x\_t,x\_{t+1})$ This problems are equivalent:

1) Sequential problem (SP) $sup\_{x\_{t+1}}(\Sigma\_{t=0}^\infty\beta^tF(x\_t,x\_{t+1}))$ st $x\_{t+1}\in\Gamma(x\_{t+1})$ for all t

2) Functional Equation (FE)$\ v(x)= sup\_{y\in\Gamma(x)}[F(x,y)+\beta v(y)]$

What is not clear to me is that:
In 1 the result of applying sup operator is a NUMBER (Value function valuated at $x\_0$
While in 2 as there is a functional equation, the result is a function. The authors seem to talk about a number (chapter 4.1) but then (in chapter 4.2) they state that applying the contraction mapping theorem to 2 we get the solution which is the unique fixed point in the set of continous bounded function, therefore the result is a function

So the solution is a number or a function?

Thanks in advance

**Tags:** dynamic-programming, dynamic-optimization, bellman-equations
> **Comments:**
> **username_1**: Typos and misleading notations in the question.  

---

## 1 answers

### Answer by username_1 on 2020-05-31. Score: 3 | Accepted answer

> ...the result of applying sup operator is a NUMBER...

Read it carefully. The equation is

$$
v(x\_0) = \sup\_{ \{x\_t \}\_{t \geq 1}} \cdots \quad (1)
$$
This defines a function $v$, called the value function, which is a type of indirect utility function. For given $x = x\_0$, the value of $v(x)$ is defined to be the sup on the RHS, taken over feasible sequences $\{ x\_t \}$.

> ...there is a functional equation, the result is a function...

Yes, the function $v(\cdot)$ defined by $(1)$ satisfies the function (Bellman) equation. Equality is in the sense of functions. The LHS is $v(\cdot)$ defined by $(1)$. The RHS is another function
$$
\nu(x) = \sup\_{y\in\Gamma(x)}[F(x,y)+\beta v(y)].
$$
The claim---the dynamic programming principle---is that they are equal, $v(\cdot) = \nu(\cdot)$.

> **Comments:**
> **username_0**: Thanks Michael , one last thing to make it 100% clear, what you are saying is that the result of Bellman eq is a function which is the value function for the SP. As both are the same if I value themsame point they are the same number.  
> **username_1**: Yes, "the solution of Bellman eqn is a function which is the value function for the SP", in economics. To be more precise, the value function must necessarily satisfy the Bellman eqn, and conversely, if a solution of the Bellman eqn satisfies the tranversality condition, then it is the value function. But it's common in economics to ignore the 2nd statement, i.e. solve the Bellman eqn and just assume transversality condition holds for the found solution.  

---

