Intuition behind how the Cauchy-Schwarz inequality's proof was obtainedCauchy-Schwarz inequality proof (but not the usual one)Please explain the intuition behind the dual problem in optimization.Intuition on fundamental theorem of arithmeticWhat is the “distance from the nearest integer”? (is that a kind of norm?)Intuition behind the derivative of dirac delta functionIntuition behind the proof of the Inverse Fourier Transform?What is meant in the quotation of Terry Tao?Is it usual to have no intuition to certain proofs and simply do them mechanically?Intuition behind the formula for $sum i^2$Idea behind the proof of Whitehead's Theorem and Compression LemmaGeometric interpretation of Hölder's inequality

Why did the HMS Bounty go back to a time when whales are already rare?

What linear sensor for a keyboard?

Why has "pence" been used in this sentence, not "pences"?

Some numbers are more equivalent than others

THT: What is a squared annular “ring”?

What major Native American tribes were around Santa Fe during the late 1850s?

Is it possible to have a strip of cold climate in the middle of a planet?

Should I install hardwood flooring or cabinets first?

Can a significant change in incentives void an employment contract?

How to decide convergence of Integrals

List of people who lose a child in תנ"ך

How should I respond when I lied about my education and the company finds out through background check?

Does the Mind Blank spell prevent the target from being frightened?

How do I implement a file system driver driver in Linux?

Greco-Roman egalitarianism

Why do IPv6 unique local addresses have to have a /48 prefix?

Did arcade monitors have same pixel aspect ratio as TV sets?

Can the Supreme Court overturn an impeachment?

Longest common substring in linear time

What is the gram­mat­i­cal term for “‑ed” words like these?

How to align and center standalone amsmath equations?

How can Trident be so inexpensive? Will it orbit Triton or just do a (slow) flyby?

Reply 'no position' while the job posting is still there

Folder comparison



Intuition behind how the Cauchy-Schwarz inequality's proof was obtained


Cauchy-Schwarz inequality proof (but not the usual one)Please explain the intuition behind the dual problem in optimization.Intuition on fundamental theorem of arithmeticWhat is the “distance from the nearest integer”? (is that a kind of norm?)Intuition behind the derivative of dirac delta functionIntuition behind the proof of the Inverse Fourier Transform?What is meant in the quotation of Terry Tao?Is it usual to have no intuition to certain proofs and simply do them mechanically?Intuition behind the formula for $sum i^2$Idea behind the proof of Whitehead's Theorem and Compression LemmaGeometric interpretation of Hölder's inequality













3












$begingroup$


I'm studying multivariable calculus. Usually, when I study, I go through a book until I find a theorem, and then try to prove it. I was unable to, so I read the proof, which is the following:



Let $x, y in mathbbR^m, alpha in mathbbR$. Then $(x+alpha
y)bullet(x+alpha y) = vert vert x+alpha yvertvert^2 geq0$
.
Using the properties a the inner product we get:



$(x+alpha y)bullet(x+alpha y) = xbullet x+alpha xbullet y +
alpha ybullet x + alpha^2ybullet y
= vertvert xvertvert^2+2(xbullet y)alpha + alpha²vertvert yvertvert^2 geq 0$
.



That last inequality is true iff the discriminant of the polynomial with respect to
$alpha$ is less than or equal to 0. Therefore $vert
xbullet yvert - vert vert xvertvert²vertvert yvertvert^2
leq 0$
, from which comes the Cauchy-Schwarz inequality. Q.E.D



I can follow every step of the proof. I also get the intuition of why the inequality should be true. However, the proof seems "empty" to me. I don't understand what someone who wanted to prove this would do to find it. What's the intuition behind using $x+alpha y$?



The reason I ask this is because, after I read the proof, the way used to prove it was so beyond everything that I tried, that I am almost sure that I'd never be able to prove this on my own. How to deal with these kind of situations?










share|cite|improve this question











$endgroup$







  • 2




    $begingroup$
    Cauchy-schwarz boils down to the fact that, if you project one vector onto the other, the square of the length of the perpendicular component is greater than or equal to $0$, see my answer here.
    $endgroup$
    – Theo Bendit
    yesterday















3












$begingroup$


I'm studying multivariable calculus. Usually, when I study, I go through a book until I find a theorem, and then try to prove it. I was unable to, so I read the proof, which is the following:



Let $x, y in mathbbR^m, alpha in mathbbR$. Then $(x+alpha
y)bullet(x+alpha y) = vert vert x+alpha yvertvert^2 geq0$
.
Using the properties a the inner product we get:



$(x+alpha y)bullet(x+alpha y) = xbullet x+alpha xbullet y +
alpha ybullet x + alpha^2ybullet y
= vertvert xvertvert^2+2(xbullet y)alpha + alpha²vertvert yvertvert^2 geq 0$
.



That last inequality is true iff the discriminant of the polynomial with respect to
$alpha$ is less than or equal to 0. Therefore $vert
xbullet yvert - vert vert xvertvert²vertvert yvertvert^2
leq 0$
, from which comes the Cauchy-Schwarz inequality. Q.E.D



I can follow every step of the proof. I also get the intuition of why the inequality should be true. However, the proof seems "empty" to me. I don't understand what someone who wanted to prove this would do to find it. What's the intuition behind using $x+alpha y$?



The reason I ask this is because, after I read the proof, the way used to prove it was so beyond everything that I tried, that I am almost sure that I'd never be able to prove this on my own. How to deal with these kind of situations?










share|cite|improve this question











$endgroup$







  • 2




    $begingroup$
    Cauchy-schwarz boils down to the fact that, if you project one vector onto the other, the square of the length of the perpendicular component is greater than or equal to $0$, see my answer here.
    $endgroup$
    – Theo Bendit
    yesterday













3












3








3


1



$begingroup$


I'm studying multivariable calculus. Usually, when I study, I go through a book until I find a theorem, and then try to prove it. I was unable to, so I read the proof, which is the following:



Let $x, y in mathbbR^m, alpha in mathbbR$. Then $(x+alpha
y)bullet(x+alpha y) = vert vert x+alpha yvertvert^2 geq0$
.
Using the properties a the inner product we get:



$(x+alpha y)bullet(x+alpha y) = xbullet x+alpha xbullet y +
alpha ybullet x + alpha^2ybullet y
= vertvert xvertvert^2+2(xbullet y)alpha + alpha²vertvert yvertvert^2 geq 0$
.



That last inequality is true iff the discriminant of the polynomial with respect to
$alpha$ is less than or equal to 0. Therefore $vert
xbullet yvert - vert vert xvertvert²vertvert yvertvert^2
leq 0$
, from which comes the Cauchy-Schwarz inequality. Q.E.D



I can follow every step of the proof. I also get the intuition of why the inequality should be true. However, the proof seems "empty" to me. I don't understand what someone who wanted to prove this would do to find it. What's the intuition behind using $x+alpha y$?



The reason I ask this is because, after I read the proof, the way used to prove it was so beyond everything that I tried, that I am almost sure that I'd never be able to prove this on my own. How to deal with these kind of situations?










share|cite|improve this question











$endgroup$




I'm studying multivariable calculus. Usually, when I study, I go through a book until I find a theorem, and then try to prove it. I was unable to, so I read the proof, which is the following:



Let $x, y in mathbbR^m, alpha in mathbbR$. Then $(x+alpha
y)bullet(x+alpha y) = vert vert x+alpha yvertvert^2 geq0$
.
Using the properties a the inner product we get:



$(x+alpha y)bullet(x+alpha y) = xbullet x+alpha xbullet y +
alpha ybullet x + alpha^2ybullet y
= vertvert xvertvert^2+2(xbullet y)alpha + alpha²vertvert yvertvert^2 geq 0$
.



That last inequality is true iff the discriminant of the polynomial with respect to
$alpha$ is less than or equal to 0. Therefore $vert
xbullet yvert - vert vert xvertvert²vertvert yvertvert^2
leq 0$
, from which comes the Cauchy-Schwarz inequality. Q.E.D



I can follow every step of the proof. I also get the intuition of why the inequality should be true. However, the proof seems "empty" to me. I don't understand what someone who wanted to prove this would do to find it. What's the intuition behind using $x+alpha y$?



The reason I ask this is because, after I read the proof, the way used to prove it was so beyond everything that I tried, that I am almost sure that I'd never be able to prove this on my own. How to deal with these kind of situations?







multivariable-calculus soft-question intuition






share|cite|improve this question















share|cite|improve this question













share|cite|improve this question




share|cite|improve this question








edited yesterday









YuiTo Cheng

2,1212837




2,1212837










asked yesterday









RUBEN GONÇALO MOROUÇORUBEN GONÇALO MOROUÇO

744




744







  • 2




    $begingroup$
    Cauchy-schwarz boils down to the fact that, if you project one vector onto the other, the square of the length of the perpendicular component is greater than or equal to $0$, see my answer here.
    $endgroup$
    – Theo Bendit
    yesterday












  • 2




    $begingroup$
    Cauchy-schwarz boils down to the fact that, if you project one vector onto the other, the square of the length of the perpendicular component is greater than or equal to $0$, see my answer here.
    $endgroup$
    – Theo Bendit
    yesterday







2




2




$begingroup$
Cauchy-schwarz boils down to the fact that, if you project one vector onto the other, the square of the length of the perpendicular component is greater than or equal to $0$, see my answer here.
$endgroup$
– Theo Bendit
yesterday




$begingroup$
Cauchy-schwarz boils down to the fact that, if you project one vector onto the other, the square of the length of the perpendicular component is greater than or equal to $0$, see my answer here.
$endgroup$
– Theo Bendit
yesterday










2 Answers
2






active

oldest

votes


















3












$begingroup$

Proving theorems about general vector spaces, or general inner product spaces, can begin by considering a familiar $2$- or $3$-dimensional space. But then you need to abstract the intuition so it's pure algebra, now diagrams required. So your question comes down to what sort of preamble may have helped here.



If you think about vectors in a space you can visualise, all the theorem says is that the angle $theta$ between two vectors satisfies $-1lecosthetale 1$, which by the cosine rule is equivalent to the triangle inequality. Since the cosine rule can be stated in terms of dot products, it makes sense to see what you learn from one more equivalent result, $Vert x-yVert^2ge 0$.



But $Vert x-alpha yVert^2ge 0$ is a natural generalisation, and connects the issue to extremising quadratics, with the extremum giving us the most inequality we can get. And we don't need to think about a specific vector space to use $Vert vVert^2ge 0$, so it's a general starting point.






share|cite|improve this answer









$endgroup$












  • $begingroup$
    Wouldn't any real angle $theta$ satisfy $-1 leq cos theta leq 1$ ? I'm not very familiar with cosine rule or geometric proofs though
    $endgroup$
    – RUBEN GONÇALO MOROUÇO
    yesterday






  • 1




    $begingroup$
    @RUBENGONÇALOMOROUÇO It would, yes. One could argue that knowing that is equivalent to knowing every other theorem mentioned herein.
    $endgroup$
    – J.G.
    yesterday


















4












$begingroup$

I don't know about anybody else, but I share your dissatisfaction with the standard slick proof, and I personally find it helpful to think instead of expressing $x$ as a sum of a multiple of $y$ and a vector orthogonal to $y$. This kind of resolution of a vector into two mutually orthogonal components is a common and natural operation.



If $lambda$ is real, then $x - lambda y$ is orthogonal to $y$ if and only if (in your notation) $(x - lambda y) bullet y = 0$, i.e.,
$$
lambda |y|^2 = x bullet y.
$$



For any value of $lambda$ satisfying that condition ($lambda$ may be chosen arbitrarily if $y = 0$, and there is a unique solution for $lambda$ if $y ne 0$), write $u = x - lambda y$ and $v = lambda y$, so that $x = u + v$ and $u bullet v = 0$. Then:
beginalign*
|x|^2 & = (u + v) bullet (u + v) \
& = u bullet u + 2u bullet v + v bullet v \
& = |u|^2 + |v|^2 \
& geqslant |v|^2.
endalign*

Therefore, using the definitions of $v$ and $lambda$:
$$
|x|^2|y|^2 geqslant |v|^2|y|^2 = lambda^2|y|^4 = (x bullet y)^2 = |x bullet y|^2,
$$

and the result follows. So the selection of the value $-lambda$ for $alpha$ does make some intuitive sense (to me, at least).



You could arrive at this value of $alpha$ less intuitively by "completing the square" in the expression you derived for $|x + alpha y|^2$, thus, multiplying by $|y|^2$, to avoid a possible division by zero:
beginalign*
|x + alpha y|^2|y|^2 & = |x|^2|y|^2 + 2(x bullet y)alpha|y|^2 + alpha^2|y|^4 \
& = (alpha|y|^2 + x bullet y)^2 + |x|^2|y|^2 - (x bullet y)^2 \
& = |x|^2|y|^2 - (x bullet y)^2,
endalign*

if
$$alpha|y|^2 + x bullet y = 0.
$$

So the proof you quoted can be seen as the proof by resolution into orthogonal components in heavy disguise.






share|cite|improve this answer









$endgroup$








  • 1




    $begingroup$
    (+1) for this approach
    $endgroup$
    – Mark Viola
    yesterday










  • $begingroup$
    One can argue more directly that $|x-lambda y|^2=(x-lambda y)bullet x=|x|^2-lambda(xbullet y)$, therefore $|x|^2geqslantlambda(xbullet y)$, therefore $|x|^2|y|^2geqslantlambda|y|^2(xbullet y)=(xbullet y)^2$; but this loses the nice intuition of Pythagoras's theorem, and its direct corollary that the projection of $x$ on $y$ is shorter than $x$ (although this can be recovered by writing $lambda(xbullet y)$ as $lambda^2|b|^2=|lambda b|^2$); and the proof veers towards being, once again, "slick" and unmemorable - which is why I forgot having once done it this way!
    $endgroup$
    – Calum Gilhooley
    yesterday











Your Answer





StackExchange.ifUsing("editor", function ()
return StackExchange.using("mathjaxEditing", function ()
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix)
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
);
);
, "mathjax-editing");

StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "69"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);

else
createEditor();

);

function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
noCode: true, onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);



);













draft saved

draft discarded


















StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3159210%2fintuition-behind-how-the-cauchy-schwarz-inequalitys-proof-was-obtained%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown

























2 Answers
2






active

oldest

votes








2 Answers
2






active

oldest

votes









active

oldest

votes






active

oldest

votes









3












$begingroup$

Proving theorems about general vector spaces, or general inner product spaces, can begin by considering a familiar $2$- or $3$-dimensional space. But then you need to abstract the intuition so it's pure algebra, now diagrams required. So your question comes down to what sort of preamble may have helped here.



If you think about vectors in a space you can visualise, all the theorem says is that the angle $theta$ between two vectors satisfies $-1lecosthetale 1$, which by the cosine rule is equivalent to the triangle inequality. Since the cosine rule can be stated in terms of dot products, it makes sense to see what you learn from one more equivalent result, $Vert x-yVert^2ge 0$.



But $Vert x-alpha yVert^2ge 0$ is a natural generalisation, and connects the issue to extremising quadratics, with the extremum giving us the most inequality we can get. And we don't need to think about a specific vector space to use $Vert vVert^2ge 0$, so it's a general starting point.






share|cite|improve this answer









$endgroup$












  • $begingroup$
    Wouldn't any real angle $theta$ satisfy $-1 leq cos theta leq 1$ ? I'm not very familiar with cosine rule or geometric proofs though
    $endgroup$
    – RUBEN GONÇALO MOROUÇO
    yesterday






  • 1




    $begingroup$
    @RUBENGONÇALOMOROUÇO It would, yes. One could argue that knowing that is equivalent to knowing every other theorem mentioned herein.
    $endgroup$
    – J.G.
    yesterday















3












$begingroup$

Proving theorems about general vector spaces, or general inner product spaces, can begin by considering a familiar $2$- or $3$-dimensional space. But then you need to abstract the intuition so it's pure algebra, now diagrams required. So your question comes down to what sort of preamble may have helped here.



If you think about vectors in a space you can visualise, all the theorem says is that the angle $theta$ between two vectors satisfies $-1lecosthetale 1$, which by the cosine rule is equivalent to the triangle inequality. Since the cosine rule can be stated in terms of dot products, it makes sense to see what you learn from one more equivalent result, $Vert x-yVert^2ge 0$.



But $Vert x-alpha yVert^2ge 0$ is a natural generalisation, and connects the issue to extremising quadratics, with the extremum giving us the most inequality we can get. And we don't need to think about a specific vector space to use $Vert vVert^2ge 0$, so it's a general starting point.






share|cite|improve this answer









$endgroup$












  • $begingroup$
    Wouldn't any real angle $theta$ satisfy $-1 leq cos theta leq 1$ ? I'm not very familiar with cosine rule or geometric proofs though
    $endgroup$
    – RUBEN GONÇALO MOROUÇO
    yesterday






  • 1




    $begingroup$
    @RUBENGONÇALOMOROUÇO It would, yes. One could argue that knowing that is equivalent to knowing every other theorem mentioned herein.
    $endgroup$
    – J.G.
    yesterday













3












3








3





$begingroup$

Proving theorems about general vector spaces, or general inner product spaces, can begin by considering a familiar $2$- or $3$-dimensional space. But then you need to abstract the intuition so it's pure algebra, now diagrams required. So your question comes down to what sort of preamble may have helped here.



If you think about vectors in a space you can visualise, all the theorem says is that the angle $theta$ between two vectors satisfies $-1lecosthetale 1$, which by the cosine rule is equivalent to the triangle inequality. Since the cosine rule can be stated in terms of dot products, it makes sense to see what you learn from one more equivalent result, $Vert x-yVert^2ge 0$.



But $Vert x-alpha yVert^2ge 0$ is a natural generalisation, and connects the issue to extremising quadratics, with the extremum giving us the most inequality we can get. And we don't need to think about a specific vector space to use $Vert vVert^2ge 0$, so it's a general starting point.






share|cite|improve this answer









$endgroup$



Proving theorems about general vector spaces, or general inner product spaces, can begin by considering a familiar $2$- or $3$-dimensional space. But then you need to abstract the intuition so it's pure algebra, now diagrams required. So your question comes down to what sort of preamble may have helped here.



If you think about vectors in a space you can visualise, all the theorem says is that the angle $theta$ between two vectors satisfies $-1lecosthetale 1$, which by the cosine rule is equivalent to the triangle inequality. Since the cosine rule can be stated in terms of dot products, it makes sense to see what you learn from one more equivalent result, $Vert x-yVert^2ge 0$.



But $Vert x-alpha yVert^2ge 0$ is a natural generalisation, and connects the issue to extremising quadratics, with the extremum giving us the most inequality we can get. And we don't need to think about a specific vector space to use $Vert vVert^2ge 0$, so it's a general starting point.







share|cite|improve this answer












share|cite|improve this answer



share|cite|improve this answer










answered yesterday









J.G.J.G.

31.8k23250




31.8k23250











  • $begingroup$
    Wouldn't any real angle $theta$ satisfy $-1 leq cos theta leq 1$ ? I'm not very familiar with cosine rule or geometric proofs though
    $endgroup$
    – RUBEN GONÇALO MOROUÇO
    yesterday






  • 1




    $begingroup$
    @RUBENGONÇALOMOROUÇO It would, yes. One could argue that knowing that is equivalent to knowing every other theorem mentioned herein.
    $endgroup$
    – J.G.
    yesterday
















  • $begingroup$
    Wouldn't any real angle $theta$ satisfy $-1 leq cos theta leq 1$ ? I'm not very familiar with cosine rule or geometric proofs though
    $endgroup$
    – RUBEN GONÇALO MOROUÇO
    yesterday






  • 1




    $begingroup$
    @RUBENGONÇALOMOROUÇO It would, yes. One could argue that knowing that is equivalent to knowing every other theorem mentioned herein.
    $endgroup$
    – J.G.
    yesterday















$begingroup$
Wouldn't any real angle $theta$ satisfy $-1 leq cos theta leq 1$ ? I'm not very familiar with cosine rule or geometric proofs though
$endgroup$
– RUBEN GONÇALO MOROUÇO
yesterday




$begingroup$
Wouldn't any real angle $theta$ satisfy $-1 leq cos theta leq 1$ ? I'm not very familiar with cosine rule or geometric proofs though
$endgroup$
– RUBEN GONÇALO MOROUÇO
yesterday




1




1




$begingroup$
@RUBENGONÇALOMOROUÇO It would, yes. One could argue that knowing that is equivalent to knowing every other theorem mentioned herein.
$endgroup$
– J.G.
yesterday




$begingroup$
@RUBENGONÇALOMOROUÇO It would, yes. One could argue that knowing that is equivalent to knowing every other theorem mentioned herein.
$endgroup$
– J.G.
yesterday











4












$begingroup$

I don't know about anybody else, but I share your dissatisfaction with the standard slick proof, and I personally find it helpful to think instead of expressing $x$ as a sum of a multiple of $y$ and a vector orthogonal to $y$. This kind of resolution of a vector into two mutually orthogonal components is a common and natural operation.



If $lambda$ is real, then $x - lambda y$ is orthogonal to $y$ if and only if (in your notation) $(x - lambda y) bullet y = 0$, i.e.,
$$
lambda |y|^2 = x bullet y.
$$



For any value of $lambda$ satisfying that condition ($lambda$ may be chosen arbitrarily if $y = 0$, and there is a unique solution for $lambda$ if $y ne 0$), write $u = x - lambda y$ and $v = lambda y$, so that $x = u + v$ and $u bullet v = 0$. Then:
beginalign*
|x|^2 & = (u + v) bullet (u + v) \
& = u bullet u + 2u bullet v + v bullet v \
& = |u|^2 + |v|^2 \
& geqslant |v|^2.
endalign*

Therefore, using the definitions of $v$ and $lambda$:
$$
|x|^2|y|^2 geqslant |v|^2|y|^2 = lambda^2|y|^4 = (x bullet y)^2 = |x bullet y|^2,
$$

and the result follows. So the selection of the value $-lambda$ for $alpha$ does make some intuitive sense (to me, at least).



You could arrive at this value of $alpha$ less intuitively by "completing the square" in the expression you derived for $|x + alpha y|^2$, thus, multiplying by $|y|^2$, to avoid a possible division by zero:
beginalign*
|x + alpha y|^2|y|^2 & = |x|^2|y|^2 + 2(x bullet y)alpha|y|^2 + alpha^2|y|^4 \
& = (alpha|y|^2 + x bullet y)^2 + |x|^2|y|^2 - (x bullet y)^2 \
& = |x|^2|y|^2 - (x bullet y)^2,
endalign*

if
$$alpha|y|^2 + x bullet y = 0.
$$

So the proof you quoted can be seen as the proof by resolution into orthogonal components in heavy disguise.






share|cite|improve this answer









$endgroup$








  • 1




    $begingroup$
    (+1) for this approach
    $endgroup$
    – Mark Viola
    yesterday










  • $begingroup$
    One can argue more directly that $|x-lambda y|^2=(x-lambda y)bullet x=|x|^2-lambda(xbullet y)$, therefore $|x|^2geqslantlambda(xbullet y)$, therefore $|x|^2|y|^2geqslantlambda|y|^2(xbullet y)=(xbullet y)^2$; but this loses the nice intuition of Pythagoras's theorem, and its direct corollary that the projection of $x$ on $y$ is shorter than $x$ (although this can be recovered by writing $lambda(xbullet y)$ as $lambda^2|b|^2=|lambda b|^2$); and the proof veers towards being, once again, "slick" and unmemorable - which is why I forgot having once done it this way!
    $endgroup$
    – Calum Gilhooley
    yesterday
















4












$begingroup$

I don't know about anybody else, but I share your dissatisfaction with the standard slick proof, and I personally find it helpful to think instead of expressing $x$ as a sum of a multiple of $y$ and a vector orthogonal to $y$. This kind of resolution of a vector into two mutually orthogonal components is a common and natural operation.



If $lambda$ is real, then $x - lambda y$ is orthogonal to $y$ if and only if (in your notation) $(x - lambda y) bullet y = 0$, i.e.,
$$
lambda |y|^2 = x bullet y.
$$



For any value of $lambda$ satisfying that condition ($lambda$ may be chosen arbitrarily if $y = 0$, and there is a unique solution for $lambda$ if $y ne 0$), write $u = x - lambda y$ and $v = lambda y$, so that $x = u + v$ and $u bullet v = 0$. Then:
beginalign*
|x|^2 & = (u + v) bullet (u + v) \
& = u bullet u + 2u bullet v + v bullet v \
& = |u|^2 + |v|^2 \
& geqslant |v|^2.
endalign*

Therefore, using the definitions of $v$ and $lambda$:
$$
|x|^2|y|^2 geqslant |v|^2|y|^2 = lambda^2|y|^4 = (x bullet y)^2 = |x bullet y|^2,
$$

and the result follows. So the selection of the value $-lambda$ for $alpha$ does make some intuitive sense (to me, at least).



You could arrive at this value of $alpha$ less intuitively by "completing the square" in the expression you derived for $|x + alpha y|^2$, thus, multiplying by $|y|^2$, to avoid a possible division by zero:
beginalign*
|x + alpha y|^2|y|^2 & = |x|^2|y|^2 + 2(x bullet y)alpha|y|^2 + alpha^2|y|^4 \
& = (alpha|y|^2 + x bullet y)^2 + |x|^2|y|^2 - (x bullet y)^2 \
& = |x|^2|y|^2 - (x bullet y)^2,
endalign*

if
$$alpha|y|^2 + x bullet y = 0.
$$

So the proof you quoted can be seen as the proof by resolution into orthogonal components in heavy disguise.






share|cite|improve this answer









$endgroup$








  • 1




    $begingroup$
    (+1) for this approach
    $endgroup$
    – Mark Viola
    yesterday










  • $begingroup$
    One can argue more directly that $|x-lambda y|^2=(x-lambda y)bullet x=|x|^2-lambda(xbullet y)$, therefore $|x|^2geqslantlambda(xbullet y)$, therefore $|x|^2|y|^2geqslantlambda|y|^2(xbullet y)=(xbullet y)^2$; but this loses the nice intuition of Pythagoras's theorem, and its direct corollary that the projection of $x$ on $y$ is shorter than $x$ (although this can be recovered by writing $lambda(xbullet y)$ as $lambda^2|b|^2=|lambda b|^2$); and the proof veers towards being, once again, "slick" and unmemorable - which is why I forgot having once done it this way!
    $endgroup$
    – Calum Gilhooley
    yesterday














4












4








4





$begingroup$

I don't know about anybody else, but I share your dissatisfaction with the standard slick proof, and I personally find it helpful to think instead of expressing $x$ as a sum of a multiple of $y$ and a vector orthogonal to $y$. This kind of resolution of a vector into two mutually orthogonal components is a common and natural operation.



If $lambda$ is real, then $x - lambda y$ is orthogonal to $y$ if and only if (in your notation) $(x - lambda y) bullet y = 0$, i.e.,
$$
lambda |y|^2 = x bullet y.
$$



For any value of $lambda$ satisfying that condition ($lambda$ may be chosen arbitrarily if $y = 0$, and there is a unique solution for $lambda$ if $y ne 0$), write $u = x - lambda y$ and $v = lambda y$, so that $x = u + v$ and $u bullet v = 0$. Then:
beginalign*
|x|^2 & = (u + v) bullet (u + v) \
& = u bullet u + 2u bullet v + v bullet v \
& = |u|^2 + |v|^2 \
& geqslant |v|^2.
endalign*

Therefore, using the definitions of $v$ and $lambda$:
$$
|x|^2|y|^2 geqslant |v|^2|y|^2 = lambda^2|y|^4 = (x bullet y)^2 = |x bullet y|^2,
$$

and the result follows. So the selection of the value $-lambda$ for $alpha$ does make some intuitive sense (to me, at least).



You could arrive at this value of $alpha$ less intuitively by "completing the square" in the expression you derived for $|x + alpha y|^2$, thus, multiplying by $|y|^2$, to avoid a possible division by zero:
beginalign*
|x + alpha y|^2|y|^2 & = |x|^2|y|^2 + 2(x bullet y)alpha|y|^2 + alpha^2|y|^4 \
& = (alpha|y|^2 + x bullet y)^2 + |x|^2|y|^2 - (x bullet y)^2 \
& = |x|^2|y|^2 - (x bullet y)^2,
endalign*

if
$$alpha|y|^2 + x bullet y = 0.
$$

So the proof you quoted can be seen as the proof by resolution into orthogonal components in heavy disguise.






share|cite|improve this answer









$endgroup$



I don't know about anybody else, but I share your dissatisfaction with the standard slick proof, and I personally find it helpful to think instead of expressing $x$ as a sum of a multiple of $y$ and a vector orthogonal to $y$. This kind of resolution of a vector into two mutually orthogonal components is a common and natural operation.



If $lambda$ is real, then $x - lambda y$ is orthogonal to $y$ if and only if (in your notation) $(x - lambda y) bullet y = 0$, i.e.,
$$
lambda |y|^2 = x bullet y.
$$



For any value of $lambda$ satisfying that condition ($lambda$ may be chosen arbitrarily if $y = 0$, and there is a unique solution for $lambda$ if $y ne 0$), write $u = x - lambda y$ and $v = lambda y$, so that $x = u + v$ and $u bullet v = 0$. Then:
beginalign*
|x|^2 & = (u + v) bullet (u + v) \
& = u bullet u + 2u bullet v + v bullet v \
& = |u|^2 + |v|^2 \
& geqslant |v|^2.
endalign*

Therefore, using the definitions of $v$ and $lambda$:
$$
|x|^2|y|^2 geqslant |v|^2|y|^2 = lambda^2|y|^4 = (x bullet y)^2 = |x bullet y|^2,
$$

and the result follows. So the selection of the value $-lambda$ for $alpha$ does make some intuitive sense (to me, at least).



You could arrive at this value of $alpha$ less intuitively by "completing the square" in the expression you derived for $|x + alpha y|^2$, thus, multiplying by $|y|^2$, to avoid a possible division by zero:
beginalign*
|x + alpha y|^2|y|^2 & = |x|^2|y|^2 + 2(x bullet y)alpha|y|^2 + alpha^2|y|^4 \
& = (alpha|y|^2 + x bullet y)^2 + |x|^2|y|^2 - (x bullet y)^2 \
& = |x|^2|y|^2 - (x bullet y)^2,
endalign*

if
$$alpha|y|^2 + x bullet y = 0.
$$

So the proof you quoted can be seen as the proof by resolution into orthogonal components in heavy disguise.







share|cite|improve this answer












share|cite|improve this answer



share|cite|improve this answer










answered yesterday









Calum GilhooleyCalum Gilhooley

5,064630




5,064630







  • 1




    $begingroup$
    (+1) for this approach
    $endgroup$
    – Mark Viola
    yesterday










  • $begingroup$
    One can argue more directly that $|x-lambda y|^2=(x-lambda y)bullet x=|x|^2-lambda(xbullet y)$, therefore $|x|^2geqslantlambda(xbullet y)$, therefore $|x|^2|y|^2geqslantlambda|y|^2(xbullet y)=(xbullet y)^2$; but this loses the nice intuition of Pythagoras's theorem, and its direct corollary that the projection of $x$ on $y$ is shorter than $x$ (although this can be recovered by writing $lambda(xbullet y)$ as $lambda^2|b|^2=|lambda b|^2$); and the proof veers towards being, once again, "slick" and unmemorable - which is why I forgot having once done it this way!
    $endgroup$
    – Calum Gilhooley
    yesterday













  • 1




    $begingroup$
    (+1) for this approach
    $endgroup$
    – Mark Viola
    yesterday










  • $begingroup$
    One can argue more directly that $|x-lambda y|^2=(x-lambda y)bullet x=|x|^2-lambda(xbullet y)$, therefore $|x|^2geqslantlambda(xbullet y)$, therefore $|x|^2|y|^2geqslantlambda|y|^2(xbullet y)=(xbullet y)^2$; but this loses the nice intuition of Pythagoras's theorem, and its direct corollary that the projection of $x$ on $y$ is shorter than $x$ (although this can be recovered by writing $lambda(xbullet y)$ as $lambda^2|b|^2=|lambda b|^2$); and the proof veers towards being, once again, "slick" and unmemorable - which is why I forgot having once done it this way!
    $endgroup$
    – Calum Gilhooley
    yesterday








1




1




$begingroup$
(+1) for this approach
$endgroup$
– Mark Viola
yesterday




$begingroup$
(+1) for this approach
$endgroup$
– Mark Viola
yesterday












$begingroup$
One can argue more directly that $|x-lambda y|^2=(x-lambda y)bullet x=|x|^2-lambda(xbullet y)$, therefore $|x|^2geqslantlambda(xbullet y)$, therefore $|x|^2|y|^2geqslantlambda|y|^2(xbullet y)=(xbullet y)^2$; but this loses the nice intuition of Pythagoras's theorem, and its direct corollary that the projection of $x$ on $y$ is shorter than $x$ (although this can be recovered by writing $lambda(xbullet y)$ as $lambda^2|b|^2=|lambda b|^2$); and the proof veers towards being, once again, "slick" and unmemorable - which is why I forgot having once done it this way!
$endgroup$
– Calum Gilhooley
yesterday





$begingroup$
One can argue more directly that $|x-lambda y|^2=(x-lambda y)bullet x=|x|^2-lambda(xbullet y)$, therefore $|x|^2geqslantlambda(xbullet y)$, therefore $|x|^2|y|^2geqslantlambda|y|^2(xbullet y)=(xbullet y)^2$; but this loses the nice intuition of Pythagoras's theorem, and its direct corollary that the projection of $x$ on $y$ is shorter than $x$ (although this can be recovered by writing $lambda(xbullet y)$ as $lambda^2|b|^2=|lambda b|^2$); and the proof veers towards being, once again, "slick" and unmemorable - which is why I forgot having once done it this way!
$endgroup$
– Calum Gilhooley
yesterday


















draft saved

draft discarded
















































Thanks for contributing an answer to Mathematics Stack Exchange!


  • Please be sure to answer the question. Provide details and share your research!

But avoid


  • Asking for help, clarification, or responding to other answers.

  • Making statements based on opinion; back them up with references or personal experience.

Use MathJax to format equations. MathJax reference.


To learn more, see our tips on writing great answers.




draft saved


draft discarded














StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3159210%2fintuition-behind-how-the-cauchy-schwarz-inequalitys-proof-was-obtained%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown





















































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown

































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown







Popular posts from this blog

Àrd-bhaile Cathair chruinne/Baile mòr cruinne | Artagailean ceangailte | Clàr-taice na seòladaireachd

대한민국 목차 국명 지리 역사 정치 국방 경제 사회 문화 국제 순위 관련 항목 각주 외부 링크 둘러보기 메뉴북위 37° 34′ 08″ 동경 126° 58′ 36″ / 북위 37.568889° 동경 126.976667°  / 37.568889; 126.976667ehThe Korean Repository문단을 편집문단을 편집추가해Clarkson PLC 사Report for Selected Countries and Subjects-Korea“Human Development Index and its components: P.198”“http://www.law.go.kr/%EB%B2%95%EB%A0%B9/%EB%8C%80%ED%95%9C%EB%AF%BC%EA%B5%AD%EA%B5%AD%EA%B8%B0%EB%B2%95”"한국은 국제법상 한반도 유일 합법정부 아니다" - 오마이뉴스 모바일Report for Selected Countries and Subjects: South Korea격동의 역사와 함께한 조선일보 90년 : 조선일보 인수해 혁신시킨 신석우, 임시정부 때는 '대한민국' 국호(國號) 정해《우리가 몰랐던 우리 역사: 나라 이름의 비밀을 찾아가는 역사 여행》“남북 공식호칭 ‘남한’‘북한’으로 쓴다”“Corea 대 Korea, 누가 이긴 거야?”국내기후자료 - 한국[김대중 前 대통령 서거] 과감한 구조개혁 'DJ노믹스'로 최단기간 환란극복 :: 네이버 뉴스“이라크 "韓-쿠르드 유전개발 MOU 승인 안해"(종합)”“해외 우리국민 추방사례 43%가 일본”차기전차 K2'흑표'의 세계 최고 전력 분석, 쿠키뉴스 엄기영, 2007-03-02두산인프라, 헬기잡는 장갑차 'K21'...내년부터 공급, 고뉴스 이대준, 2008-10-30과거 내용 찾기mk 뉴스 - 구매력 기준으로 보면 한국 1인당 소득 3만弗과거 내용 찾기"The N-11: More Than an Acronym"Archived조선일보 최우석, 2008-11-01Global 500 2008: Countries - South Korea“몇년째 '시한폭탄'... 가계부채, 올해는 터질까”가구당 부채 5000만원 처음 넘어서“‘빚’으로 내몰리는 사회.. 위기의 가계대출”“[경제365] 공공부문 부채 급증…800조 육박”“"소득 양극화 다소 완화...불평등은 여전"”“공정사회·공생발전 한참 멀었네”iSuppli,08年2QのDRAMシェア・ランキングを発表(08/8/11)South Korea dominates shipbuilding industry | Stock Market News & Stocks to Watch from StraightStocks한국 자동차 생산, 3년 연속 세계 5위자동차수출 '현대-삼성 웃고 기아-대우-쌍용은 울고' 과거 내용 찾기동반성장위 창립 1주년 맞아Archived"중기적합 3개업종 합의 무시한 채 선정"李대통령, 사업 무분별 확장 소상공인 생계 위협 질타삼성-LG, 서민업종인 빵·분식사업 잇따라 철수상생은 뒷전…SSM ‘몸집 불리기’ 혈안Archived“경부고속도에 '아시안하이웨이' 표지판”'철의 실크로드' 앞서 '말(言)의 실크로드'부터, 프레시안 정창현, 2008-10-01“'서울 지하철은 안전한가?'”“서울시 “올해 안에 모든 지하철역 스크린도어 설치””“부산지하철 1,2호선 승강장 안전펜스 설치 완료”“전교조, 정부 노조 통계서 처음 빠져”“[Weekly BIZ] 도요타 '제로 이사회'가 리콜 사태 불러들였다”“S Korea slams high tuition costs”““정치가 여론 양극화 부채질… 합리주의 절실””“〈"`촛불집회'는 민주주의의 질적 변화 상징"〉”““촛불집회가 민주주의 왜곡 초래””“국민 65%, "한국 노사관계 대립적"”“한국 국가경쟁력 27위‥노사관계 '꼴찌'”“제대로 형성되지 않은 대한민국 이념지형”“[신년기획-갈등의 시대] 갈등지수 OECD 4위…사회적 손실 GDP 27% 무려 300조”“2012 총선-대선의 키워드는 '국민과 소통'”“한국 삶의 질 27위, 2000년과 2008년 연속 하위권 머물러”“[해피 코리아] 행복점수 68점…해외 평가선 '낙제점'”“한국 어린이·청소년 행복지수 3년 연속 OECD ‘꼴찌’”“한국 이혼율 OECD중 8위”“[통계청] 한국 이혼율 OECD 4위”“오피니언 [이렇게 생각한다] `부부의 날` 에 돌아본 이혼율 1위 한국”“Suicide Rates by Country, Global Health Observatory Data Repository.”“1. 또 다른 차별”“오피니언 [편집자에게] '왕따'와 '패거리 정치' 심리는 닮은꼴”“[미래한국리포트] 무한경쟁에 빠진 대한민국”“대학생 98% "외모가 경쟁력이라는 말 동의"”“특급호텔 웨딩·200만원대 유모차… "남보다 더…" 호화病, 고질병 됐다”“[스트레스 공화국] ① 경쟁사회, 스트레스 쌓인다”““매일 30여명 자살 한국, 의사보다 무속인에…””“"자살 부르는 '우울증', 환자 중 85% 치료 안 받아"”“정신병원을 가다”“대한민국도 ‘묻지마 범죄’,안전지대 아니다”“유엔 "학생 '성적 지향'에 따른 차별 금지하라"”“유엔아동권리위원회 보고서 및 번역본 원문”“고졸 성공스토리 담은 '제빵왕 김탁구' 드라마 나온다”“‘빛 좋은 개살구’ 고졸 취업…실습 대신 착취”원본 문서“정신건강, 사회적 편견부터 고쳐드립니다”‘소통’과 ‘행복’에 목 마른 사회가 잠들어 있던 ‘심리학’ 깨웠다“[포토] 사유리-곽금주 교수의 유쾌한 심리상담”“"올해 한국인 평균 영화관람횟수 세계 1위"(종합)”“[게임연중기획] 게임은 문화다-여가활동 1순위 게임”“영화속 ‘영어 지상주의’ …“왠지 씁쓸한데””“2월 `신문 부수 인증기관` 지정..방송법 후속작업”“무료신문 성장동력 ‘차별성’과 ‘갈등해소’”대한민국 국회 법률지식정보시스템"Pew Research Center's Religion & Public Life Project: South Korea"“amp;vwcd=MT_ZTITLE&path=인구·가구%20>%20인구총조사%20>%20인구부문%20>%20 총조사인구(2005)%20>%20전수부문&oper_YN=Y&item=&keyword=종교별%20인구& amp;lang_mode=kor&list_id= 2005년 통계청 인구 총조사”원본 문서“한국인이 좋아하는 취미와 운동 (2004-2009)”“한국인이 좋아하는 취미와 운동 (2004-2014)”Archived“한국, `부분적 언론자유국' 강등〈프리덤하우스〉”“국경없는기자회 "한국, 인터넷감시 대상국"”“한국, 조선산업 1위 유지(S. Korea Stays Top Shipbuilding Nation) RZD-Partner Portal”원본 문서“한국, 4년 만에 ‘선박건조 1위’”“옛 마산시,인터넷속도 세계 1위”“"한국 초고속 인터넷망 세계1위"”“인터넷·휴대폰 요금, 외국보다 훨씬 비싸”“한국 관세행정 6년 연속 세계 '1위'”“한국 교통사고 사망자 수 OECD 회원국 중 2위”“결핵 후진국' 한국, 환자가 급증한 이유는”“수술은 신중해야… 자칫하면 생명 위협”대한민국분류대한민국의 지도대한민국 정부대표 다국어포털대한민국 전자정부대한민국 국회한국방송공사about korea and information korea브리태니커 백과사전(한국편)론리플래닛의 정보(한국편)CIA의 세계 정보(한국편)마리암 부디아 (Mariam Budia),『한국: 하늘이 내린 한 폭의 그림』, 서울: 트랜스라틴 19호 (2012년 3월)대한민국ehehehehehehehehehehehehehehWorldCat132441370n791268020000 0001 2308 81034078029-6026373548cb11863345f(데이터)00573706ge128495

Cannot Extend partition with GParted The 2019 Stack Overflow Developer Survey Results Are In Announcing the arrival of Valued Associate #679: Cesar Manara Planned maintenance scheduled April 17/18, 2019 at 00:00UTC (8:00pm US/Eastern) 2019 Community Moderator Election ResultsCan't increase partition size with GParted?GParted doesn't recognize the unallocated space after my current partitionWhat is the best way to add unallocated space located before to Ubuntu 12.04 partition with GParted live?I can't figure out how to extend my Arch home partition into free spaceGparted Linux Mint 18.1 issueTrying to extend but swap partition is showing as Unknown in Gparted, shows proper from fdiskRearrange partitions in gparted to extend a partitionUnable to extend partition even though unallocated space is next to it using GPartedAllocate free space to root partitiongparted: how to merge unallocated space with a partition