9.1 Least squares, calculator work, correlation coefficients (Page 4/2)

Siyavula textbooks: grade 12 Page 1 / 2

The method of least squares

We now come to a more accurate method of finding the line of best-fit. The method is very simple. Suppose we guess a line of best-fit. Then at at every data point, we find the distance between the data point and the line. If the line fitted the data perfectly, this distance should be zero for all the data points. The worse the fit, the larger the differences. We then square each of these distances, and add them all together.

The best-fit line is then the line that minimises the sum of the squared distances.

Suppose we have a data set of $n$ points ${(x_{1}; y_{1}), (x_{2}; y_{2}), ..., (x_{n}, y_{n})}$ . We also have a line $f (x) = m x + c$ that we are trying to fit to the data. The distance between the first data point and the line, for example, is

distance = y_{1} - f (x) = y_{1} - (m x + c)

We now square each of these distances and add them together. Lets call this sum $S (m, c)$ . Then we have that

\begin{matrix} S (m, c) & = & {(y_{1} - f (x_{1}))}^{2} + {(y_{2} - f (x_{2}))}^{2} + ... + {(y_{n} - f (x_{n}))}^{2} \\ = & \sum_{i = 1}^{n} {(y_{i} - f (x_{i}))}^{2} \end{matrix}

Thus our problem is to find the value of $m$ and $c$ such that $S (m, c)$ is minimised. Let us call these minimising values $m_{0}$ and $c_{0}$ . Then the line of best-fit is $f (x) = m_{0} x + c_{0}$ . We can find $m_{0}$ and $c_{0}$ using calculus, but it is tricky, and we will just give you the result, which is that

\begin{matrix} m_{0} & = & \frac{n \sum_{i = 1}^{n} x_{i} y_{i} - \sum_{i = 1}^{n} x_{i} \sum_{i = 1}^{n} y_{i}}{n \sum_{i = 1}^{n} {(x_{i})}^{2} - {(\sum_{i = 1}^{n}, x_{i})}^{2}} \\ c_{0} & = & \frac{1}{n} \sum_{i = 1}^{n} y_{i} - \frac{m_{0}}{n} \sum_{i = 0}^{n} x_{i} = \bar{y} - m_{0} \bar{x} \end{matrix}

Khan academy video on regression - 1

In the table below, we have the records of the maintenance costs in Rands, compared with the age of the appliance in months. We have data for 5 appliances.

appliance	1	2	3	4	5
age ( $x$ )	5	10	15	20	30
cost ( $y$ )	90	140	250	300	380

Find the line of best fit using the method of least squares.

Draw up a table of

x

y

x y

and

x^{2}

values

appliance	$x$	$y$	$x y$	$x^{2}$
1	5	90	450	25
2	10	140	1400	100
3	15	250	3750	225
4	20	300	6000	400
5	30	380	11400	900
Total	80	1160	23000	1650

Work out $m_{0}$ and $c_{0}$ and write the equation
$\begin{matrix} m_{0} & = & \frac{n \sum x y - \sum x \sum y}{n \sum x^{2} - {(\sum x)}^{2}} = \frac{5 \times 23000 - 80 \times 1160}{5 \times 1650 - 80^{2}} = 12 \\ c_{0} & = & \bar{y} - b \bar{x} = \frac{1160}{5} - \frac{12 \times 80}{5} = 40 \\ ∴ & \underset{̲}{\hat{y} = 40 + 12 x} \end{matrix}$

Using a calculator

Find a regression equation for the following data:

Days ( $x$ )	1	2	3	4	5
Growth in m ( $y$ )	1,00	2,50	2,75	3,00	3,50

Getting your calculator ready
Using your calculator, change the mode from normal to “Stat $x y$ ”. This mode enables you to type in bivariate data.

Entering the data

Key in the data as follows:

1	$(x, y)$	1	DATA	$n$ = 1
2	$(x, y)$	2,5	DATA	$n$ = 2
3	$(x, y)$	2,75	DATA	$n$ = 3
4	$(x, y)$	3,0	DATA	$n$ = 4
5	$(x, y)$	3,5	DATA	$n$ = 5

Getting regression results from the calculator
Ask for the values of the regression coefficients $a$ and $b$ .

RCL $a$ gives $a =$ 0,9

RCL $b$ gives $b =$ 0,55

$∴ \hat{y} = 0, 9 + 0, 55 x$

Using a calculator determine the least squares line of best fit for the following data set of marks.

Learner	1	2	3	4	5
Chemistry (%)	52	55	86	71	45
Accounting (%)	48	64	95	79	50

For a Chemistry mark of 65%, what mark does the least squares line predict for Accounting?

Getting your calculator ready
Switch on the calculator. Press [MODE] and then select STAT by pressing [2]. The following screen will appear:

1 1-VAR 2 A + BX

3 $_$ + CX $^{2}$ 4 ln X

5 e $\hat{}$ X 6 A . B $\hat{}$ X

7 A . X $\hat{}$ B 8 1/X

Now press [2] for linear regression. Your screen should look something like this:

x y

1

2

3
Entering the data
Press [52] and then [=]to enter the first mark under $x$ . Then enter the other values, in the same way, for the $x$ -variable (the Chemistry marks) in the order in which they are given in the data set. Then move the cursor across and up and enter 48 under $y$ opposite 52 in the $x$ -column. Continue to enter the other $y$ -values (the Accounting marks) in order so that they pair off correctly with the corresponding $x$ -values.

x y

1 52

2 55

3

Then press [AC]. The screen clears but the data remains stored.

1: Type 2: Data

3: Edit 4: Sum

5: Var 6: MinMax

7: Reg

Now press [SHIFT][1]to get the stats computations screen shown below. Choose Regression by pressing [7].

1: A 2: B

3: r 4: $\hat{x}$

5: $\hat{y}$
Getting regression results from the calculator
1. a) Press [1] and [=]to get the value of the $y$ -intercept, $a = - 5, 065 . . = - 5, 07$ (to 2 d.p.) Finally, to get the slope, use the following key sequence: [SHIFT][1][7][2][=]. The calculator gives $b = 1, 169 . . = 1, 17$ (to 2 d.p.) The equation of the line of regression is thus: $\hat{y} = - 5, 07 + 1, 17 x$
2. b) Press [AC][65][SHIFT][1][7][5][=] This gives a (predicted) Accounting mark of $\hat{} = 70, 94 = 71$ %

Questions & Answers

how to create a software using Android phone

Wiseman Reply

how

basra

what is the difference between C and C++.

Yan Reply

what is software

Sami Reply

software is a instructions like programs

Shambhu

what is the difference between C and C++.

Yan

yes, how?

Hayder

what is software engineering

Ahmad

software engineering is a the branch of computer science deals with the design,development, testing and maintenance of software applications.

Hayder

who is best bw software engineering and cyber security

Ahmad

Both software engineering and cybersecurity offer exciting career prospects, but your choice ultimately depends on your interests and skills. If you enjoy problem-solving, programming, and designing software syste

Hayder

what's software processes

Ntege Reply

I haven't started reading yet. by device (hardware) or for improving design Lol? Here. Requirement, Design, Implementation, Verification, Maintenance.

Vernon

I can give you a more valid answer by 5:00 By the way gm.

Vernon

it is all about designing,developing, testing, implementing and maintaining of software systems.

Ehenew

hello assalamualaikum

Sami

My name M Sami I m 2nd year student

Sami

what is the specific IDE for flutter programs?

Mwami Reply

jegudgdtgd my Name my Name is M and I have been talking about iey my papa john's university of washington post I tagged I will be in

Mwaqas Reply

yes

usman

how disign photo

atul Reply

hlo

Navya

Michael

yes

Subhan

Show the necessary steps with description in resource monitoring process (CPU,memory,disk and network)

samuel Reply

What is software engineering

Tafadzwa Reply

Software engineering is a branch of computer science directed to writing programs to develop Softwares that can drive or enable the functionality of some hardwares like phone , automobile and others

kelvin

if any requirement engineer is gathering requirements from client and after getting he/she Analyze them this process is called

Alqa Reply

The following text is encoded in base 64. Ik5ldmVyIHRydXN0IGEgY29tcHV0ZXIgeW91IGNhbid0IHRocm93IG91dCBhIHdpbmRvdyIgLSBTdGV2ZSBXb3puaWFr Decode it, and paste the decoded text here

Julian Reply

what to do you mean

Vincent

hello

ALI

how are you ?

ALI

What is the command to list the contents of a directory in Unix and Unix-like operating systems

George Reply

how can i make my own software free of cost

Faizan Reply

like how

usman

Hayder

The name of the author of our software engineering book is Ian Sommerville.

Doha Reply

what is software

Sampson Reply

the set of intruction given to the computer to perform a task

Noor

Got questions? Join the online conversation and get instant answers!

Jobilize.com Reply

<< Chapter < Page Page > Chapter >>

Read also:

Get Jobilize Job Search Mobile App in your pocket Now!

100% Free Mobile Applications
Receive real-time job alerts and never miss the right job again

Source: OpenStax, Siyavula textbooks: grade 12 maths. OpenStax CNX. Aug 03, 2011 Download for free at http://cnx.org/content/col11242/1.2

Google Play and the Google Play logo are trademarks of Google Inc.

Notification Switch

Would you like to follow the 'Siyavula textbooks: grade 12 maths' conversation and receive update notifications?

Ask

	8 AP 08 Appendicular Skeleton MCQ By OpenStax Start Quiz
	Renaissance Baroque Arts By Marion Cabalfin Start Quiz
	13 Biology 13 Modern Understandings of Inheritance By OpenStax Start Quiz
	38 Biology 38 The Musculoskeletal System MCQ By OpenStax Start Quiz
	Vocabulary Week 1-3 By Rachel Woolard Start Quiz
	Professional Writing MCQ By Mary Cohen Start Quiz
	Object Oriented Programming Test 1 By Ali Sid Start Test
	Real Estate Finance By Mldelatte Start Quiz
	Classical Music By Marion Cabalfin Start Quiz
©flickr: Mike	Examples of Wiffle IQ By Sean WiffleBoy Start Quiz

1	1-VAR	2	A + BX
3	$_$ + CX $^{2}$	4	ln X
5	e $\hat{}$ X	6	A . B $\hat{}$ X
7	A . X $\hat{}$ B	8	1/X

RCL	$a$	gives	$a =$ 0,9
RCL	$b$	gives	$b =$ 0,55

1:	Type	2:	Data
3:	Edit	4:	Sum
5:	Var	6:	MinMax
7:	Reg

1:	A	2:	B
3:	r	4:	$\hat{x}$
5:	$\hat{y}$