Home » date » 2007 » Nov » 19 » attachments

Workshop 6

R Software Module: rwasp_multipleregression.wasp (opens new window with default values)
Title produced by software: Multiple Regression
Date of computation: Mon, 19 Nov 2007 03:01:59 -0700
 
Cite this page as follows:
Statistical Computations at FreeStatistics.org, Office for Research Development and Education, URL http://www.freestatistics.org/blog/date/2007/Nov/19/t11954661255rb13y8d3hjmukh.htm/, Retrieved Mon, 19 Nov 2007 10:56:16 +0100
 
User-defined keywords:
 
Dataseries X:
» Textbox « » Textfile « » CSV «
110.40 72.50 0 96.40 59.40 0 101.90 85.70 0 106.20 88.20 0 81.00 62.80 0 94.70 87.00 0 101.00 79.20 0 109.40 112.00 1 102.30 79.20 1 90.70 132.10 1 96.20 40.10 1 96.10 69.00 1 106.00 59.40 1 103.10 73.80 1 102.00 57.40 1 104.70 81.10 1 86.00 46.60 1 92.10 41.40 1 106.90 71.20 1 112.60 67.90 1 101.70 72.00 1 92.00 145.50 1 97.40 39.70 1 97.00 51.90 1 105.40 73.70 1 102.70 70.90 1 98.10 60.80 1 104.50 61.00 1 87.40 54.50 1 89.90 39.10 1 109.80 66.60 1 111.70 58.50 1 98.60 59.80 1 96.90 80.90 1 95.10 37.30 1 97.00 44.60 1 112.70 48.70 1 102.90 54.00 1 97.40 49.50 1 111.40 61.60 1 87.40 35.00 1 96.80 35.70 1 114.10 51.30 1 110.30 49.00 1 103.90 41.50 1 101.60 72.50 1 94.60 42.10 1 95.90 44.10 1 104.70 45.10 1 102.80 50.30 1 98.10 40.90 1 113.90 47.20 1 80.90 36.90 1 95.70 40.90 1 113.20 38.30 1 105.90 46.30 1 108.80 28.40 1 102.30 78.40 1 99.00 36.80 1 100.70 50.70 1 115.50 42.80 1
 
Text written by user:
 
Output produced by software:

Enter (or paste) a matrix (table) containing all data (time) series. Every column represents a different variable and must be delimited by a space or Tab. Every row represents a period in time (or category) and must be delimited by hard returns. The easiest way to enter data is to copy and paste a block of spreadsheet cells. Please, do not use commas or spaces to seperate groups of digits!


Summary of compuational transaction
Raw Inputview raw input (R code)
Raw Outputview raw output of R engine
Computing time3 seconds
R Server'Gwilym Jenkins' @ 72.249.127.135


Multiple Linear Regression - Estimated Regression Equation
Invest[t] = + 129.477741045368 -0.532610496389665Tot.prod[t] -1.22880551638674Tijd[t] + 7.6597101083052M1[t] + 4.87011023185619M2[t] + 1.61852011632155M3[t] + 15.8565145220841M4[t] -16.6968534757561M5[t] -9.40733614237636M6[t] + 11.8432786998468M7[t] + 18.7072378065419M8[t] + 5.1378128884813M9[t] + 48.1266498483989M10[t] -14.0049369537788M11[t] -0.676239716955866t + e[t]


Multiple Linear Regression - Ordinary Least Squares
VariableParameterS.D.T-STAT
H0: parameter = 0
2-tail p-value1-tail p-value
(Intercept)129.47774104536851.2926112.52430.0151080.007554
Tot.prod-0.5326104963896650.537457-0.9910.3268790.163439
Tijd-1.228805516386746.098418-0.20150.8411990.4206
M17.65971010830529.8959410.7740.4428760.221438
M24.870110231856198.2389030.59110.5573390.27867
M31.618520116321557.9268330.20420.8391120.419556
M415.85651452208419.9119011.59970.1165020.058251
M5-16.696853475756110.175477-1.64090.1076410.05382
M6-9.407336142376367.93386-1.18570.2418220.120911
M711.843278699846810.1181041.17050.2478270.123913
M818.707237806541910.3950671.79960.0784810.03924
M95.13781288848138.346490.61560.5412150.270608
M1048.12664984839897.7059066.245400
M11-14.00493695377887.711377-1.81610.0758690.037935
t-0.6762397169558660.115742-5.842600


Multiple Linear Regression - Regression Statistics
Multiple R0.879870656126318
R-squared0.774172371512158
Adjusted R-squared0.70544222371151
F-TEST (value)11.2639416076574
F-TEST (DF numerator)14
F-TEST (DF denominator)46
p-value1.51000545400848e-10
Multiple Linear Regression - Residual Statistics
Residual Standard Deviation12.1727554778682
Sum Squared Residuals6816.09489250269


Multiple Linear Regression - Actuals, Interpolation, and Residuals
Time or IndexActualsInterpolation
Forecast
Residuals
Prediction Error
172.577.6610126352981-5.16101263529812
259.481.6517199913486-22.2517199913486
385.774.79453242871510.9054675712850
488.286.06606198304612.13393801695387
562.866.2582387772696-3.4582387772696
68765.57475259315521.4252474068449
779.282.7936815911675-3.59368159116749
811283.278667294846828.7213327051532
979.272.8145371841976.38546281580308
10132.1121.30541618527910.7945838147212
1140.155.5682319360021-15.4682319360021
126968.9501902224640.0498097775360103
1359.470.6608166995556-11.2608166995556
1473.868.73954754568085.06045245431924
1557.465.3975892592189-7.9975892592189
1681.177.52129560777353.5787043922265
1746.654.2515041754641-7.65150417546413
1841.457.6158577639111-16.2158577639111
1971.270.30759754261130.89240245738866
2067.973.4594371029295-5.55943710292948
217265.01922687856036.98077312143966
22145.5112.49814593650233.0018540634981
2339.746.8142227368641-7.1142227368641
2451.960.3559641722429-8.45596417224288
2573.762.86550639391910.834493606081
2670.960.837715140766210.0622848592338
2760.859.35989359166821.44010640833180
286169.512941103581-8.51294110358103
2954.545.39097287704829.1090271229518
3039.150.6727242524979-11.5727242524979
3166.660.64815049961095.95184950038907
3258.565.8239099462098-7.32390994620978
3359.858.55544281389791.24455718610209
3480.9101.773477900722-20.8734779007221
3537.339.92435027509-2.62435027508996
3644.652.2410875687725-7.64108756877248
3748.750.8625731668041-2.16257316680406
385452.61631643801791.38368356198211
3949.551.6178443356706-2.11784433567055
4061.657.7230520750223.87694792497805
413537.2760962735778-2.27609627357781
4235.738.8828352239389-3.18283522393885
4351.350.2430487616651.05695123833502
444958.4546880376849-9.45468803768492
4541.547.6177305795623-6.11773057956229
4672.591.1553319642203-18.6553319642203
4742.132.075778919814410.0242210801856
4844.144.7120825113307-0.612082511330715
4945.147.008580534451-1.90858053445098
5050.344.55470088418655.74529911581352
5140.943.1301403847274-2.23014038472740
5247.248.2766492305774-1.07664923057739
5336.932.62318789664024.27681210335976
5440.931.35383016649719.54616983350292
5538.342.6075216049453-4.30752160494527
5646.352.683297618329-6.38329761832904
5728.436.8930625437825-8.49306254378254
5878.482.667628013277-4.26762801327708
5936.821.617416132229515.1825838677705
6050.734.040675525189916.6593244748101
6142.833.14151056997229.65848943002778
 
Charts produced by software:
http://127.0.0.1/wessadotnet/public_html/freestatisticsdotorg/blog/date/2007/Nov/19/t11954661255rb13y8d3hjmukh/1atdz1195466514.png (open in new window)
http://127.0.0.1/wessadotnet/public_html/freestatisticsdotorg/blog/date/2007/Nov/19/t11954661255rb13y8d3hjmukh/1atdz1195466514.ps (open in new window)


http://127.0.0.1/wessadotnet/public_html/freestatisticsdotorg/blog/date/2007/Nov/19/t11954661255rb13y8d3hjmukh/2go7b1195466514.png (open in new window)
http://127.0.0.1/wessadotnet/public_html/freestatisticsdotorg/blog/date/2007/Nov/19/t11954661255rb13y8d3hjmukh/2go7b1195466514.ps (open in new window)


http://127.0.0.1/wessadotnet/public_html/freestatisticsdotorg/blog/date/2007/Nov/19/t11954661255rb13y8d3hjmukh/3ou4w1195466514.png (open in new window)
http://127.0.0.1/wessadotnet/public_html/freestatisticsdotorg/blog/date/2007/Nov/19/t11954661255rb13y8d3hjmukh/3ou4w1195466514.ps (open in new window)


http://127.0.0.1/wessadotnet/public_html/freestatisticsdotorg/blog/date/2007/Nov/19/t11954661255rb13y8d3hjmukh/45pb11195466514.png (open in new window)
http://127.0.0.1/wessadotnet/public_html/freestatisticsdotorg/blog/date/2007/Nov/19/t11954661255rb13y8d3hjmukh/45pb11195466514.ps (open in new window)


http://127.0.0.1/wessadotnet/public_html/freestatisticsdotorg/blog/date/2007/Nov/19/t11954661255rb13y8d3hjmukh/5jt3s1195466514.png (open in new window)
http://127.0.0.1/wessadotnet/public_html/freestatisticsdotorg/blog/date/2007/Nov/19/t11954661255rb13y8d3hjmukh/5jt3s1195466514.ps (open in new window)


http://127.0.0.1/wessadotnet/public_html/freestatisticsdotorg/blog/date/2007/Nov/19/t11954661255rb13y8d3hjmukh/68rfl1195466514.png (open in new window)
http://127.0.0.1/wessadotnet/public_html/freestatisticsdotorg/blog/date/2007/Nov/19/t11954661255rb13y8d3hjmukh/68rfl1195466514.ps (open in new window)


http://127.0.0.1/wessadotnet/public_html/freestatisticsdotorg/blog/date/2007/Nov/19/t11954661255rb13y8d3hjmukh/776kd1195466514.png (open in new window)
http://127.0.0.1/wessadotnet/public_html/freestatisticsdotorg/blog/date/2007/Nov/19/t11954661255rb13y8d3hjmukh/776kd1195466514.ps (open in new window)


http://127.0.0.1/wessadotnet/public_html/freestatisticsdotorg/blog/date/2007/Nov/19/t11954661255rb13y8d3hjmukh/8j4jr1195466514.png (open in new window)
http://127.0.0.1/wessadotnet/public_html/freestatisticsdotorg/blog/date/2007/Nov/19/t11954661255rb13y8d3hjmukh/8j4jr1195466514.ps (open in new window)


http://127.0.0.1/wessadotnet/public_html/freestatisticsdotorg/blog/date/2007/Nov/19/t11954661255rb13y8d3hjmukh/9afae1195466514.png (open in new window)
http://127.0.0.1/wessadotnet/public_html/freestatisticsdotorg/blog/date/2007/Nov/19/t11954661255rb13y8d3hjmukh/9afae1195466514.ps (open in new window)


 
Parameters:
par1 = 2 ; par2 = Include Monthly Dummies ; par3 = Linear Trend ;
 
R code (references can be found in the software module):
library(lattice)
par1 <- as.numeric(par1)
x <- t(y)
k <- length(x[1,])
n <- length(x[,1])
x1 <- cbind(x[,par1], x[,1:k!=par1])
mycolnames <- c(colnames(x)[par1], colnames(x)[1:k!=par1])
colnames(x1) <- mycolnames #colnames(x)[par1]
x <- x1
if (par3 == 'First Differences'){
x2 <- array(0, dim=c(n-1,k), dimnames=list(1:(n-1), paste('(1-B)',colnames(x),sep='')))
for (i in 1:n-1) {
for (j in 1:k) {
x2[i,j] <- x[i+1,j] - x[i,j]
}
}
x <- x2
}
if (par2 == 'Include Monthly Dummies'){
x2 <- array(0, dim=c(n,11), dimnames=list(1:n, paste('M', seq(1:11), sep ='')))
for (i in 1:11){
x2[seq(i,n,12),i] <- 1
}
x <- cbind(x, x2)
}
if (par2 == 'Include Quarterly Dummies'){
x2 <- array(0, dim=c(n,3), dimnames=list(1:n, paste('Q', seq(1:3), sep ='')))
for (i in 1:3){
x2[seq(i,n,4),i] <- 1
}
x <- cbind(x, x2)
}
k <- length(x[1,])
if (par3 == 'Linear Trend'){
x <- cbind(x, c(1:n))
colnames(x)[k+1] <- 't'
}
x
k <- length(x[1,])
df <- as.data.frame(x)
(mylm <- lm(df))
(mysum <- summary(mylm))
bitmap(file='test0.png')
plot(x[,1], type='l', main='Actuals and Interpolation', ylab='value of Actuals and Interpolation (dots)', xlab='time or index')
points(x[,1]-mysum$resid)
grid()
dev.off()
bitmap(file='test1.png')
plot(mysum$resid, type='b', pch=19, main='Residuals', ylab='value of Residuals', xlab='time or index')
grid()
dev.off()
bitmap(file='test2.png')
hist(mysum$resid, main='Residual Histogram', xlab='values of Residuals')
grid()
dev.off()
bitmap(file='test3.png')
densityplot(~mysum$resid,col='black',main='Residual Density Plot', xlab='values of Residuals')
dev.off()
bitmap(file='test4.png')
qqnorm(mysum$resid, main='Residual Normal Q-Q Plot')
grid()
dev.off()
(myerror <- as.ts(mysum$resid))
bitmap(file='test5.png')
dum <- cbind(lag(myerror,k=1),myerror)
dum
dum1 <- dum[2:length(myerror),]
dum1
z <- as.data.frame(dum1)
z
plot(z,main=paste('Residual Lag plot, lowess, and regression line'), ylab='values of Residuals', xlab='lagged values of Residuals')
lines(lowess(z))
abline(lm(z))
grid()
dev.off()
bitmap(file='test6.png')
acf(mysum$resid, lag.max=length(mysum$resid)/2, main='Residual Autocorrelation Function')
grid()
dev.off()
bitmap(file='test7.png')
pacf(mysum$resid, lag.max=length(mysum$resid)/2, main='Residual Partial Autocorrelation Function')
grid()
dev.off()
bitmap(file='test8.png')
opar <- par(mfrow = c(2,2), oma = c(0, 0, 1.1, 0))
plot(mylm, las = 1, sub='Residual Diagnostics')
par(opar)
dev.off()
load(file='createtable')
a<-table.start()
a<-table.row.start(a)
a<-table.element(a, 'Multiple Linear Regression - Estimated Regression Equation', 1, TRUE)
a<-table.row.end(a)
myeq <- colnames(x)[1]
myeq <- paste(myeq, '[t] = ', sep='')
for (i in 1:k){
if (mysum$coefficients[i,1] > 0) myeq <- paste(myeq, '+', '')
myeq <- paste(myeq, mysum$coefficients[i,1], sep=' ')
if (rownames(mysum$coefficients)[i] != '(Intercept)') {
myeq <- paste(myeq, rownames(mysum$coefficients)[i], sep='')
if (rownames(mysum$coefficients)[i] != 't') myeq <- paste(myeq, '[t]', sep='')
}
}
myeq <- paste(myeq, ' + e[t]')
a<-table.row.start(a)
a<-table.element(a, myeq)
a<-table.row.end(a)
a<-table.end(a)
table.save(a,file='mytable1.tab')
a<-table.start()
a<-table.row.start(a)
a<-table.element(a,hyperlink('http://www.xycoon.com/ols1.htm','Multiple Linear Regression - Ordinary Least Squares',''), 6, TRUE)
a<-table.row.end(a)
a<-table.row.start(a)
a<-table.element(a,'Variable',header=TRUE)
a<-table.element(a,'Parameter',header=TRUE)
a<-table.element(a,'S.D.',header=TRUE)
a<-table.element(a,'T-STAT<br />H0: parameter = 0',header=TRUE)
a<-table.element(a,'2-tail p-value',header=TRUE)
a<-table.element(a,'1-tail p-value',header=TRUE)
a<-table.row.end(a)
for (i in 1:k){
a<-table.row.start(a)
a<-table.element(a,rownames(mysum$coefficients)[i],header=TRUE)
a<-table.element(a,mysum$coefficients[i,1])
a<-table.element(a, round(mysum$coefficients[i,2],6))
a<-table.element(a, round(mysum$coefficients[i,3],4))
a<-table.element(a, round(mysum$coefficients[i,4],6))
a<-table.element(a, round(mysum$coefficients[i,4]/2,6))
a<-table.row.end(a)
}
a<-table.end(a)
table.save(a,file='mytable2.tab')
a<-table.start()
a<-table.row.start(a)
a<-table.element(a, 'Multiple Linear Regression - Regression Statistics', 2, TRUE)
a<-table.row.end(a)
a<-table.row.start(a)
a<-table.element(a, 'Multiple R',1,TRUE)
a<-table.element(a, sqrt(mysum$r.squared))
a<-table.row.end(a)
a<-table.row.start(a)
a<-table.element(a, 'R-squared',1,TRUE)
a<-table.element(a, mysum$r.squared)
a<-table.row.end(a)
a<-table.row.start(a)
a<-table.element(a, 'Adjusted R-squared',1,TRUE)
a<-table.element(a, mysum$adj.r.squared)
a<-table.row.end(a)
a<-table.row.start(a)
a<-table.element(a, 'F-TEST (value)',1,TRUE)
a<-table.element(a, mysum$fstatistic[1])
a<-table.row.end(a)
a<-table.row.start(a)
a<-table.element(a, 'F-TEST (DF numerator)',1,TRUE)
a<-table.element(a, mysum$fstatistic[2])
a<-table.row.end(a)
a<-table.row.start(a)
a<-table.element(a, 'F-TEST (DF denominator)',1,TRUE)
a<-table.element(a, mysum$fstatistic[3])
a<-table.row.end(a)
a<-table.row.start(a)
a<-table.element(a, 'p-value',1,TRUE)
a<-table.element(a, 1-pf(mysum$fstatistic[1],mysum$fstatistic[2],mysum$fstatistic[3]))
a<-table.row.end(a)
a<-table.row.start(a)
a<-table.element(a, 'Multiple Linear Regression - Residual Statistics', 2, TRUE)
a<-table.row.end(a)
a<-table.row.start(a)
a<-table.element(a, 'Residual Standard Deviation',1,TRUE)
a<-table.element(a, mysum$sigma)
a<-table.row.end(a)
a<-table.row.start(a)
a<-table.element(a, 'Sum Squared Residuals',1,TRUE)
a<-table.element(a, sum(myerror*myerror))
a<-table.row.end(a)
a<-table.end(a)
table.save(a,file='mytable3.tab')
a<-table.start()
a<-table.row.start(a)
a<-table.element(a, 'Multiple Linear Regression - Actuals, Interpolation, and Residuals', 4, TRUE)
a<-table.row.end(a)
a<-table.row.start(a)
a<-table.element(a, 'Time or Index', 1, TRUE)
a<-table.element(a, 'Actuals', 1, TRUE)
a<-table.element(a, 'Interpolation<br />Forecast', 1, TRUE)
a<-table.element(a, 'Residuals<br />Prediction Error', 1, TRUE)
a<-table.row.end(a)
for (i in 1:n) {
a<-table.row.start(a)
a<-table.element(a,i, 1, TRUE)
a<-table.element(a,x[i])
a<-table.element(a,x[i]-mysum$resid[i])
a<-table.element(a,mysum$resid[i])
a<-table.row.end(a)
}
a<-table.end(a)
table.save(a,file='mytable4.tab')
 





Copyright

Creative Commons License

This work is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 License.

Software written by Ed van Stee & Patrick Wessa


Disclaimer

Information provided on this web site is provided "AS IS" without warranty of any kind, either express or implied, including, without limitation, warranties of merchantability, fitness for a particular purpose, and noninfringement. We use reasonable efforts to include accurate and timely information and periodically update the information, and software without notice. However, we make no warranties or representations as to the accuracy or completeness of such information (or software), and we assume no liability or responsibility for errors or omissions in the content of this web site, or any software bugs in online applications. Your use of this web site is AT YOUR OWN RISK. Under no circumstances and under no legal theory shall we be liable to you or any other person for any direct, indirect, special, incidental, exemplary, or consequential damages arising from your access to, or use of, this web site.


Privacy Policy

We may request personal information to be submitted to our servers in order to be able to:

We NEVER allow other companies to directly offer registered users information about their products and services. Banner references and hyperlinks of third parties NEVER contain any personal data of the visitor.

We do NOT sell, nor transmit by any means, personal information, nor statistical data series uploaded by you to third parties.

We carefully protect your data from loss, misuse, alteration, and destruction. However, at any time, and under any circumstance you are solely responsible for managing your passwords, and keeping them secret.

We store a unique ANONYMOUS USER ID in the form of a small 'Cookie' on your computer. This allows us to track your progress when using this website which is necessary to create state-dependent features. The cookie is used for NO OTHER PURPOSE. At any time you may opt to disallow cookies from this website - this will not affect other features of this website.

We examine cookies that are used by third-parties (banner and online ads) very closely: abuse from third-parties automatically results in termination of the advertising contract without refund. We have very good reason to believe that the cookies that are produced by third parties (banner ads) do NOT cause any privacy or security risk.

FreeStatistics.org is safe. There is no need to download any software to use the applications and services contained in this website. Hence, your system's security is not compromised by their use, and your personal data - other than data you submit in the account application form, and the user-agent information that is transmitted by your browser - is never transmitted to our servers.

As a general rule, we do not log on-line behavior of individuals (other than normal logging of webserver 'hits'). However, in cases of abuse, hacking, unauthorized access, Denial of Service attacks, illegal copying, hotlinking, non-compliance with international webstandards (such as robots.txt), or any other harmful behavior, our system engineers are empowered to log, track, identify, publish, and ban misbehaving individuals - even if this leads to ban entire blocks of IP addresses, or disclosing user's identity.


FreeStatistics.org is powered by