Calculating RMSE Va...
 
Notifications
Clear all

Calculating RMSE Values

4 Posts
4 Users
0 Reactions
4 Views
(@andrewm)
Posts: 268
Registered
Topic starter
 

I'm helping a friend with a paper on field data collection using smart phone apps. He wants me to perform some accuracy comparisons using internal phone gps, external bluetooth gps (consumer grade), external mapping grade bluetooth gps, all the way up to my survey-grade Trimble R2. Using my R2, I plan on establishing a bench mark at my office using a 6-hour static observation and process through Opus. Then with each device, I will connect to my smart phone via bluetooth and use the Esri Collector app to collect a streaming line feature at 1s intervals for 30-minutes each. I'll convert the line vertices to points and get state plane coordinates for each point. Then I'll bring the data in Excel to calculate RMSE values compared to the benchmark. Here's where I need some help. What is the proper way to calculate RMSE (horizontal only)? Here's one way:

  1. Calculate north error for each point (measured_n - benchmark_n)
  2. Calculate east error for each point (measured_e - benchmark_e)
  3. Calculate horizontal error for each point (SQRT(x^2+y^2))
  4. Square the horizontal error for each point
  5. Calculate the average of the squared errors
  6. Calculate the square root of the average of the squared errors to obtain the RMSE error

Here's another way I saw:

  1. Calculate north and east error as above
  2. Calculate standard deviation for north error
  3. Calculate standard deviation for east error
  4. Calculate the square root of the sum of the squared standard deviations to obtain RMS

Which way is correct?

 
Posted : May 20, 2016 10:43 am
(@bill93)
Posts: 9834
 

The second is WRONG. If N and E rms are equal and uncorrelated the radial rms is that same number. If unequal or correlated you get an ellipse whose parameters depend on a more complicated set of formulas.

 
Posted : May 20, 2016 8:20 pm
(@mark-silver)
Posts: 713
Registered
 

You should compare 24-hour data sets, or run all at the same time.

Otherwise one can pick the winner with mission planning.

M

 
Posted : May 21, 2016 3:55 pm
(@felipe-g-nievinski)
Posts: 42
Registered
 

The first method is correct. It may be called "pooled RMS". Taking the average of squared RMS values is preferable to the average of RMS values, especially if you wish to expand the result to a given confidence level at the end.
-FGN.

 
Posted : May 24, 2016 10:48 am