Research SitesNavigationUser loginWho's onlineThere are currently 0 users and 4 guests online.
|
Comparing vector reprojection between GDAL 1.3.1 and ArcMap 9.0Submitted by dylan on Sun, 2006-07-30 03:04.
UPDATE:
it looks like the mysterious NAD_1927_To_NAD_1983_6 transform is actually a localized transform for the Quebec area. Furthermore, ESRI has informed us that this is not in any way a default transform, rather the first in the list. In summary, regardless of the software that you are using to do this type of work, always know your data and do your homework on the available methods. Thanks to Matt Wilkie for the detective work. OGR ogr2ogr -s_srs 'prj=latlong datum=NAD83' -t_srs '+proj=utm +zone=11 +datum=NAD27' output.shp input.shp ArcToolbox transform from NAD83 GCS to NAD27 UTM Zone 11 (NADCON) ArcToolbox transform from NAD83 GCS to NAD27 UTM Zone 11 (NAD_1927_To_NAD_1983_6 transformation)
Several comparisons where done to assess the three dataum shifting methods. First the output from the cs2cs command (used for datum shift operations among other things) was compared with the same operation on a the NGS NADCON website. The two methods appeard to be the same for at least 10 decimal places. Next, the first coordinate from a polygon projected across datums (with the three methods described above) was compared. The OGR and ArcGIS (NADCON) methods produced identical results, however the ArcGIS (NAD_1927_To_NAD_1983_6) method produced odd results. It appeared as if the coordinates where transformed, but not corectly. Finally, the same coordinate was datum shifted using proj directly: with the same odd results as the NAD_1927_To_NAD_1983_6 method. An analysis of these coordinates as compared to the corectly shifted coordinates is presented in figures 2 through 4. As discovered in an earlier experiment, vector projection within a single datum by OGR and ArcGIS yielded nearly identical results. This is certainly a good thing if you are using both of these programs in your work flow, or sharing with others critical of open source tools. Based on these simple tests, the output from OGR and ArcGIS (using the NADCON transform) are functionaly identical. This is also a good thing. However, the default transform presented in the project feature dialog within ArcToolbox (Figure 1) is still a bit puzzling. While it appears to perform some soft of coordinate projection, it is certainly not the correct one. Also, it is worth noting that using the proj command directly for a similar operation results in the same odd output! It should be said however, that proj is not designed for datum shifts. Instead, the command cs2cs should be used. What have we learned? While I wasn't expecting OGR and ArcGIS to produce different results, it is nice to see that when used properly they produce nearly identical output. Perhaps someone can shed some light on the default, and somewhat bizzare NAD_1927_To_NAD_1983_6 datum transform method in ArcGIS 9.0. Details on the tests can be found below:
( categories: Dylan | Open Source GIS and Mapping Ideas )
The datum shift reference in the ESRI doco (http://edndoc.esri.com/arcobjects/9.1/default.asp?url=/arcobjects/9.1/ComponentHelp/esriGeometry/esriSRGeoTransformation3Type.htm) points to an EPSG code for the shift (1573). If you look this up in the EPSG database (http://www.epsg.org/) , it references a NTV2 Canadian Transformation (specifically for Quebec as mentioned above.) The funny thing is, this grid should not work outside of Quebec. In searching through all of the NAD27 -> NAD83 shifts (the mathematical ones anyways), nothing comes close to the shift (~ dx=60.0, dy= 108.2, dz=192.600000). Interesting indeeed. I didn't think to lookup the EPSG code mentioned in the EDN article. Could this suggest that there is no error-checking involved in the application of a transform within ArcGIS 9.0? Well IMHO there should be no such thing as a "default" set of datum transformation parameters for a datum, and ArcGIS and OGR are both wrong in allowing the user to use a default transformation without further prompting. It just so happens in this case that the one OGR uses (NADCON) is the most accurate available for the area covered by your data, but in the general case (worldwide) this is very hard to determine and there normally is no such thing as a default. The transformation that should be used depends on the exact area covered, accuracy required etc. In most cases in GRASS, when choosing projection parameters, the user is interactively prompted and forced to make a decision on which datum transformation to use. I feel this is "a good thing" because, in the best traditions of the steep learning curve in GRASS (!) it makes the user think about the meaning of their data and how reliable they expect the result of the processing to be (garbage in garbage out etc.). Thanks for the comment Paul. Without a doubt I agree in regards to the approach where the user must select an appropriate dataum transform. However, I must admit that the first time I used GRASS, I was forced to take out my old text book on cartography [1] and read up on things. Perhaps some pressure on both the GDAL (proj4) and ArcGIS side will help to get things moving in the right direction. PS: interesting website on the France datum shift grid creation!
Hey Dylan: By the way, thanks for doing this benchmarking. People do this stuff all the time with Statistical software as well. They usually use SAS as the gold standard. It was based upon some of these results: that I advise people to NEVER do statistical analysis in Excel except for things like Mean and Median. Hi Steve thanks for the comments. The ESRI link was interesting, but not particularly enlightening in regards to the actualy parameters involved. In regards to statistical analysis, I would highly recommend R as it is both multi-platform and open source. In addition it has some excellent packages for interfacing to RDBMS, GDAL, and GRASS. Ditto on the Excel comment! |
||||||||||||||||||||||||||||||||||||||||||||||||||
I asked ESRI about this, their response: The 'default' transformation that Dylan refers to, NAD_1927_To_NAD_1983_6, is just the first in the alphabetical list. As it turns it out, it uses NTv2 and is designed for Quebec. ArcGIS generally doesn't set any default transformations but leaves it to you to decide which one is most appropriate. Dylan's data is outside the area covered by the NTv2 grid file, so essentially no tranformation occurs when he uses NAD_1927_To_NAD_1983_6. A better reference for him, which does list the methods, parameters and areas of use for the transformations is:
http://support.esri.com/index.cfm?fa=knowledgebase.techarticles.articleShow&d=21327
-- Melita Kennedy Product Specialist ESRI, Inc.
Even if mistaken about the "default", thank you for conducting the experiment and telling us about it. Otherwise I would sailed along quite happily usiing the wrong selections myself. Also thanks to you we also know that provided the appropriate transformation method is chosen equivalent results can be achieved with both ArcGIS and GDAL, so we are all free to choose the tool most readily at hand.