POI Updates and Downloads Forum
| Message | ||
|---|---|---|
| Posted by ve3slm Removing duplicates I am new to this site, but one thing I have noticed in downloading the POI files from this site is that there is some overlap between provincial / state files. For example, using the Tim Horton's locations (lifeblood here in Canada :D ) the Quebec file contains Ontario, New Brunswick, and Nova Scotia locations. If you download all of the .CSV files and run them through POI Loader, you will have these duplicates in your GPS. However, if you either download the GPX files, or convert the CSV to GPX, and then load the GPX,s into MapSource, the duplicates will be detected and can automatically be removed. Then you can save the new .GPX and run it through POI Loader. For the Tim Horton's, this reduced the number of POI's by about 25% (from 4700 to 3200 or so) |
||
| Posted by adam_d_richardson remove duplicates You can also remove the duplicates in a CSV file by joining all the CSV files together. Do this either with copy and paste or using a DOS/terminal concat command. You can then open the CSV file in a spreadsheet application and filter the data to only show unique values. You can then copy the data out and save in a new sheet (saving as CSV) and this will provide you with just the one cleansed file to upload. |
||
| Posted by bigappo Removing duplicates All the data in my Navman .csv files seems to have unique sequential number on the end of each line. If I delete a line how does this affect the "sequence"? How would you restore the sequence without physically changing every line beyond the one you have deleted/added? |
||
| Posted by evg84 Removing duplicates You might work with java csv files to eliminate duplicates. |
||
| Posted by dcj1710 Re: Removing duplicates
Open the file in excel, click the 'Data" tab on the toolbar then click 'Remove Duplicates' the pop up will ask which column you want searched for duplicates (usually column C) uncheck the columns that you don't want the duplicates removed from then click OK. This removes all duplicates but has no impact on your 'sequence' as the sequential number makes the column unique. Click save as and save in whatever format you require; if your specific format isn't available save it as .csv comma delimited and as excel workbook, then use the POI tools on this site to convert is to your format. |
||