GPS POI Home POI FilesPOI ToolsPOI MapsGPS ForumSupport
  GPS Data Team
Your local business listing specialists

Home > Forums > POI Updates and Downloads > Removing duplicates

Post new GPS POI data or GPS devices related topic in POI Updates and Downloads forum   Reply to topic Removing duplicates
 



ve3slm

GPS: Garmin Mobile PC







Post Removing duplicates     
Reply with quote

I am new to this site, but one thing I have noticed in downloading the POI files from this site is that there is some overlap between provincial / state files. For example, using the Tim Horton's locations (lifeblood here in Canada Very Happy ) the Quebec file contains Ontario, New Brunswick, and Nova Scotia locations. If you download all of the .CSV files and run them through POI Loader, you will have these duplicates in your GPS. However, if you either download the GPX files, or convert the CSV to GPX, and then load the GPX,s into MapSource, the duplicates will be detected and can automatically be removed. Then you can save the new .GPX and run it through POI Loader. For the Tim Horton's, this reduced the number of POI's by about 25% (from 4700 to 3200 or so)
View user's profile





adam_d_richardson

GPS: Apple iPhone 3GS







Post remove duplicates     
Reply with quote

You can also remove the duplicates in a CSV file by joining all the CSV files together. Do this either with copy and paste or using a DOS/terminal concat command.
You can then open the CSV file in a spreadsheet application and filter the data to only show unique values. You can then copy the data out and save in a new sheet (saving as CSV) and this will provide you with just the one cleansed file to upload.
View user's profile





bigappo

GPS: Navman MY450LMT







Post Removing duplicates     
Reply with quote

All the data in my Navman .csv files seems to have unique sequential number on the end of each line. If I delete a line how does this affect the "sequence"? How would you restore the sequence without physically changing every line beyond the one you have deleted/added?
View user's profile





evg84

GPS: iPhone 4







Post Removing duplicates     
Reply with quote

You might work with java csv files to eliminate duplicates.
View user's profile





dcj1710

GPS: iphone







Post Re: Removing duplicates     
Reply with quote

bigappo wrote:
All the data in my Navman .csv files seems to have unique sequential number on the end of each line. If I delete a line how does this affect the "sequence"? How would you restore the sequence without physically changing every line beyond the one you have deleted/added?


Open the file in excel, click the 'Data" tab on the toolbar then click 'Remove Duplicates' the pop up will ask which column you want searched for duplicates (usually column C) uncheck the columns that you don't want the duplicates removed from then click OK. This removes all duplicates but has no impact on your 'sequence' as the sequential number makes the column unique.
Click save as and save in whatever format you require; if your specific format isn't available save it as .csv comma delimited and as excel workbook, then use the POI tools on this site to convert is to your format.
View user's profile





Your Name

Guest






Post Your comments     
Reply with quote

Add your comment here:

 




Display posts from previous:   
Post new GPS POI data or GPS devices related topic in POI Updates and Downloads forum Reply to topic Removing duplicates
Home > GPS Forum > POI Updates and Downloads > Discussion

Page 1 of 1




Jump to:  

 






Permalink: Removing duplicates | POI Updates and Downloads forum