Get error when uploading ANcestryDNA

[chrisbonisa]

Actually, Ancestry's v1.0 chip had more SNPs in common with FTDNA's chip than their v2.0 chip, if that is what you mean. See ISOGGs "Autosomal SNP comparison chart" for specifics.

I don't recall people having issues uploading Ancestry v1.0 results, but others could comment on that.

I've not seen this chart before(great info!), but it actually shows exactly what I'm talking about. If you look at the Ancestry v1 versus v2 you see 407,968 out of 641,908 are shared which explains the ~60% overlap between the two attempting to use this tool to build a v2 file out of a v1 file using a v2 template.

Technically we could build a tool to convert from any of these formats to another, but there would be so much discarded due to the lack of overlap, I'm not sure it would be worth the time.

[KATM]

On a side note, we had 2 kits uploaded that appear to be v1.0 files, which there is only 60% snp coverage compared to v2.0 which doesn't sound very viable. Were there ever problems uploading v1.0 files? In theory I could make a v1.0 template to achieve the same results as I have my brothers dna file from 2016 which he successfully uploaded last year. If there is any interest in this, whomever is trying, please let me know and I will add that, there is no identifiable info in the files so I don't know who you are, you would have to reach out to me.

Actually, Ancestry's v1.0 chip had more SNPs in common with FTDNA's chip than their v2.0 chip, if that is what you mean. See ISOGGs "Autosomal SNP comparison chart" for specifics.

I don't recall people having issues uploading Ancestry v1.0 results, but others could comment on that.

[Ann Turner]

On a side note, we had 2 kits uploaded that appear to be v1.0 files, which there is only 60% snp coverage compared to v2.0 which doesn't sound very viable. Were there ever problems uploading v1.0 files? In theory I could make a v1.0 template to achieve the same results as I have my brothers dna file from 2016 which he successfully uploaded last year. If there is any interest in this, whomever is trying, please let me know and I will add that, there is no identifiable info in the files so I don't know who you are, you would have to reach out to me.

FTDNA has accepted v1 files for a very long time. If there are current problems, they must be different.

[Ann Turner]

I stuck it up on one of my websites where I'm doing some other DNA stuff, anyone can feel free to use it if they wish:

http://www.mapmy23.com/tools/ancestry_ftdna_fix.php

If you do use the tool, please respond in here and let others know if it works or not. So far in my testing its working 100%, but the more people that try it the more we will know if this is a solution until FTDNA resolves it themselves.

I posted a link to your tool in several places, and there were a number of grateful responses!

[chrisbonisa]

Thank You Thank You Thank You!

Have followed this thread for weeks, and been trying myself to edit the two ancestry files I had, realigning lines and adding no calls to no avail

Your Tool worked perfectly and both 17.184kb files (Tests from Ancestry since Aug 17th) now uploaded to FTDNA with no problems!

Cant thank you enough!

Ryan

Excellent! Glad this is working! We have had over 75 kits put through the tool now so it seems to be working for a lot of people!

Wow, thank you so much! I've been reading ways to fix it and no luck. This was fast and simple! Thank you!!!!!!

Glad this is working!

On a side note, we had 2 kits uploaded that appear to be v1.0 files, which there is only 60% snp coverage compared to v2.0 which doesn't sound very viable. Were there ever problems uploading v1.0 files? In theory I could make a v1.0 template to achieve the same results as I have my brothers dna file from 2016 which he successfully uploaded last year. If there is any interest in this, whomever is trying, please let me know and I will add that, there is no identifiable info in the files so I don't know who you are, you would have to reach out to me.

[mamoahina]

If you do use the tool, please respond in here and let others know if it works or not. So far in my testing its working 100%, but the more people that try it the more we will know if this is a solution until FTDNA resolves it themselves.

Wow, thank you so much! I've been reading ways to fix it and no luck. This was fast and simple! Thank you!!!!!!

[clarkie]

Yeah I didn't notice the PM, but I've read and responded to it. I've built out a tool that seems to work 100%. The key to solving it is a combination of what I was doing before, filling in the blank template file of a working file with the data from the non-working one, but keeping the I's and D's from the template and not zeroing the entire thing and also filling everything in by position number instead of RSID, which is what I was doing the first go around.

I stuck it up on one of my websites where I'm doing some other DNA stuff, anyone can feel free to use it if they wish:

http://www.mapmy23.com/tools/ancestry_ftdna_fix.php

If you do use the tool, please respond in here and let others know if it works or not. So far in my testing its working 100%, but the more people that try it the more we will know if this is a solution until FTDNA resolves it themselves.

Thank You Thank You Thank You!

Have followed this thread for weeks, and been trying myself to edit the two ancestry files I had, realigning lines and adding no calls to no avail

Your Tool worked perfectly and both 17.184kb files (Tests from Ancestry since Aug 17th) now uploaded to FTDNA with no problems!

Cant thank you enough!

Ryan

[chrisbonisa]

Slight update

Looks like someone tried to upload a double-line spaced file for some reason, and also whitespace before the columns, maybe they opened the text file up in wordpad or something. Anyways I added some code to filter those extra lines out and trim the whitespace to be able to process files like this. The tool now only cares about this:

If a line after whitespace trimmed starts with "rs" but not "rsid"(this is a header line). That row will be assumed to be data and tab delimited(white spacing also removed from other columns).

Columns are in this order:
rsid chromosome position allele1 allele2

This is all the same as a typical Ancestry.com file, I'm basically just filtering out any extra characters or linefeeds introduced by opening the file in a text editor and re-saving it.

[chrisbonisa]

Same here--thank you! Worked like a charm. Matches are correct, everything looks good on this end. We did compare to results at Gedmatch and some percentages on admix are .01%-.03% off from the original, but expecting that would occur with the constant flux of data.

Again, thank you all so much--have been fighting this upload for a month. Your fix took all of 10 minutes (half of that was reading and copying files over!)

Awesome! And yeah if you do the math, about 1000 snps get discarded as they dont exist in the format excepted by ftdna and thats out of 650,000 or so.....around 0.15% or 99.85% coverage. Thats such a tiny difference I don't think it would affect anything.

[DBrooks]

Just a follow up to this, my moms dna which i put through this tool and uploaded successfully to FTDNA has finished processing by them and shows all the matches I would expect as a normal upload would! I can now use the matrix tool and narrow down which lines my matches are coming from on my tree!

Same here--thank you! Worked like a charm. Matches are correct, everything looks good on this end. We did compare to results at Gedmatch and some percentages on admix are .01%-.03% off from the original, but expecting that would occur with the constant flux of data.

Again, thank you all so much--have been fighting this upload for a month. Your fix took all of 10 minutes (half of that was reading and copying files over!)

[chrisbonisa]

Follow up

Yeah I didn't notice the PM, but I've read and responded to it. I've built out a tool that seems to work 100%. The key to solving it is a combination of what I was doing before, filling in the blank template file of a working file with the data from the non-working one, but keeping the I's and D's from the template and not zeroing the entire thing and also filling everything in by position number instead of RSID, which is what I was doing the first go around.

I stuck it up on one of my websites where I'm doing some other DNA stuff, anyone can feel free to use it if they wish:

http://www.mapmy23.com/tools/ancestry_ftdna_fix.php

If you do use the tool, please respond in here and let others know if it works or not. So far in my testing its working 100%, but the more people that try it the more we will know if this is a solution until FTDNA resolves it themselves.

Just a follow up to this, my moms dna which i put through this tool and uploaded successfully to FTDNA has finished processing by them and shows all the matches I would expect as a normal upload would! I can now use the matrix tool and narrow down which lines my matches are coming from on my tree!

[chrisbonisa]

OldFinneyKid and chrisbonisa, you may want to give FTDNA an extra not-so-gentle nudge by submitting the AncestryDNAFix link, or your methods, via the Family Tree DNA Feedback form, because they don't usually read the forums.

Good idea! I've sent them a message...

[KATM]

OldFinneyKid and chrisbonisa, you may want to give FTDNA an extra not-so-gentle nudge by submitting the AncestryDNAFix link, or your methods, via the Family Tree DNA Feedback form, because they don't usually read the forums.

[OldFinneyKid]

2 work-arounds for FTDNA

Hopefully between these 2 tools it will solve our problems for now!

Yeah, there are 2 complete methods -- send the DNA file to your server and get it back finished, or process it locally on your own PC. Something for everyone.

FTDNA could easily incorporate these checks into their uploads if they really wanted the autosomal transfer to work.

[chrisbonisa]

I'm glad you could use the info about the additional records in the template. I, too, have tested mine 4 times now and feel good about the reliablity.

For anyone wishing to use it, it's at AncestryDNAFix. Feel free to use it, I don't need any feedback unless you need something....

Yes, thank you for those additional ideas, that was really the last key to getting the darn thing working! Hopefully between these 2 tools it will solve our problems for now! And I agree with your comments before, there is no reason FTDNA cannot do this themselves, its really not rocket science once you know whats wrong with it.