Showing posts with label Prosapia Genetics. Show all posts
Showing posts with label Prosapia Genetics. Show all posts

Friday, 25 July 2014

My letter in Family Tree Magazine about "genetic homeland" stories

The August 2014 issue of Family Tree Magazine includes a letter I wrote in response to two stories in their July issue which claimed that it is possible to identify someone's "genetic homeland" from a DNA test. There was not space in the magazine to include the full text of my letter and the editor has kindly given me permission to reproduce the full letter here.
In your July issue you published two articles which claimed to show that it is possible to pinpoint your "genetic homeland" a thousand or more years ago by taking a simple DNA test. It would indeed be wonderful if a DNA test could give us this information but sadly it is not possible. 
The first story “DNA: find your ancestral home” (p9) referred to a new autosomal DNA test developed by a company called Prosapia Genetics. They claim that they are able to pinpoint someone’s genetic homeland one thousand years ago and that their test is “accurate to home village with a time resolution of the past 1,000 years”. The underlying research on which this test is based was published in a scientific journal (Elhaik et el 2014, Nature Communications 5: 3513). However, the researchers were only able to place 50% of people within 450 kilometres of their country of origin, which is hardly the level of precision claimed. Furthermore the research focused solely on the present-day country of origin and made no attempt to determine an ancestral origin one thousand years ago. Such a method is best thought of as human provenancing – finding the location where an individual’s genotype is most likely to be found – not a method for inferring ancestry. Indeed, if you go back one thousand years you have in theory about 35 billion ancestors, although you actually inherited DNA from only a small, random subset of those ancestors. Identifying a single location as the “genetic homeland” of either all your pedigree ancestors or just the DNA ancestors would be a meaningless exercise. The International Society of Genetic Genealogy received a number of reports from dissatisfied customers of Prosapia Genetics, many of whom had received bizarre results placing their "genetic homeland" in the middle of a river or ocean. Fortunately they were able to get refunds from PayPal. 
Dr Tyrone Bowes, the author of the second article "Routes to roots" (pp14-18), claims to be able to tell his customers when their ancestors arrived in Britain and where they came from based on recurring surname matches received as part of a commercial Y-chromosome DNA test. DNA testing is a very useful tool for the genealogist, and Y-DNA matches can often provide clues about our recent origins. However, Y-DNA results should always be interpreted in combination with genealogical and historical records. While a Y-DNA test is very good at indicating whether or not two people share a recent male-line ancestor, it is much more difficult to determine precisely when or where that ancestor might have lived. For example, a match on 34 out of 37 markers could indicate a shared ancestor who lived 200 years ago or 2000 years ago, and there is no way of determining the precise timeframe. Furthermore, surnames did not become common in Britain one thousand years ago, as is claimed. They were introduced into Britain with the Norman Conquest but the adoption of surnames was a gradual process. While most English people had acquired surnames by the fifteenth century, surnames were not adopted until the nineteenth century in some parts of Wales. In the Highlands of Scotland the clan system survived until the eighteenth century, and people adopted the name of the clan rather than using an hereditary surname. Even when surnames are passed on through the fatherline the link between the Y-chromosome and the surname is often broken as a result of illegitimacy, cuckoldry, adoption or name changes. In addition, there is an inherent American bias in the commercial databases. Consequently Y-DNA matches will often tell us more about non-paternity events in Colonial America in the last 400 years, rather than a person’s origins in the British Isles. All these factors need to be taken into account when interpreting DNA results. 
The mutations that determine haplogroups (the deep-rooted branches of the human Y-DNA tree) did indeed occur at a specific time and place several thousand years ago, but determining when and where that happened is a different matter entirely. We are reliant on making inferences from the DNA of living people. However, the current distribution of haplogroups differs from each of the distributions at different times in the past. The changes occur due to migration and the randomness of genetic drift. As more ancient DNA samples become available it might one day be possible to provide some answers, but we are not there yet and it is unlikely that we will ever be able to "precisely reconstruct our ancestral journey". 
Readers wishing to understand more about the legitimate uses of DNA testing for genealogy and the limited inferences that can be made from deep ancestry tests might like to refer to the new “Debunking genetic astrology” website that I have worked on with my colleagues at University College London: www.ucl.ac.uk/mace-lab/debunking. In particular readers might like to look at the page on dubious commercial claims (www.ucl.ac.uk/mace-lab/debunking/companies) where the genetic homeland stories are discussed in greater detail.
The editor also included in the August issue of Family Tree Magazine responses to my letter from Vladimir Makarov of Prosapia Genetics and Tyrone Bowes, the creator of the Irish, Scottish and English Origenes websites. Unfortunately, neither letter addressed any of the issues I'd raised. Vladimir Makarov argued that his reports do reflect ancient origins simply because the reference populations he uses are "totally agnostic of political boundaries". He failed to recognise that these reference populations are themselves possibly admixed and do not necessarily represent the population in the same location one thousand years ago. Tyrone Bowes went into great detail about a case report that he'd compiled for a Mr Valentine which purported to show a link with the McGregors. It seems that his entire dating method has been based on this single case. Numerous scientific studies have of course demonstrated that mutations occur at random, and any attempt to investigate the validity of matches must take into account the uncertainties in the TMRCA (time to the most recent common ancestor) calculations. My points about differing times of surname adoption and non-paternity events remained unanswered.

For further information about Prosapia Genetics and the case reports offered by the Irish, Scottish and English Origenes websites see my two earlier blog posts:

- Driving in the wrong direction with a dodgy DNA satnav (a critique of the test from Prosapia Genetics)
- A look at the genetic homeland case reports from English Origenes, Irish Origenes and Scottish Origenes


© 2014 Debbie Kennett

Saturday, 3 May 2014

Driving in the wrong direction with a dodgy DNA satnav

I've been receiving a lot of questions in the last couple of days about the new DNA "satnav" tool called GPS (Geographic Population Structure) which purports to pinpoint the village that your ancestors lived in one thousand years ago. See, for example, the articles in the Daily Mail and the Washington Post. There was also some prominent and uncritical coverage on BBC Breakfast News on Thursday featuring a segment in which the BBC weather presenter Carol Kirkwood was given the results of her DNA test on air and told that her ancestors were from the town of Crieff in Scotland. As Chris Jiggins has pointed out on Twitter the acronym GPS seems to have been chosen deliberately to "promote a completely false sense of accuracy".  

The company which is offering this service is a new start up by the name of Prosapia Genetics, which has been set up by Tatiana Tatarinova from the Children's Hospital Los Angeles. The company proudly proclaim on their website: "Our first tool, GPS, will tell you where your DNA was forged, and is accurate to home village with a time resolution of the past 1,000 years."

The reports are based on an analysis of autosomal SNPs. You can either order a test through Prosapia Genetics, who appear to have an affiliate relationship with Family Tree DNA, or you can submit your raw data file from a test you've already taken with one of the companies that offers autosomal DNA testing - AncestryDNA (US only),  23andMe, Family Tree DNA, Geno 2.0 or BritainsDNA/ScotlandsDNA. A range of reports is offered with prices varying depending on the number of reference populations used for the analysis. The reports simply give you a set of geographical co-ordinates, which are supposed to represent the "ancient home" of all of your ancestors, and a map showing where your ancestors lived. We are now getting feedback from a number of people who've paid for this service and it would appear, not surprisingly, that the reality does not match the hype.

Julie Matthews bought the Basic Test, which covers 100 reference populations. She commented in the Facebook R1b-L21 group:
I spent $29 to discover that my "homeland" was in the middle of the River Humber in England. I knew we all descended from fish - here's proof. Don't waste your money!
Teresa Vega paid for the Super Test, which includes 500 reference populations. She writes in the ISOGG Facebook group:
Totally unconvincing. Stupid me paid $42.99 for nada! My ancestral home is smack dab west of Puerto Rico in the Atlantic Ocean! I learned nothing and it told me to upgrade to another test for more detailed results -- a test they don't even have listed! Don't believe the hype!!!!
Teresa's report can be seen online here.

JoAnn O'Linger had a similarly misleading result. She reports in the ISOGG Facebook group:
I had a similarly disappointing result from Prosapia (paid for), it was the "Super Test" as well: 
" JoAnn ordered a Super GPS Test of her DNA data. We found the following GPS Co-ordinates : Latitude 56.7811288256845 and Longitude 4.26921663910535 
A map pointing the location is given below with a short guide on how to interpret this results.
How to interpret your results? 
GPS coordinates indicate the place where your DNA was forged before your family may have moved to your current location. Because borders changed throughout history, your ancestors may have been part of an ancient country once ruled the region. If your GPS coordinates are in the water, it indicates mixture between two populations on the two ends of the body of water, in which case we suggest you register to the upcoming GPS2 tool that would provide you with the origins of your parents. If you wish to learn more about your past, we suggest you try the Advanced test or the Super test, which provide much higher accuracy." 
JoAnn says: "Those coordinates are squarely in the North Sea, which does make sense as I am the typical American mutt, with mostly Irish and English heritage, but if one goes further back, much of that is from Norman French and Gaelic-Norse Orcadians. So it makes sense, but in my opinion it's not worth the high price."
Prosapia Genetics have a Forum where you can read the comments from their customers, many of whom have expressed similar disappointment at the service offered:

http://prosapiagenetics.com/community/viewforum.php?f=2

[Update 10th May 2014 The Prosapia Genetics Forum is now restricted to members only. I am told that complaints and negative comments have been deleted and comments are being moderated.]

This is not surprising as the whole concept of the test is fundamentally flawed. If we assume 30 years per generation and we go back 35 generations to the year 1050 theoretically we will have 34,359,738,367 ancestors. This figure does of course exceed the population of the world at that time and in reality there will be lots of pedigree collapse which will reduce the number of ancestors considerably. Even so, the mind-boggling figures demonstrate that it is quite meaningless to try and pinpoint a single geographical location as the origin of all those diverse ancestors one thousand years ago. Furthermore, we only inherit the DNA of a tiny subset of our ancestors. To understand why this is the case read Luke Jostin's blog post "How many ancestors share our DNA" and the posts from Graham Coop and Blaine Bettinger that are linked in that article.

Even if it were possible to pinpoint a single location to represent our millions of ancestors from a thousand years ago, we would need accurate "maps" in the form of carefully sampled reference populations in order to be able to use our DNA satnav. Unfortunately, we only have a limited number of reference populations available, many of which have been sampled for medical purposes with no attempt made to collect the relevant "co-ordinates" in the form of  detailed genealogical information. Consequently, any maps included in a reference genome "satnav" are going to have massive black holes. It is therefore not surprising that this DNA satnav is misdirecting people into rivers and oceans!

The methodology behind the GPS tool was outlined in a paper by Elhaik et al entitled Geographic population structure analysis of worldwide human populations infers their biogeographical origins. The paper was published in the scientific journal Nature Communications. Despite the fact that the Prosapia Genetics website appears to have been launched on the same day that the paper was published Tatiana Tatarinova, the founder of the Prosapia Genetics website and one of the lead authors, has not declared any "competing financial interests". The paper has already been the subject of controversy. The technique described in the paper offers nothing new and it is claimed that the methodology has been copied from that used by the blogger Dienekes Pontikos, who writes under a pseudonym. For background see Dienekes' two blog posts on the subject:

- Nature Communications, the Genographic Project, Elhaik et al. re-discover zombies, the Oracle, etc. 3 years after the fact...
- The Geographic Position Structure (GPS) algorithm of Elhaik et al. (2014) is basically wrong

See in particular the comments section of the first of the above two posts where Eran Elhaik attempts to defend the charge of plagiarism.

Joe Pickrell, one of the reviewers of the paper, has posted a summary of his critique which is well worth a read. The review can be found here:

http://jkplab.org/2014/04/30/review-geographic-population-structure-gps-of-worldwide-human-populations-infers-biogeographical-origin/

The authors themselves concede in the paper that the technique has its limitations and will only work if "the appropriate samples are available in the reference population data set". They appear to have cherry-picked some conveniently isolated populations such as the Sardinians for the purposes of their study, but the technique did not work for other populations:
To test GPS’s accuracy with individuals from populations that were not included in the reference population set, we conducted two analyses. We first repeated the previous analysis using the leave-one-out procedure at the population level. As expected, GPS accuracy decreased with 50% of worldwide individuals predicted to be 450 km away from their true origin. The predicted distance increased to 1,100 and 1,750 km for 80 and 90% of the individuals, respectively (Fig. 4a). Because GPS best localizes individuals surrounded by M genetically related populations, populations from island nations (for example, Japan and United Kingdom) or populations whose most related populations were under-represented in our reference population data set (for example, Peru and Russia) were most poorly predicted. Consequently, the median distances to the true origin were much smaller for individuals residing in Europe (250 km), Africa (300 km) and Asia (450 km) due to their being more commonly represented in the reference population data set compared with Native Americans and Oceanians. These results represent the upper limit of GPS’s accuracy when the specific population of the test individual is absent from the reference population data set.
A hyped up press release was issued by the University of Sheffield which also includes a link to a video on YouTube. As is often the case, the media have picked up on the hype in the press release and have made no attempt to read the scientific paper and understand the limitations of the methodology. I hope that there have not been too many people who have paid out good money for these misleading DNA satnav reports.

Note that if you've taken a test with one of the genetic genealogy companies there are many free services that you can use to get an alternative reading of your data and a prediction of your "ethnicity", all of which will give much better results than the commercial offerings from Prosapia. One of the best free websites is GedMatch which allows you to get readings from a wide range of different services. You can find a full list of services in the ISOGG Wiki article on admixture analyses. However, it is still very difficult to distinguish between populations at anything more than the Continental level, and all such reports should be treated with a very large pinch of salt.

Update 6 May 2014
Teresa Vega now tells me that she has received a full refund for her test from PayPal. She told PayPal that she had felt misled by the company's claims and she was unhappy that they had recommended upgrading to a test that they did not even have on their site. JoAnn O'Linger is now also in the process of applying for a refund.

Update 3rd September 2014
Although the Prosapia Genetics domain name was originally registered to Dr Tatiana Tatarinova, it was subsequently transferred to Vladimir Makarov.

Update 30th May 2015
In April 2015 Dr Eran Elhaik gave a presentation at Who Do You Think You Are? Live on the subject of "Reaching the Holy Grail in genetic genealogy: from genome to home village". For further details see the summary on the DNA sat nav page on the UCL website. In particular do listen to the recording of the exchange in the Q&A session between Eran Elhaik and Professor Mark Thomas.

Update 16th July 2016
A new paper by Pavel Flegontov, Alexei Kassian, Mark G. Thomas, Valentina Fedchenko, Piya Changmai and George Starostin "Pitfalls of the geographic population structure (GPS) approach applied to human genetic history: a case study of Ashkenazi Jews" provides a critique of the GPS methodology used for the Prosapia Genetics test with specific reference to its application to infer the origins of the Yiddish language.

Update 31st October 2016
A corrigendum to the Elhaik et al 2014 paper on geographic population structure has been published by Nature Communications. It contains a conflict of interests statement from the authors. The statement includes an acknowledgement that one of the authors (Tatiana Tatarinova) has a link with Prosapia Genetics.

Acknowledgements
Many thanks to Julie Matthews, JoAnn O'Linger and Teresa Vega for permission to use their quotes and reports.

Related blog posts
- My letter in Family Tree Magazine about "genetic homeland" stories

See also
Since writing this article I have discovered other discussions on the subject. I have posted the relevant links below and will update the list if further links become available:
- Prosapia Genetics - Worth the money? A review by Lorine McGinnis Schulze
- Researchers develop DNA GPS tool to accurately trace geographical ancestry -  a discussion on the Reddit forum
- Is GPS DNA tracking too good to be true? An article by Peter Calver in the Lost Cousins newsletter, May 2014
- So many genes, so close to home by Matthew Thomas, BioNews, 12 May 2014.
- Ancestral home pinpointed by DNA by Julie Lutter, Family History Research by Jodi, 13 May 2014.

© 2014-2016 Debbie Kennett