This article is from the source 'guardian' and was first published or seen on . It last changed over 40 days ago and won't be checked again for changes.
You can find the current article at its original source at http://www.guardian.co.uk/news/datablog/2013/apr/12/gdelt-global-database-events-location
The article has changed 2 times. There is an RSS feed of changes available.
Previous version
1
Next version
| Version 0 | Version 1 |
|---|---|
| GDELT: a big data history of life, the universe and everything | GDELT: a big data history of life, the universe and everything |
| (6 months later) | |
| Everybody is searching for bigger and bigger data: how about this? A comprehensive list of every event in human history. | Everybody is searching for bigger and bigger data: how about this? A comprehensive list of every event in human history. |
| It matters because historians have long feared that we live in a digital dark ages - where our history will have vanished when future generations try to look back on these electronic decades. | It matters because historians have long feared that we live in a digital dark ages - where our history will have vanished when future generations try to look back on these electronic decades. |
| That is the purpose of GDELT: Global Data on Events, Location and Tone. Primarily set up by Kalev Leetaru at the University of Illinois it is literally a giant list: over 250m events in over 300 categories from riots and protests to diplomatic exchanges and peace appeals. Crucially, it contains latitude and longitude for every event - all of them are now geotagged to city level. | That is the purpose of GDELT: Global Data on Events, Location and Tone. Primarily set up by Kalev Leetaru at the University of Illinois it is literally a giant list: over 250m events in over 300 categories from riots and protests to diplomatic exchanges and peace appeals. Crucially, it contains latitude and longitude for every event - all of them are now geotagged to city level. |
| It's based on an impressive rosta of news media: AfricaNews, Agence France Presse, Associated Press Online, Associated Press Worldstream, BBC Monitoring, Christian Science Monitor, Facts on File, Foreign Broadcast Information Service, United Press International, and the Washington Post. They include "all national and international news coverage from the New York Times, all international and major US national stories from the Associated Press, and all national and international news from Google News with the exception of sports, entertainment, and strictly economic news." | It's based on an impressive rosta of news media: AfricaNews, Agence France Presse, Associated Press Online, Associated Press Worldstream, BBC Monitoring, Christian Science Monitor, Facts on File, Foreign Broadcast Information Service, United Press International, and the Washington Post. They include "all national and international news coverage from the New York Times, all international and major US national stories from the Associated Press, and all national and international news from Google News with the exception of sports, entertainment, and strictly economic news." |
| And while it only goes back to 1979 now, eventually it will include all events back to 1800. | And while it only goes back to 1979 now, eventually it will include all events back to 1800. |
| Launched only recently, it's been used a PhD Jay Yonamine to predict violence in Afghanistan. He says that | Launched only recently, it's been used a PhD Jay Yonamine to predict violence in Afghanistan. He says that |
| From a forecasting perspective, the benefits of a machine-coded dataset updated in (near) real-time that provides specific latitude-longitude coordinates are numerous. | From a forecasting perspective, the benefits of a machine-coded dataset updated in (near) real-time that provides specific latitude-longitude coordinates are numerous. |
| Interestingly, his paper points out that the news media probably does as good a job as official - but classified - data like Wikileaks when it comes to mapping that conflict. | Interestingly, his paper points out that the news media probably does as good a job as official - but classified - data like Wikileaks when it comes to mapping that conflict. |
| The categories the team use could themselves be the subject of a dissertation: a 300-strong taxonomy, CAMEO, developed by Penn State's Philip A. Schrodt. | The categories the team use could themselves be the subject of a dissertation: a 300-strong taxonomy, CAMEO, developed by Penn State's Philip A. Schrodt. |
| Says Kalev Leetaru (and his paper is worth reading too) | Says Kalev Leetaru (and his paper is worth reading too) |
The goal of the project is to create a free and open global resource for the quantitative study and mapping of global conflict and cooperation and thus the data is being made available completely free and open for any use. | The goal of the project is to create a free and open global resource for the quantitative study and mapping of global conflict and cooperation and thus the data is being made available completely free and open for any use. |
| You can read more on this from Foreign Policy | You can read more on this from Foreign Policy |
| It's a truly impressive project: and a power tool for anyone interested in data journalism too. Imagine being able to map every military action in Iraq in a moment, or provide a detailed verified guide to the Arab Spring? This would be a good place to start | It's a truly impressive project: and a power tool for anyone interested in data journalism too. Imagine being able to map every military action in Iraq in a moment, or provide a detailed verified guide to the Arab Spring? This would be a good place to start |
| NEW! Buy our book | NEW! Buy our book |
| • Facts are Sacred: the power of data | • Facts are Sacred: the power of data |
| More open data | More open data |
| Data journalism and data visualisations from the Guardian | Data journalism and data visualisations from the Guardian |
| World government data | World government data |
| • Search the world's government data with our gateway | • Search the world's government data with our gateway |
| Development and aid data | Development and aid data |
| • Search the world's global development data with our gateway | • Search the world's global development data with our gateway |
| Can you do something with this data? | Can you do something with this data? |
| • Flickr Please post your visualisations and mash-ups on our Flickr group • Contact us at data@guardian.co.uk | • Flickr Please post your visualisations and mash-ups on our Flickr group • Contact us at data@guardian.co.uk |
| • Get the A-Z of data • More at the Datastore directory • Follow us on Twitter • Like us on Facebook | • Get the A-Z of data • More at the Datastore directory • Follow us on Twitter • Like us on Facebook |
| Our editors' picks for the day's top news and commentary delivered to your inbox each morning. |
Previous version
1
Next version