EFY Times  
Tuesday, April 28, 2015

 
GO
 
 

Viewing The World Through The Eyes Of Wikipedia
 
Home >> Infotech >> Trends
 
Viewing The World Through The Eyes Of Wikipedia  
 
   
Rate this news:  (0 Votes)
Thursday, June 21, 2012 SGI (NASDAQ: SGI), the trusted leader in technical computing has partnered with Kalev H. Leetaru of the University of Illinois to create the first-ever historical mapping and exploration of the full text contents of the English-language edition of Wikipedia, in time and space. The results include visualizations of modern history captured in under a day utilizing in-memory data-mining techniques. Loading the entire English language edition of Wikipedia into SGI® UV™ 2000, Mr. Leetaru was able to show how Wikipedia’s view of the world unfolded over the past two centuries. Location, year and the positive or negative sentiment have been tied to those references.






While several previous projects have mapped Wikipedia entries with manually assigned location metadata by an editor, these previous attempts only accounted for a tiny fraction of Wikipedia’s location information. This project unlocked the contents of the articles themselves, identifying every location and date in all four million pages and the connections among them to create a massive network.

“Seeing” Wikipedia in a brand new way

“This analysis allows the world to take a step back from the individual articles and text to gain a forest view of the tremendous knowledge captured in Wikipedia, not just a page by page tree view. We can watch how one of the largest collections of human knowledge has evolved and see what we could never see before, such as global sentiment at a certain time and place, or where there might be blind spots in the knowledge coverage, ” said Franz Aman, chief marketing officer and head of strategy, SGI. “We love to use Google Earth because we can zoom out and get the big picture view. With SGI UV 2, we can apply the same concept to Big Data to get the big picture on our Big Data.”

From this analysis, Wikipedia is seen to have four periods of growth in its historical coverage: 1001-1500 (Middle Ages), 1501-1729 (Early Modern Period), 1730-2003 (Age of Enlightenment), 2004-2011 (Wikipedia Era) and its continued growth appears to be focused on enhancing its coverage of historical events, rather than increased documenting of the present. The average tone of Wikipedia’s coverage of each year closely matches major global events, with the most negative period in the last 1,000 years being the American Civil War, followed by World War II. The analysis also shows that the “copyright gap” that blanks out most of the twentieth century in digitized print collections is not a problem with Wikipedia where there is steady exponential growth in its coverage from 1924 to today.

Enabling researchers to data-mine Big Data at the speed of Big Data

“The one-way nature of connections in Wikipedia, the lack of links, and the uneven distribution of Infoboxes, all point to the limitations of metadata-based data mining of collections like Wikipedia,” said Mr. Leetaru. “With SGI UV 2, the large shared memory available allowed me to ask questions of the entire dataset in near-real time. With a huge amount of cache-coherent shared memory at my fingertips, I could simply write a few lines of code and run it across the entire dataset, asking whatever questions came to mind. This isn’t possible with a scale-out computing approach. It’s very similar to using a word processor instead of using a typewriter – I can conduct my research in a completely different way, focusing on the outcomes, not the algorithms.”

The analytical approach

Loaded into SGI® UV™ 2000, the Big Brain computer, this massive dataset underwent full text geocoding and complete date-coding, using algorithms that identified every mention of every location and every date across the text of every entry on Wikipedia. More than 80 million locations and 42 million dates between 1000 AD and 2012 were extracted, averaging 19 locations and 11 dates per article (every 44 words and every 75 words, respectively). The connections between every date and every location were captured into a massive network representing Wikipedia’s view of history. With this instrumentation, Mr. Leetaru was able to perform near-real time analysis over the entire dataset on the SGI UV 2 to create visual maps throughout space and time to see not only how history unfolded but also the overall tone of the world throughout the last thousand years, and interactively testing a wide array of theories and research questions, all in less than a day’s work.

The New SGI UV: The Big Brain computer

SGI UV 2 product family enables users to find answers to the world’s most difficult problems on a system as easy to administer as a workstation. Built with Intel® Xeon® processor E5 family, running standard Linux, and supporting a wide range of storage options, SGI UV 2 offers a complete, industry-standard solution for no-limit computing.

With as little as 16 cores and 32 gigabytes of memory, SGI UV 2 can start small and seamlessly expand. This next generation platform doubles the number of cores (up to 4096 cores) and quadruples the amount of coherent main memory (up to 64 terabytes) from the previous generation, available for in-memory computing in a single-image system. SGI UV 2 can scale to eight petabytes of shared memory and at a peak I/O rate of four terabytes per second (14 PB/hour) it could ingest the entire contents of the U.S. Library of Congress print collection in less than three seconds.

SGI UV 2000 is available immediately. SGI UV 20 can be ordered today and will start shipping in August 2012. Pricing starts at $30,000 USD.



Print Email Post Comment 
(Total Views: 834)
 
Share

 
 
Infotech News
   
Adarsh Credit Co-Operative Society Implemented First Full-Fledged SAP Financial Services Suite In India To Strengthen Their Customer Engagement
AuraPortal iBPMS Helium Uses Its ERM Solution To Coordinate Supply Chain Processes
Store More Files With The HP x755w USB 3.0 Flash Drive
HP Unveils Software Innovations To Help Businesses Win In The Mobile App Economy
Swiss Made Rugged Embedded Computer With Integrated PoE
 
 
 
     
     
     
     
     
     
Most popular
 

Daily

China's Android-Based LED Projectors Unlocks Market Potential: Chinavasion
TransPortal Demonstrates Latest Products And Services To Improve Orthopaedic Documentation At AAOE Annual Conference
Surry County Register Of Deeds Implements Simplifile E-Recording
Allied Telesis Selects Kaspersky Lab To Provide Advanced Threat Protection For New Range Of Next-Generation Firewalls
BigRock Announces Winners For Its ‘being.desi’ Campaign
Gartner Says India Devices Shipments To Grow 4.5 Per Cent In 2015
XMS Penvision Announces Immediate Availability Of Sign@ And Sign@Work Signature Verification To Its Formidable Digital Writing Platform
EVERLIGHT Successfully Defeated Nichia's White LED Patents
Swiss Made Rugged Embedded Computer With Integrated PoE
Spice Mobiles Launches Its First 4G LTE Smartphone – Stellar 519
 
   

Weekly

European Union Delegation To Organize Media Seminar #DIGILOGUE2015 On 27 April
India Ranked Second In Cyber Crimes Through Social Media
Storage Switzerland Test Drive Demonstrates Transporter’s Private Cloud Storage Efficiency Over Public Cloud Solutions Such As Dropbox
The Meeco Group Completes Installation Of 20KW Solar Project In Gurgaon
Stratasys Opens Maiden 3D Printing Experience Centre In India
Akitio Unveils The Thunder2 Quad Mini 12 TB Thunderbolt 2 SSD Storage Solution
Hackers Or Google Maps Developers: Who Made The Android Bot Pee On An Apple Logo?
Whatsapp To Become Largest Communication Service; Crosses 800 Million Users
Asus Zenphone 2 Claims To Be The World’s First Smartphone Range With 4GB RAM
After Facebook Changed News Feed, Twitter Launches ‘Highlights’
Microsoft Launches Outlook For Android; App Now Available For Download
Twitter’s Quality Feature To Remove Threats From The Timeline
Microsoft To Bring Office Apps To Phones In A 'Universal' Avatar
Facebook Launches Caller ID App ‘Hello’ For Android
Intex Unveils Cloud M6 Smartphone
Lenovo Introduces A5000, The Latest In Its A-Series Of Smartphones
 
   

Overall

Features
5 Rules To Ensure Proper Programming Style
Here are some of the best rules that help you in attaining a better programming style....
Key Rules To Build A Great Tech Team
Making IT work in any organisation is about making human connections. Here's how you can do it....
6 Best Code Editors For Realtime Collaboration
Here is the compiled list of 6 Best Code Editors for Real Time Collaboration....
Top 10 Most Expensive Gadgets In The World
Here are top 10 gadgets made for super-rich people in the world...
7 Things To Do After Buying New iPhone
Bought a new iPhone? Here are 7 things you need to do right away...
8 Gadgets To Make Your Smartphone Even Smarter!
Check out these 8 cool gadgets that will make your smartphone smarter...
10 Must Have Google Chrome Apps
Install these Chrome extension apps to boost your work productivity...
Top 6 Octa-Core Android Phones Under Rs 10,000/-
Here is the list of best 6 super-fast Android phones you can buy under Rs 10,000/-...
6 Qualities That Can Help You Achieve Happiness
Here are 6 qualities that you can incorporate in life to find the greater happiness....
Top 10 Frequently Asked SQL Query Interview Questions
Here are 10 frequently asked SQL interview questions and answers that can help you crack the interview....
8 Best Alternatives To Bootstrap
Boostrap is used by many web developers out there. If you are looking for some innovative alternative to Bootstrap. Here is the list of 8 best options...
8 Tech Companies You Didn't Know You Use Everyday!
You may not have heard the names of following tech companies but, you use their product and services in daily life through your favorite app....
Top 8 PHP Libraries For Developers
Here is the list of best PHP libraries for web developers and programmers...
3 Successes And 3 Failures Of Microsoft
Microsoft has seen many triumphs and failures. Here are top 3 successes and 3 failures in company's 40 year journey....
Top 8 Most Expensive Smartphones In India
Ever wondered about the most expensive smartphones available in India? Here is the list of luxury smartphones...
 
  View All
Dialogue
 
“One Day The End User Can Open Up A Used Battery, And Use What’s Inside As Barbecue Sauce”
Of course that is not something currently possible, but what B&B Batteries does have are some secret recipes for their very specialised battery design...
We Wish To Procure All The LED Components Within India: Avni Energy
G. Gururaja, director, Avni Energy Solutions Pvt Ltd, shares his views about the expanding LED industry in the Indian market and the company's plans i...
We Have Registered 50 Per Cent Growth In The Last Two Years: Arihant Lighting
Apart from LEDs, Arihant is associated with the promotion of renewable energy in India and therefore, manufactures various energy saving products....
“Elcom Plans To Build A New State Of The Art R&D And Manufacturing Unit In Maharashtra", Reveals MD Girish V Vaze
Starting out as a small business to cater to the industry’s need for import substitutes, Elcom International has grown to be a leader in the field of ...
Delta Magnets Ltd To Enter Into JV With Chinese Company!
The company had partnered with TDK Japan for technology transfer to manufacture magnets in India....
   
  View All
Videos
 
First Look: LG Optimus G
The phone sports a high-end display and comes powered by a powerful processor. ...
Create QR-Codes For Free
TEC-IT releases the freeware QR-Code Studio to provide a quick and convenient way of QR code creation for every application scenario....
DoT Secretary Shares Plans For Growth Of Telecom Sector
M.F. Farooqui has recently taken charge as secretary, Department of Telecom....
Hands-On: Sony Xperia Z
Xperia Z is Sony's first entrant model in the big-screen smartphone category. ...
Hands On: Videocon A30 Smartphone
Videocon, the consumer electronics company which is known for its refrigerators, washing machine and air-conditioner has unveiled its Android-based sm...
   
View All
   
 
IFA 2014
 
IFA 2014: LG Launches 34-Inches Curved Monitor
The company is yet to confirm price and availability of the device....
IFA 2014: Intel Launches First Core M Range Of Processors
This range of processors is tailor-made for 2-in-1 devices which include a tablet and a laptop....
MWC 2014: Tablet Lets People Feel Textures On Its Screen
Now feel what you see on your tablet, by way of ultrasonic waves....
MWC 2014: 4K Android Tablet Games To Kill Consoles, iPad
Tablet makers like Samsung want to beat the iPad by making 4K tabs. ...
MWC 2014: This Vodafone Backpack Helps Get Network In Disaster Situations
Two engineers of Vodafone New Zealand displayed the "mini" mobile network by Vodafone substructure in a backpack. ...
MWC 2014: Wilocity Chipset To Bring 'Lightening' Speed To Mobile Phones
Wilocity has developed a WiGig chipset for mobile phones that will bring lightning-fast wireless capability ...
MWC 2014: Samsung Introduces Octacore, Hexacore Chipsets
The Korean giant, Samsung unveiled two new octacore and hexacore chipsets at MWC 2014, in Barcelona. The company previously used Exynos 5 Octa 5410 ch...
   
View All
   
 
Events
 
19th Consumer Electronic Imaging Fair To Be Held On ...

View All
   
   
 
 

home archives contact us advertise with us
           
Magazines Portals Directories Events News Verticals Educational Institute  
Electronics for You
Open Source for You
Electronics Bazaar
electronicsforu.com
efytimes.com
opensourceforu.com
electronicsb2b.com
Electronics Annual Guide
EFY EXPO INDIA
EFY EXPO WEST
ELECTRONICS ROCKS
EFY Awards
OSIDAYS Expo
Electronics
Infotech
Linux & Open Source
Consumer Electronics
Science & Technology
BPO
EFY Techcenter

Educational Kits
Kitsnspares.com  
 
 
© Copyright 2015 EFY Enterprises Pvt. Ltd.
All rights reserved. Reproduction in whole or in part in any form or medium without written permission is prohibited.
Usage of the content from the web site is subject to Terms and Conditions