Harvard/MIT Student Creates GPU Database, Hacker-Style

[sl4shd0t]

First time accepted submitter IamIanB writes "Harvard Middle Eastern Studies student Todd Mostak's first tangle with big data didn't go well; trying to process and map 40 million geolocated tweets from the Arab Spring uprising took days. So while taking a database course across town at MIT, he developed a massively parallel database that uses GeForce Titan GPUs to do the data processing. The system sees 70x performance increases over CPU-based systems, and can out crunch a 1000 node MapReduce cluster, in some cases. All for around $5,000 worth of hardware. Mostak plans to release the system under an open source license; you can play with a data set of 125 million tweets hosted at Harvard's WorldMap and see the millisecond response time." I seem to recall a dedicated database query processor that worked by having a few hundred really small processors that was integrated with INGRES in the 80s. http://a.fsdn.com/sd/twitter_icon_large.png (http://twitter.com/home?status=Harvard%2FMIT+Student+Creates+GPU+Data base%2C+Hacker-Style%3A+http%3A%2F%2Fbit.ly%2F11G4OYU) http://a.fsdn.com/sd/facebook_icon_large.png (http://www.facebook.com/sharer.php?u=http%3A%2F%2Fsearch.slashdot.org%2Fst ory%2F13%2F04%2F22%2F2225240%2Fharvardmit-student-creates-gpu-database-hacker-style%3Futm_source%3Dslashdot%26utm_medium%3Dfaceb ook) http://www.gstatic.com/images/icons/gplus-16.png (http://plus.google.com/share?url=http://search.slashdot.org/story/13/04/22/2225240/harvardmit-student-creates-gpu-database-hacker-style?utm_source=slashdot&utm_medium=googleplus)

Read more of this story (http://search.slashdot.org/story/13/04/22/2225240/harvardmit-student-creates-gpu-database-hacker-style?utm_source=rss1.0moreanon&utm_medium=feed) at Slashdot.
http://slashdot.feedsportal.com/c/35028/f/647376/s/2b09732f/mf.gif

http://da.feedsportal.com/r/164016279927/u/49/f/647376/c/35028/s/2b09732f/a2.img (http://da.feedsportal.com/r/164016279927/u/49/f/647376/c/35028/s/2b09732f/a2.htm)http://pi.feedsportal.com/r/164016279927/u/49/f/647376/c/35028/s/2b09732f/a2t.imghttp://feeds.feedburner.com/~r/Slashdot/slashdotDevelopers/~4/U-G0m2_heYY

More... (http://rss.slashdot.org/~r/Slashdot/slashdotDevelopers/~3/U-G0m2_heYY/story01.htm)