Made In IBM Labs: New Architecture Can Double Analytics Processing Speed

Next-Generation Design Wins the Storage Challenge at Supercomputing 2010

ID: 1020192
recent pressrelease next pressrelease

(PresseBox) - 10 - At the Supercomputing 2010 conference, IBM (NYSE: IBM) today unveiled details of a new storage architecture design, created by IBM scientists, that will convert terabytes of pure information into actionable insights twice as fast (1) as previously possible. Ideally suited for cloud computing applications and data-intensive workloads such as digital media, data mining and financial analytics, this new architecture will shave hours off of complex computations without requiring heavy infrastructure investment.
Running analytics applications on extremely large data sets is becoming increasingly important, but organizations can only continue to increase the size of their storage facilities so much. As businesses search for ways to harness their large stored data to achieve new levels of business insight, they need alternative solutions like cloud computing to keep up with growing data requirements as well as tackling workload flexibility through the rapid provisioning of system resources for different types of workloads.
"Businesses are literally running into walls, unable to keep up with the vast amounts of data generated on a daily basis," said Prasenjit Sarkar, Master Inventor, Storage Analytics and Resiliency, IBM Research - Almaden. "We constantly research and develop the industry's most advanced storage technologies to solve the world's biggest data problems. This new way of storage partitioning is another step forward on this path as it gives businesses faster time-to-insight without concern for traditional storage limitations."
Created at IBM Research - Almaden, the new General Parallel File System-Shared Nothing Cluster (GPFS-SNC) architecture is designed to provide higher availability through advanced clustering technologies, dynamic file system management and advanced data replication techniques. By "sharing nothing," new levels of availability, performance and scaling are achievable. GPFS-SNC is a distributed computing architecture in which each node is self-sufficient; tasks are then divided up between these independent computers and no one waits on the other.


IBM's current GPFS technology offering is the core technology for IBM's High Performance Computing Systems, IBM's Information Archive, IBM Scale-Out NAS (SONAS), and the IBM Smart Business Compute Cloud. These research lab innovations enable future expansion of those offerings to further tackle tough big data problems.
For instance, large financial institutions run complex algorithms to analyze risk based on petabytes of data. With billions of files spread across multiple computing platforms and stored across the world, these mission-critical calculations require significant IT resource and cost because of their complexity. Using this GPFS-SNC design, running this complex analytics workload could become much more efficient, as the design provides a common file system and namespace across disparate computing platforms, streamlining the process and reducing disk space.
For more information about IBM Research, please visit www.ibm.com/research
(1) MapReduce Benchmarks on a 16-node cluster with 4 SATA disks per node comparing GPFS-SNC to HDFS



Keywords (optional):



Company information / Profile:

PressRelease by

Requests:



PressContact / Agency:



published by: PresseBox
print pressrelease  send to a friend  

Date: 11/19/2010 - 08:54
Language: English
News-ID 1020192
Character count: 0
Kontakt-Informationen:
Firma: IBM Deutschland GmbH
Ansprechpartner: Feedback to businesspress24.com about Pressrelease-id:
Stadt: New Orleans
Telefon:

Comments:



Number of hits: 170

Linking-Tips:



Direct Link to this PressRelease:






We would appreciate a link in your News-, Press- or Partner-Site.

Comments on this PressRelease






All members: 8 805
Register today: 0
Register yesterday: 1
Members online: 0
Guests online: 82


Don't have an account yet? You can create one. As registered user you have some advantages like theme manager, comments configuration and post comments with your name.