Solving IO Bottlenecks in Big Data Analytics

Big Data challenges and what some of the most data intensive agencies are doing to address it. Topics discussed include:

How agencies are dealing with unprecedented amounts of data creation and performance requirements;

How data-driven enterprises are looking at new methods of metadata management to contextualize their assets and gain a richer understanding of their data;

How cloud tools and infrastructure enable new opportunities to share, collaborate and accelerate decision making across agencies and geographies;

Higher education institutions around the world are in the process of digitizing, indexing and adding searchable metadata to their digital collections. As these data sets expand to hundreds of millions of immutable objects and petabytes of data, there is a need to consolidate and automate to maximize the value of this capital expenditure.

The Integrated Rule-Oriented Data System (iRODS) is a popular open source policy-based data management system (application) that enables data sharing, publication and preservation and is also capable of implementing an automated data analysis pipeline. For each type of data management application, policies or rules can be applied that control the execution of procedures that enforce desired collection properties. By evolving the policies, a collection can migrate through the stages of the data life cycle.

DataDirect Networks - Storage Fusion Architecture is a highly scalable storage platform capable of hosting iRODS in a tightly coupled solution with a RAID controller and parallel file system providing an appliance like solution that can scale to multiple-petabytes in a single name space.

For large storage systems, the massively parallel open source file system Lustre provides an incredible level of performance, flexibility and scalability. It’s a tested and proved technology that it is currently used by over 60% of the TOP100 supercomputing sites in the world. More high-end systems are coming online all the time.

However, in practice, Lustre’s known for being a little “hard to use.”

Interested in the advantages of this powerful filesystem but concerned about day-to-day administration issues? Looking to evaluate the technology but need answers to better evaluate? This one-hour webinar will cover a wide range of issues, but is intended to be open to your questions. What items should you monitor in a Lustre system daily? How do you configure user quotas? How do you automate failover with heartbeat? How do you restore Lustre from file based backups? What are some good tips for tuning Lustre specifically to your environment?

Whamcloud provides support and training services and lives and breathes Lustre. Whamcloud partners with DataDirect Networks to provide solutions that fix the headaches associated with Lustre administration. Come and find out core tips and tricks in building a rock solid Lustre environment that will work specifically for you and your storage environment.

This webinar will be led by Zhiqi Tao, Senior System Engineer at Whamcloud, now owned by Intel, and Dr. James Coomer, DDN’s Senior Technical Advisor for EMEA. Thirty minutes will be spent offering some key tips and trick for Lustre administrators. The session will then be opened up to the audience for 30 minutes for questions.

Join DDN experts to see how organizations are leveraging developments in storage infrastructure to extract the greatest possible value from their data. Material covered will include general architectural concepts on building storage infrastructure for big data analytics, as well as a detailed discussion of real world applications and benchmarking results with SAS and Vertica platforms. Specifics on the impact to data ingest speed, query performance, flexibility, ease of management and overall scalability will also be covered.

This webinar will explore methods for minimizing latency and accelerating Big Data processing, analytics, and distribution using high performance, InfiniBand-connected storage systems, specifically in web scale data centers. We will review the network and system factors influencing performance today, and present storage and interconnect solutions that minimize process latencies, decrease time to results and increase ROI for Big Data applications.

Please join Mellanox and DDN for this educational webinar to learn about the concepts, challenges and performance options for Big Data analytics applications.

In this webinar you'll learn how DDN's new DirectMon management software enables a comprehensive "single pane of glass" approach to centralized management and monitoring of DDN storage products.

Join DDN, FilmPartners, and Broadcast Engineering for an in-depth discussion on the Unified Workflow solution created by tightly integrating DDN's xSTREAMscaler and MXFserver 5.0. With experts from FilmPartners and DDN, moderated by Michael Grotticelli of Broadcast Engineering you will not want to miss this webinar as we go over all the details, take questions from the audience and show examples of real-world success.

Significant products, technology and services that were showcased at NAB 2012 are reviewed.

Join DDN, FilmPartners, and Broadcast Engineering for an in-depth discussion on the Unified Workflow solution created by tightly integrating DDN’s xSTREAMscaler and MXFserver 5.0. With experts from FilmPartners and DDN, moderated by Michael Grotticelli of Broadcast Engineering you will not want to miss this webinar as we go over all the details, take questions from the audience and show examples of real-world success.

Learn in this webinar how DDN has raised the performance bar (again) in announcing the SFA 12K(TM) series of scalable storage platforms. The SFA12K product family is a series of systems which have been designed from the ground-up for the next wave of data creation, distribution and processing. With this offering, DDN has established a clear leadership along a number of key dimensions
Big Data Innovation We're now delivering the features that our competitors only dream of having, including our In-Storage Processing™ and Storage Fusion Fabric™. These solutions not only greatly simplify big data storage environments, but also enable applications to excel.

Performance The SFA12K is 2.7 times faster than it's next-closest competitor... and oh by the way, that's our own SFA10K-X. The system is up to 800% faster than competing systems.

Data Center Efficiency The SFA12K can reduce data center requirements and is astonishingly 240% more efficient than competing scale out technology

Engineered Scalability With a focus on managing large scale systems, technologies such as DDN's SATAssure™, ReACT™ and new Quality of Service serve as validation of the ~1M lines of code we've built into our platform that makes managing large data sets easiest with the SFA

Content is exploding, and DDN is hiring. Learn why the leader in scalable storage is changing the technology landscape, and how you can be a part of it.

From the Cloud Computing Conference at NAB 2012, Jean-Luc Chatelain describes how Creators can leverage cloud computing for improving and accelerating content creation. Listen and learn why "Cloud is the New Black".

This webinar will cover highlights of the Lustre roadmap and areas of interest on the business side of the equation. What can managers and technology buyers expect from Lustre? Should you upgrade to Lustre 2.2? What news will come out of the Lustre Users Group (April 23-25)? What are the opportunities for using Lustre in commercial HPC markets moving forward? Bring your toughest Lustre questions - a Q&A session with leading Lustre experts will follow the presentations.

Learn how NOAA accelerates their research by using storage from DataDirect Networks. NOAA's research helps keep citizens informed of the changing environment around them from the surface of the sun to the depths of the ocean floor.

“Legal Concerns & Practical Solutions for Media in the Cloud,” a webinar produced by DataDirect Networks in association with the DCIA and Dow Lohnes PLLC Attorneys At Law. This webinar will discuss the latest contractual, copyright, and fourth amendment consequences of using cloud based services. It will also cover possible private media cloud solutions that may help expedite the adoption of cloud storage and collaboration by Media and Entertainment companies.

Storage is a major factor in time to results for analytics workflows. In this webinar, Larry Jones from DataDirect Networks (DDN) will highlight STAC testing results that demonstrate the advantage of high performance storage.

Supercomputing is the biggest event of the year in High Performance Computing, and DataDirect Networks is one of the biggest forces present at SC'11. Hear about the latest products and technology directions from the leader in HPC storage, including the announcement of the SFA 12K product line.

Are you a "cloud builder?" This webinar is specifically for you - learn how scalability and performance challenges can be eliminated upfront by avoiding the pitfalls of using traditional storage for the unique needs of cloud implementation. DDN, the technology leader in cloud storage, will highlight how object storage is the optimal platform for building private and public clouds, as well as setting a path to Exascale computing by moving to a "NoFS" approach. Join DDN to discuss new approaches to cloud storage scalability, and become part of the dialogue around how to remove storage as the bottleneck in your cloud building efforts.

Silicon Angle's John Furrier interviews Jean-Luc Chatelain , DDN's EVP of Strategy and Technology. Jean-Luc highlights the unique role DDN has in enabling organizations to maximize the value of all information everywhere.