Scalable Storage

The ability to generate and capture various sensor data, communications, and imagery has grown exponentially, and there does not appear to be any change in sight. To effectively extract the maximum benefit from the deluge of data generated today, analysts need to utilize the new generation of analytical tools and human expertise that is rapidly being developed. When properly utilized, these advances are providing today’s analysts with an unprecedented ability to make real-time data-driven decisions as well as improved options to collaborate and share information. However, effective implementation in the era of hyperscale data depends on the ability to manage conventional system technology, and unpredictable volume requirements. An imbalanced analytics system can result in bottlenecks that reduce the value of analytics tools and the enterprise data warehouses (EDW) that power them. As such, it’s critical for organizations to ensure that at either end of the ingest/egest process they build scalable storage and storage processing technology to complement today’s high-speed data warehousing and data analytics technology. This session will detail how new filing system options and cloud infrastructure can improve the performance of analytics applications utilizing actual benchmark tests, and demonstrate new options to collaborate and share information.

Big Data challenges and what some of the most data intensive agencies are doing to address it. Topics discussed include:

How agencies are dealing with unprecedented amounts of data creation and performance requirements;

How data-driven enterprises are looking at new methods of metadata management to contextualize their assets and gain a richer understanding of their data;

How cloud tools and infrastructure enable new opportunities to share, collaborate and accelerate decision making across agencies and geographies;

Higher education institutions around the world are in the process of digitizing, indexing and adding searchable metadata to their digital collections. As these data sets expand to hundreds of millions of immutable objects and petabytes of data, there is a need to consolidate and automate to maximize the value of this capital expenditure.

The Integrated Rule-Oriented Data System (iRODS) is a popular open source policy-based data management system (application) that enables data sharing, publication and preservation and is also capable of implementing an automated data analysis pipeline. For each type of data management application, policies or rules can be applied that control the execution of procedures that enforce desired collection properties. By evolving the policies, a collection can migrate through the stages of the data life cycle.

DataDirect Networks - Storage Fusion Architecture is a highly scalable storage platform capable of hosting iRODS in a tightly coupled solution with a RAID controller and parallel file system providing an appliance like solution that can scale to multiple-petabytes in a single name space.

For large storage systems, the massively parallel open source file system Lustre provides an incredible level of performance, flexibility and scalability. It’s a tested and proved technology that it is currently used by over 60% of the TOP100 supercomputing sites in the world. More high-end systems are coming online all the time.

However, in practice, Lustre’s known for being a little “hard to use.”

Interested in the advantages of this powerful filesystem but concerned about day-to-day administration issues? Looking to evaluate the technology but need answers to better evaluate? This one-hour webinar will cover a wide range of issues, but is intended to be open to your questions. What items should you monitor in a Lustre system daily? How do you configure user quotas? How do you automate failover with heartbeat? How do you restore Lustre from file based backups? What are some good tips for tuning Lustre specifically to your environment?

Whamcloud provides support and training services and lives and breathes Lustre. Whamcloud partners with DataDirect Networks to provide solutions that fix the headaches associated with Lustre administration. Come and find out core tips and tricks in building a rock solid Lustre environment that will work specifically for you and your storage environment.

This webinar will be led by Zhiqi Tao, Senior System Engineer at Whamcloud, now owned by Intel, and Dr. James Coomer, DDN’s Senior Technical Advisor for EMEA. Thirty minutes will be spent offering some key tips and trick for Lustre administrators. The session will then be opened up to the audience for 30 minutes for questions.

Join DDN experts to see how organizations are leveraging developments in storage infrastructure to extract the greatest possible value from their data. Material covered will include general architectural concepts on building storage infrastructure for big data analytics, as well as a detailed discussion of real world applications and benchmarking results with SAS and Vertica platforms. Specifics on the impact to data ingest speed, query performance, flexibility, ease of management and overall scalability will also be covered.

This webinar will explore methods for minimizing latency and accelerating Big Data processing, analytics, and distribution using high performance, InfiniBand-connected storage systems, specifically in web scale data centers. We will review the network and system factors influencing performance today, and present storage and interconnect solutions that minimize process latencies, decrease time to results and increase ROI for Big Data applications.

Please join Mellanox and DDN for this educational webinar to learn about the concepts, challenges and performance options for Big Data analytics applications.

In this webinar you'll learn how DDN's new DirectMon management software enables a comprehensive "single pane of glass" approach to centralized management and monitoring of DDN storage products.

Join DDN, FilmPartners, and Broadcast Engineering for an in-depth discussion on the Unified Workflow solution created by tightly integrating DDN's xSTREAMscaler and MXFserver 5.0. With experts from FilmPartners and DDN, moderated by Michael Grotticelli of Broadcast Engineering you will not want to miss this webinar as we go over all the details, take questions from the audience and show examples of real-world success.

Significant products, technology and services that were showcased at NAB 2012 are reviewed.

Join DDN, FilmPartners, and Broadcast Engineering for an in-depth discussion on the Unified Workflow solution created by tightly integrating DDN’s xSTREAMscaler and MXFserver 5.0. With experts from FilmPartners and DDN, moderated by Michael Grotticelli of Broadcast Engineering you will not want to miss this webinar as we go over all the details, take questions from the audience and show examples of real-world success.