Reimagining Memory and Storage in the Data Center

Innovative new technologies from Intel are transforming the memory and storage hierarchy.

High Stakes in the Data Center

Mountains of data promise valuable insights and innovation for businesses that rethink and redesign their system architectures. But companies that don’t re-architect might find themselves scrambling just to keep from being buried in the avalanche of data.

The problem is not just in storing raw data, though. For businesses to stay competitive, they need to quickly and cost-effectively access and process all that data for business insights, research, artificial intelligence (AI), and other uses. Both memory and storage are required to enable this level of processing, and companies struggle to balance high costs against limited capacities and performance constraints.

The challenge is even more daunting because different types of memory and storage are required for different workloads. Furthermore, multiple technologies might be used together to achieve the optimal tradeoff in cost versus performance.

Intel is addressing these challenges with new memory and storage technologies that empower businesses to reimagine their data center architectures.

Gaps in the Memory/Storage Hierarchy

Historically, memory and storage solutions have been limited by density, performance, and cost. This limitation has been felt across all kinds of organizations, from retail to government to healthcare to finance. For example, cloud service providers (CSPs) can struggle to meet service level agreements (SLAs) as data loads increase. Financial-services companies can run up against capacity and performance limits for rapidly processing high volumes of transactions. And enterprise businesses can’t keep pace with in-memory analytics needs stemming from customer, inventory, social media, and Internet of Things (IoT) data — primarily due to the high costs and limited capacity of dynamic RAM (DRAM).

To manage data efficiently and effectively, businesses need to determine which infrastructure components best match their needs and budgets. That’s no easy task because each technology in the hierarchy has its strengths and weaknesses:

  • DRAM is great for performance, but it’s expensive, volatile, and has limited scalability.
  • Flash storage (NAND) is non-volatile and less expensive than DRAM, but it lacks DRAM’s performance.
  • Spinning hard-disk drives (HDDs) provide massive storage at the lowest price, but physical discs bring well-understood total cost of ownership (TCO) issues around reliability, physical space requirements, cooling, and power.

Collectively, these traditional storage options have left significant gaps in the memory and storage continuum in the data center, thus limiting the performance of applications. Ever-increasing amounts of data, and the need to access more of it quickly, have further magnified the problem.

In particular, two memory and storage gaps stand out for organizations trying to transform their data centers:

  • Between costly, low-capacity DRAM and more affordable NAND-based solid-state drives (SSDs).
  • Between slower NAND SSDs and lower-cost, but less reliable, HDDs.

Organizations have not had viable options that balance cost, capacity, and performance to bridge those gaps—until now (see Figure 1).

Figure 1. The traditional memory and storage continuum leaves large gaps in capacity, cost, and performance

Closing the Gaps with Intel® Technologies

Intel eliminates data center memory and storage gaps with solutions designed to provide high performance, capacity, and reliability. These solutions deliver low latency and greater operational value than traditional options. Three product families in particular are designed to close cost and performance gaps in the data center with flexibility for new data tiers:

  • Intel® Optane™ DC persistent memory represents a new class of memory and storage technology that offers high capacity, affordability, and persistence. It allows organizations to maintain larger amounts of data closer to the processor, so workloads and services can be optimized to reduce latencies and enhance performance.
  • Intel® Optane™ DC SSDs combine attributes of memory and storage with high throughput, low latency, high quality-of-service (QoS), and high endurance.
  • Intel® QLC 3D NAND SSDs, such as the Intel® SSD D5-P4320, offer the highest Peripheral Component Interconnect Express* (PCIe*) data-volume density on the market at a price that makes them ideal HDD replacements for storing less frequently accessed data.

These innovative products let you reimagine data center configurations to handle modern workloads and keep your business competitive. Each product is described in detail below, with real-world examples of the performance, capacity, and cost benefits they provide.

Intel® Optane™ Technology Creates a New Tier in the Data Hierarchy

Businesses must rethink solutions in previously unimagined ways, adapting to new technologies and evolving to meet their clients’ needs. Intel® Optane™ technology is a new, non-volatile storage option based on Intel® 3D XPoint™ technology that modernizes the existing data center architecture with a new tier in the memory and storage hierarchy, filling the gap between high-performing volatile memory and lower-performing, but affordable, NAND storage. Intel® Optane™ technology is unique in its combination of low latency, high quality of service (QoS), high endurance, and high throughput.

Figure 2. Intel® Optane™ technology combines the performance benefits of DRAM with the capacity benefits of NAND SSDs

Intel® Optane™ technology is ideal for handling “working data”: data that needs to be close to the CPU for rapid access. Working data is about getting much faster access to much more data for real-time analytics, financial transactions, flight reservations, and other use cases that require predictably fast read-response times—when average response times are not good enough. In working data, predictable and consistent performance are important even from the first requests.

Both Intel® Optane™ DC persistent memory and Intel® Optane™ DC SSDs are built on Intel® Optane™ technology. But, as described below, each has a different form factor, and they can be used separately or together in the data center to offer innovative new memory and storage options for businesses.

Intel® Optane™ DC Persistent Memory Lets You Extend or Displace Costly DRAM

Intel® Optane™ DC persistent memory is an industry-disrupting product that fills the gap between DRAM and Intel® Optane™ DC SSDs. For companies that rely on in-memory processing of data, Intel® Optane™ DC persistent memory opens the door to accessing much higher quantities of “hot” data for AI, analytics, high performance computing (HPC), and other uses.

Unlike traditional DRAM, Intel® Optane™ DC persistent memory combines high density, affordability, and persistence. By expanding affordable system memory capacities (greater than 3 TB per CPU socket), businesses can better optimize their data center workloads by moving larger amounts of data closer to the processor and minimizing the higher latency of accessing data from traditional non-volatile system storage.

Intel® Optane™ DC persistent memory will be widely available in 2019, with the release of the next-generation Intel® Xeon® Scalable platform.

Figure 3. Intel® Optane™ DC persistent memory module

The Intel® Optane™ SSD DC P4800X Tackles Working Data in the Data Center

Intel® Optane™ SSD DC P4800X drives look like standard SSDs, but because they are built on Intel® Optane™ technology, they are not NAND-based. The unique architecture of the Intel® Optane™ SSD DC P4800X provides breakthrough performance that is both faster and more consistent than NAND-based SSDs. NAND-based drives typically have fast read times but slow write times—and even slower write times under the stress of high-frequency operations. In contrast, Intel® Optane™ DC SSDs are architected to perform writes at the byte- or page-level for faster and much more predictable performance, with more balanced read and write performance, and with no need for garbage collection.

The Intel® Optane™ SSD DC P4800X maintains consistent read-response times regardless of the write throughput applied to the drive. The graph in Figure 4 shows just how much lower the latency of an Intel® Optane™ DC SSD is compared to a current generation Intel® 3D NAND SSD, especially under the pressure of increasing random-write operations. Unlike NAND-based SSDs, the latency of Intel® Optane™ DC SSDs remains consistently low for all write requests.1

Figure 4. The Intel® Optane™ SSD DC P4800X provides consistently low latency compared to an Intel® 3D NAND SSD1

The combination of low, consistent latency and high endurance allows Intel® Optane™ DC SSDs to function much more efficiently as caching devices than NAND-based solutions.

A study from Evaluator Group demonstrated the impact of replacing an all-NAND-flash write caching and storage solution with Intel® Optane™ DC SSDs in the caching layer. Testing found that a system built on Intel® Xeon® Scalable processors, using Intel® Optane™ SSD DC P4800X drives for the caching layer, delivered up to 3x better price/performance levels than previous-generation systems and storage media, as measured by the IOmark-VM* benchmark.2

The Intel® Optane™ SSD DC P4800X also provides much greater endurance than NAND-based drives. A comparison of two currently shipping drives, for example, shows up to 60 drive writes per day (DWPD) for the Intel® Optane™ SSD DC P4800X compared to just 3 DWPD for the NAND-based Intel® SSD DC P4600.3 This makes Intel® Optane™ DC SSDs much more durable in high-traffic caching environments.

Intel® Optane™ DC persistent memory can also be combined with Intel® Optane™ DC SSDs to create an entirely new, flexible, memory-like tier, as shown in Figure 5. Valuable data traditionally trapped in slower NAND storage can be quickly accessed and acted upon.

Figure 5. Intel® Optane™ DC persistent memory can be combined with Intel® Optane™ DC SSDs to create a whole new tier for handling hot working data and warm capacity data for in-memory analytics (red = “hot” data, yellow = “warm” data, and blue = “cold” data)

Optimize Software to Take Advantage of Intel® Optane™ Technology Performance

Significant improvements in performance can be achieved simply by adding Intel® Optane™ DC SSDs to an existing data center infrastructure, but software optimizations can generate even greater performance results for applications running on Intel® Optane™ technology. Open source software, in particular, matches well with Intel® Optane™ DC SSDs because developers can modify applications to take advantage of the benefits offered by the Intel® Optane™ SSD DC P4800X.

At Oracle, for example, a performance architect optimized MySQL* for the Intel® Optane™ SSD DC P4800X, which resulted in a 5x performance improvement on heavy input/output (I/O)-bound workloads. The Oracle architect also achieved 1 million reads from a single Intel® Optane™ DC SSD.4

In another example, optimizations to Direct I/O* demonstrated up to 48 percent greater efficiency in Java 10* compared to Buffered I/O*.5 These optimizations have significant implications for organizations that run AI workloads or databases that rely on Java, such as Cassandra* or Apache HBase*.

Software architects can use existing tools and development kits to optimize performance for Intel® Optane™ technology. Use the following resources from Intel to get started:

Extend Memory with Intel® Memory Drive Technology

Intel® Optane™ DC SSDs can also be configured as extended memory by using Intel® Memory Drive Technology. Intel® Memory Drive Technology transparently integrates an SSD into the memory subsystem and makes it appear like DRAM, with no changes required to the operating system or applications. Intel® Memory Drive Technology can be used to displace a portion of DRAM and reduce overall memory cost, or to grow the memory pool beyond DRAM capacities when large system memory capacities are required.

In fact, Apache Spark* performance is 5x faster by adding Intel® Memory Drive Technology software with an Intel® Optane™ SSD DC P4800X.4

Reduce the Capacity Storage Gap with Intel® QLC 3D NAND SSDs

As NAND technology increases in efficiency and declines in price, the need for mechanical drives continues to decline. The latest breakthrough, Intel® QLC 3D NAND SSDs, might relegate spinning discs to only the coldest of data-storage scenarios.

Intel® QLC 3D NAND SSDs are designed to provide flash reliability at higher densities and an affordable price point. These benefits help remove barriers to replacing traditional HDDs, which are typically slower, less reliable, more power hungry, require more cooling, and take up a larger data footprint compared to flash drives.

Figure 6. By converting from HDDs to Intel® QLC 3D NAND SSDs, businesses can achieve significant savings in power, cooling, and service, with a smaller data center footprint6 7

Intel® QLC 3D NAND SSDs can be combined with Intel® Optane™ technology to accelerate the speed of frequently accessed data, while using the price and capacity benefits of flash technology over HDDs for massive capacity storage. That lets organizations fill the storage cost/capacity gap between Intel® Optane™ DC SSDs and HDDs. Moreover, because Intel® QLC 3D NAND SSDs offer high reliability with affordability, many organizations can use them to replace HDDs.

Consolidate Data with Innovative New Form Factors from Intel

Intel is also closing the storage cost/capacity gap with innovative new form factors. Winner of a Gold International Design Excellence Award in 2018, Intel’s 3D NAND “ruler” form factor for SSDs improves density, manageability, and serviceability in tandem with an efficient thermal design that is revolutionizing server architecture.

Because of the unique shape and characteristics of the drive, based on EDSFF, vendors like Supermicro are able to fit 32 Intel “ruler” drives at 32 TB each into a single 1U server, providing up to one petabyte of data per server.8

Reimagine Data Center Storage

Intel® technologies enable modern businesses to rapidly and flexibly store, process, and manage massive quantities of data for analytics, AI, HPC, and other workloads by filling the memory and storage gaps with a complete range of options—from Intel® Optane™ DC persistent memory and the Intel® Optane™ SSD DC P4800X to Intel® QLC 3D NAND SSDs and high-capacity “ruler” form factor drives.

Together, Intel storage technologies and products offer data center architects flexibility to match performance, capacity, reliability, and affordability to their business applications and workloads. It’s time to reimagine memory and storage with Intel® Optane™ technology and Intel® QLC 3D NAND technology.

Learn More

Reimagine your data center with Intel storage technologies. Visit intel.com.br/content/www/br/pt/storage to get started.

Pronto para falar com a Intel sobre como acelerar sua jornada de modernização do data center?


Informações de produto e desempenho

1

Fonte: testado pela Intel: o Tempo de resposta se refere à latência média de leitura medida a uma profundidade de fila 1 durante uma carga de trabalho de gravação aleatória de 4K usando FIO 3.1. Veja a configuração na Nota de rodapé 1 acima.

2

Testes realizados por The Evaluator Group, encomendados pela Intel. Veja detalhes de configuração em https://www.evaluatorgroup.com/document/lab-insight-latest-intel-technologies-power-new-performance-levels-vmware-vsan-2018-update/. Configuração anterior: processador Intel® Xeon® E5-2699 v4, ESXI: ESXi600-201803001, Build: 7967764, Ubuntu Linux 18.04, BIOS: 2600WT SE5C610.86B.01.01.0024. Mídia de armazenamento: 1 x SSD Intel® DC série S3700 de 800 GB + 6 x SSD Intel® DC série S3510 1,6 TB. Desempenho: 320 IOmark-VM, preço/desempenho: US$ 684/VM; Configuração atual: processador Intel® Xeon® Gold 6154, ESXI ESXi-6.7.0-8169922 Build 8169922, Ubuntu Linux 18.04, BIOS SE5C620.86B.00.01.0013.030920180427. Mídia de armazenamento: 2 x SSD Intel® DC série P4800X de 375 GB + 5 x SSD Intel® DC série P4500 de 4 TB ; Desempenho: 1152 IOmark-VM, preço/desempenho: US$ 216/VM. Mídia de armazenamento: 1 x SSD Intel® DC série P3700 + 4 x disco rígido Seagate 1 TB 10K; Desempenho: 88 IOmark-VM-HC, preço/desempenho: US$ 2.153/IOmark-VM-HC; Configuração atual: mídia de armazenamento: 2 x SSD Intel® DC série P4800X + 4 x SSD Intel® DC P4500 série de 4 TB; Desempenho: 704 IOmark-VM-HC. Preço/desempenho: $684/IOmark-VM-HC. **. Preço/desempenho: $237/IOmark-VM-HC. Os resultados de desempenho são baseados em testes realizados em segunda-feira, 20 de agosto de 2018 e podem não refletir todas as atualizações de segurança disponíveis ao público. Para obter detalhes, consulte a publicação da configuração.

3

Intel. Consulte as especificações do produto na tabela em “Resumo do produto: SSD Intel® Optane™ DC P4800X”. https://www.intel.com.br/content/www/br/pt/products/docs/memory-storage/solid-state-drives/data-center-ssds/optane-ssd-dc-p4800x-p4801x-brief.html.

4

Os resultados de desempenho são baseados em testes realizados em 20 de setembro de 2018 e podem não refletir todas as atualizações de segurança disponíveis ao público. Para obter detalhes, consulte a publicação da configuração. Nenhum componente ou produto é totalmente seguro. Fonte: Intel. Configuração do sistema: Sistema servidor Intel®, 2 x processadores Intel® Xeon® Gold 6154, DRAM DDR4 de 384 GB, unidades de banco de dados: 2 x SSD Intel® Optane™ DC P4800X (375 GB) e 1 x SSD Intel® DC série P4510, 1 x SSD Intel DC série S4510, CentOS 7.5* (kernel 4.18 (elrepo)), BIOS: SE5C620.86B.00.01.0014.070920180847, tipo de produto do sistema: Placas para servidor Intel® 2600WFT. MySQL Server 8.0.13*, Sysbench 1.0.15* configurado para divisão de transações de processamento de transações online (OLTP) de leitura/gravação 70/30 usando um banco de dados de 100 GB. 30% de memória de banco de dados fornecida ao MySQL (30 GB).

5

Os resultados de desempenho se baseiam em testes realizados em julho de 2018 e podem não incluir todas as atualizações de segurança disponíveis publicamente. Para obter detalhes, consulte a publicação da configuração. Nenhum produto pode ser totalmente seguro. Fonte: Intel: Configuração do sistema: caixa branca de Placa para servidor Intel® S2600WFT, 2 x processadores Intel® Xeon® Gold 6154 a 3,00 GHz com 36 núcleos virtuais, 64 GB DIMM DDR4 síncrona 2,666 MHz (0,4 ns) (4 x 16 GB), 1 x NVM Express* (NVMe*), Peripheral Component Interconnect Express* (PCIe*), SSD Intel® Optane™ DC P4800X de 750 GB (versão de firmware: E2010324), 1 x NVMe* PCIe* 4 TB SSD Intel® DC série P4500 (versão de firmware: QDV10150), versão do BIOS Intel®: SE5C620.86B.00.01.0013.030920180427, distribuição CentOS 7.4* com o kernel 4.15.7. Veja as informações do OpenJDK* em: OpenJDK. "JDK 10". Março de 2018. https://openjdk.java.net/projects/jdk/10/.

6

Economia de custos com energia, resfriamento e consolidação. Baseada em HDD: HDD de 7,2K RPM e 4 TB, AFR de 2% e potência ativa de 7,7 W, 24 drives em 2U (potência total de 1971 W) https://www.seagate.com/files/www-content/datasheets/pdfs/exos-7-e8-data-sheet-DS1957-1-1709US-en_US.pdf SSD: potência ativa de 22 W, AFR de 44%, 32 drives no 1U (potência total de 704 W); Custo de resfriamento baseado no prazo de implantação de 5 anos com custo de US$ 0,158/Kwh e número de watts para resfriamento de 1 watt 1,20 Com base em 24 drives HDD 2U de 3,5 pol. e 32 drives EDSFF 1U longo. Armazenamento híbrido baseado no uso de Unidade de estado sólido Intel® TLC (Tri-Level Cell, Célula de Três Níveis) para cache.

 

7

Redução de custos de substituição do drive. Cálculo: HDD, AFR (Annualized Failure Rate, Taxa Anual de Falha) de 2% x 256 drives x 5 anos = 25,6 substituições em 5 anos; SSD: AFR de 0,44% x 32 drives x 5 anos = 0,7 substituições em 5 anos.

 

8

Supermicro. "The systems support front hot-swap accessibility to 32 EDSFF drives for up to 1PB of fast low-latency NVMe* storage in 1U (Os sistemas suportam acessibilidade frontal de hot swap para 32 unidades EDSFF de até 1 PB de armazenamento NVMe* rápido de baixa latência em 1U)". Fonte: "Supermicro Opens New Era of Petascale Computing with a Family of All-Flash NVMe 1U Systems Scalable up to a Petabyte of High Performance Storage (A Supermicro abre uma nova era de computadores Petascale com uma família de sistemas NVMe em 1U totalmente em flash, dimensionáveis até um Petabyte de armazenamento de alto desempenho)". Agosto de 2018. https://www.supermicro.com/newsroom/pressreleases/2018/press180807_Petabyte_NVMe_1U.cfm. Referência do SuperStorage SSG-136R-NR32JBF: https://www.supermicro.com/products/system/1U/136/SSG-136R-NR32JBF.cfm.