HSE: Heterogeneous-memory storage engine designed for SSDs

栏目: IT技术 · 发布时间: 6年前

内容简介:HSEis an embeddable key-value store designed for SSDs based on NAND flash or persistent memory. HSE optimizes performance and endurance by orchestrating data placement across DRAM and multiple classes of SSDs or other solid-state storage.HSE is ideal for p

HSE: Heterogeneous-Memory Storage Engine

HSEis an embeddable key-value store designed for SSDs based on NAND flash or persistent memory. HSE optimizes performance and endurance by orchestrating data placement across DRAM and multiple classes of SSDs or other solid-state storage.

HSE is ideal for powering NoSQL, Software-Defined Storage (SDS), High-Performance Computing (HPC), Big Data, Internet of Things (IoT), and Artificial Intelligence (AI) solutions.

Key Features

  • Standard and advanced key-value operators
  • Full transactions with snapshot-isolation spanning multiple independent key-value collections
  • Cursors for iterating over snapshot views
  • Data model for optimizing mixed use-case workloads in a single data store
  • Flexible durability controls
  • Configurable data orchestration schemes
  • C API library that can be embedded in any application

Benefits

  • Scales to terabytes of data and hundreds of billions of keys per store
  • Efficiently handles thousands of concurrent operations
  • Dramatically improves throughput, latency, write-amplification, and read-amplification versus common alternatives for many workloads
  • Optionally combines multiple classes of solid-state storage to optimize performance and endurance

Getting Started

The HSE Wiki contains all the information you need to get started with HSE.

YCSB Performance Results

YCSB (Yahoo!® Cloud Serving Benchmark) is an industry-standard benchmark for databases and storage engines supporting key-value workloads. The following table summarizes several YCSB workload mixes, with application examples taken from the YCSB documentation.

YCSB Workload Operations Application Example
A 50% Read; 50% Update Session store recording user-session activity
B 95% Read; 5% Update Photo tagging
C 100% Read User profile cache
D 95% Read; 5% Insert User status updates

We integrated HSE with YCSB to make it easy to compare its performance and scalability to that of other storage engines for YCSB workloads. Below are throughput results from running YCSB with HSE.

For comparison, we include results from RocksDB , a popular and widely-deployed key-value store. For these YCSB workloads, HSE delivered up to nearly 6x more throughput than RocksDB.

HSE: Heterogeneous-memory storage engine designed for SSDs

System configuration details and additional performance results can be found in the YCSB section of the HSE Wiki.

We also integrated HSE with MongoDB® , a popular NoSQL database, to validate its benefits within a real-world storage application. Below are throughput results from running YCSB with MongoDB using HSE (MongoDB/HSE).

For comparison, we include results from MongoDB using the default WiredTiger storage engine (MongoDB/WiredTiger). For these YCSB workloads, MongoDB/HSE delivered up to nearly 8x more throughput than MongoDB/WiredTiger.

HSE: Heterogeneous-memory storage engine designed for SSDs

System configuration details and additional performance results can be found in the MongoDB section of the HSE Wiki.


以上就是本文的全部内容,希望对大家的学习有所帮助,也希望大家多多支持 码农网

查看所有标签

本站部分资源来源于网络,本站转载出于传递更多信息之目的,版权归原作者或者来源机构所有,如转载稿涉及版权问题,请联系我们

数据之巅

数据之巅

涂子沛 / 中信出版社 / 2014-5-1 / 65.00元

《数据之巅:大数据革命,历史、现实与未来》从美国建国之基讲起,通过阐述初数时代、内战时代、镀金时代、进步时代、抽样时代、大数据时代的特征,系统梳理了美国数据文化的形成,阐述了其数据治国之道,论述了中国数据文化的薄弱之处,展望了未来数据世界的远景。 “尊重事实,用数据说话”,“推崇知识和理性,用数据创新”,作者不仅意在传承黄仁宇“数目字”管理的薪火,还试图把数据这个科技符号在中国转变为文化符号......一起来看看 《数据之巅》 这本书的介绍吧!

在线进制转换器
在线进制转换器

各进制数互转换器

HTML 编码/解码
HTML 编码/解码

HTML 编码/解码

SHA 加密
SHA 加密

SHA 加密工具