CXL Industry News
Accelerating Data Retrieval in Retrieval Augmentation Generation (RAG) Pipelines using CXL
RAG (retrieval augmented generation) has emerged as a powerful technique to customize LLMs for users and use cases beyond the model’s training set. However, there are multiple potential bottlenecks within a RAG pipeline.
Announcing Memory Machine Cloud 3.0 Imperia
I am very excited to announce that Memory Machine Cloud (MMCloud) Imperia (3.0) is now generally available. Our vision for MMCloud is that it delivers unparalleled resource efficiency for compute intensive workloads and extreme ease-of-use for both Cloud admins and...
Introducing Weighted Interleaving in Linux for Enhanced Memory Bandwidth Management
With the release of Linux Kernel 6.9, system administrators have gained a powerful new tool for managing memory distribution across NUMA nodes: Weighted Interleaving. This feature is especially beneficial in systems utilizing various types of memory, including traditional DRAM and Compute Express Link (CXL) attached memory. In this article, we’ll explore Weighted Interleaving, how it works, and how to use it.
Unleashing the Future of Memory Management: Exploring CXL Dynamic Capacity Devices with Docker and QEMU
In the ever-advancing realm of technology, developers and application owners always look for innovative tools and methodologies to boost performance and scalability. A revolutionary stride in this direction is the integration of Compute Express Link (CXL) technology, particularly through the utilization of Dynamic Capacity Devices (DCD). CXL, an open standard for high-speed CPU-to-device and CPU-to-memory interconnects, substantially enhances data center and cloud environments, offering many benefits.
Memory Wall, Big Memory, and the Era of AI
In the fast-evolving landscape of artificial intelligence (AI), where models are growing larger and more complex by the day, the demand for efficient processing of vast amounts of data has ushered in a new era of computing infrastructure.
MemVerge and Micron Boost NVIDIA GPU Utilization with CXL® Memory
The joint solution increases GPU utilization by 77% and more than doubles the speed of OPT-66B batch inference. San Jose, CA – March 18, 2024 – MemVerge®, a leader in AI-first Big Memory Software, has joined forces with Micron to unveil a groundbreaking solution that...
MemVerge and Sentieon Announce WaveRider for Sentieon to Accelerate Next-Generation Sequencing in the Cloud
Early Customers Realize 10x Increase in Performance and Cloud Cost Savings; Sentieon Software Offered Free in Memory Machine Cloud Subscription MILPITAS, Calif. – November 14, 2023 – MemVerge®, pioneers of Big Memory software, and Sentieon®, the market leader in...
Samsung, MemVerge, H3 Platform, and XConn Demonstrate Memory Pooling and Sharing for “Endless Memory”
Joint demonstration eliminates Out-of-Memory errors to accelerate AI/ML workloads SANTA CLARA, Calif. – Aug 8, 2023 – Samsung, MemVerge, H3 Platform, and XConn, today unveiled a 2TB Pooled CXL Memory System at Flash Memory Summit. The system addresses performance...
Emulating CXL Memory Expanders in QEMU
Build and install a working branch of QEMU. Launch a pre-made QEMU instance with a CXL Memory Expander. Create a memory region for the CXL Memory Expander. Convert that memory region between DEVDAX and NUMA Modes.
MemVerge and SK hynix Accelerate Memory Pooling and Sharing Software Development with CXL Flight Simulator
The companies contribute to the open-source community and deliver pre-built QEMU virtual machines that emulate CXL memory pool devices MILPITAS, Calif. – August 2, 2023 – MemVerge®, pioneers of Big Memory software, today introduced QEMU-based CXL Flight Simulator, a...
CXL Forum Community News