llmrun
MemTensorMemTDeepseekV4ForCausalLM

MemT 1.0 Flash — Hardware Requirements & GPU Compatibility

Chat

MemT 1.0 Flash is a 287.9B-parameter open language model from MemTensor. It supports a context window of up to 1,048,576 tokens. At BF16 it needs about 576.21 GB of VRAM — see which GPUs and Macs can run it below.

287.9B params · MoE17B active1049K contextMIT2.9K downloads77 likes
Based on DeepSeek V4 Flash

MemT 1.0 Flash runs on a multi-GPU server

BF16 needs ~576.4 GB · about 5× H200 SXM 141 GB

MIT

Not set up for it?

Reference GPU · RTX 4090 24 GB

Estimates, ±20% · how we estimate

Run MemT 1.0 Flash

One recommended way. Every other method, OS and quant is in the step-by-step guide.

Recommended

vLLM on a multi-GPU server
tensor + pipeline parallel · needs vLLM on every node
$vllm serve MemTensor/MemT-1.0-Flash --max-model-len 16384 --tensor-parallel-size 8

Size the nodes from the table above

Download: Weights on Hugging Face

install, other ways

Other ways

each opens step-by-step

Run in cloud

Rent 5× H200 SXM · BF16

Estimated hourly price
~$17.95/hr
est., whole server
GPUs
5 GPUs
705 GB of VRAM
Deployon RunPodRent H200 SXM$3.59/hr per GPU (opens in new tab)
Compare GPUs →

How Much VRAM Does MemT 1.0 Flash Need?

Select a quantization level; the listed hardware adheres to it.

QuantizationVRAM+32KRuns on
576.2 GB576.6 GB16-bit · bfloat — Brain floating point 16 — preferred for trainingRuns on 5× H200 SXM 141 GB
est.calculated, no published file yet

Selected BF16

Brain floating point 16

576.4GBat 16K context

Weights
575.9 GB
KV cache
0.2 GB
Overhead
0.3 GB

Server-class: ~576.4 GB at 16K context · about 5× H200 SXM 141 GB

Which Hardware Can Run MemT 1.0 Flash?

BF16 · 576.2 GB

MemT 1.0 Flash (BF16) requires 576.2 GB of VRAM to load the model weights. For comfortable inference with headroom for KV cache and system overhead, 750+ GB is recommended. Using the full 1049K context window can add up to 11.5 GB, bringing total usage to 587.7 GB. No consumer GPU has enough memory.

Needs server-class hardware

MemT 1.0 Flash runs on a multi-GPU server · BF16 needs ~576.4 GB

Hardware that runs this model
HardwareQuantMemoryContextHardware page
5× H200 SXM 141 GB · 705 GBBF16576.4 GB1M ctxH200 SXM →BF16 · 576.4 GB · 1M ctx
4× B200 192 GB · 768 GBBF16576.4 GB1M ctxB200 →BF16 · 576.4 GB · 1M ctx

Also: NVIDIA DGX A100 640GB · NVIDIA DGX H100

≤ 640 GB tier →

By VRAM tier · typical GPUs and Macs at BF16

Consumer GPUs (up to 32 GB) and Macs up to 512 GB: too small for this model (needs ≥ 576.4 GB)8 GB tier →12 GB tier →16 GB tier →24 GB tier →Macs →

Alternatives to MemT 1.0 Flash

Similar models

3
ModelScoreVRAMWhy it is similar
MiMo V2.6 Flash MOPDXiaomi—186.5 GBsame size
DeepSeek V4 Flash Vision ExpDeepSeek—183.3 GBsame size
Hy3Tencent—182.3 GBsame size

Specifications

Publisher
MemTensor
Parameters
287.9B
Active parameters
17.4B per token
Architecture
MemTDeepseekV4ForCausalLM
Context Length
1,048,576 tokens
Vocabulary Size
129,280
Release Date
2026-10-17
License
MIT

Resources

Frequently Asked Questions

How much VRAM does MemT 1.0 Flash need?

MemT 1.0 Flash requires 576.2 GB of VRAM at BF16. Full 1049K context adds up to 11.5 GB (587.7 GB total).

VRAM = Weights + KV Cache + Overhead

Weights = 287.9B × 16 bits ÷ 8 = 575.9 GB

KV Cache + Overhead ≈ 0.3 GB (at 2K context + ~0.3 GB framework)

Fit ratings and hardware model lists check this model with room for a 16K-token context, which needs a little more memory.

KV Cache + Overhead ≈ 11.8 GB (at full 1049K context)

VRAM usage by quantization

576.2 GB
587.7 GB

Learn more about VRAM estimation →

Can NVIDIA GeForce RTX 5090 run MemT 1.0 Flash?

No — MemT 1.0 Flash requires at least 576.2 GB at BF16, which exceeds the NVIDIA GeForce RTX 5090's 32 GB of VRAM.

Can I run MemT 1.0 Flash on a Mac?

MemT 1.0 Flash requires at least 576.2 GB at BF16. None of the 146 Macs we list has that much usable memory (the largest has 508.5 GB after macOS overhead).

Can I run MemT 1.0 Flash locally?

Yes — MemT 1.0 Flash can run locally on consumer hardware. Popular tools include Ollama, LM Studio, and llama.cpp.

What's the download size of MemT 1.0 Flash?

At BF16, the download is about 575.89 GB.

Which GPUs can run MemT 1.0 Flash?

No single consumer GPU has enough VRAM to run MemT 1.0 Flash at BF16 (576.2 GB). Multi-GPU or professional hardware is required.

Which devices can run MemT 1.0 Flash?

MemT 1.0 Flash requires at least 576.2 GB at BF16, which exceeds the usable memory of every unified-memory device we list (the largest has 508.5 GB).