Set up UltiHash Serverless
How to get started with a preconfigured, managed UltiHash cluster
If you don't want to self-host your own UltiHash cluster for any reason, UltiHash Serverless is perfect for you. It gives you the same high-throughput engine behind our self-hosted version, but without the hassle of managing it yourself.
Your can choose the cloud provider you prefer (current options are AWS and Hetzner Cloud); and your data stays local, stored securely in Frankfurt am Main, Germany (AWS) or Falkenstein, Germany (Hetzner).
UltiHash Serverless offers a number of preconfigured cluster sizes:
200GB: Ideal for tests and proof-of-concept projects (not available on Hetzner)
1 TB: Ideal for development and small pipelines
5 TB: Ideal for production workloads and training
10 TB: Ideal for high-volume inference, media, or GenAI pipelines
Read throughput benchmarks
Read throughput plays a central role in high-performance data workloads such as model training, fine-tuning, and batch inference. In these scenarios, delays in accessing data can lead to underutilized compute resources (e.g GPUs) and increased costs. UltiHash Serverless is optimized to provide high and consistent read performance, particularly for teams working with large volumes of data stored in the EU. The following benchmarks compare UltiHash to AWS S3 (Standard and Express One Zone) across different configurations.
Please note that if you’re using UltiHash Self-Hosted, the read throughput measured may be different depending on the hardware you’re using. For reference, the following benchmarks have been tested with the AWS EC2 instance type c7g.4xlarge
.
UltiHash Serverless (hosted on AWS) vs. S3 Standard (Region eu-central-1
, Frankfurt)
UltiHash Serverless (AWS)
1 GB/s
S3 Standard
200–250 MB/s
UltiHash Serverless delivers 4–5× higher read throughput than S3 Standard, enabling faster data access and reducing idle time for compute resources, such as GPUs waiting for data loading.
To address the need for higher read throughput, AWS introduced a new tier, S3 Express One Zone, designed for high-throughput data access. This tier is particularly targeted at workloads requiring rapid access to large volumes of small files or high request rates. It is currently only available in the us-east-1
(Virginia) region, which limits its applicability for EU-based workloads or users with data residency requirements in Europe.
The table below compares S3 Express One Zone performance under two different conditions:
S3 Express One Zone (Virginia)
Virginia
1.1 GB/s
S3 Express One Zone (Virginia)
Frankfurt
290 MB/s
UltiHash Serverless (Frankfurt)
Frankfurt
1 GB/s
While S3 Express One Zone offers strong read performance when used locally within Virginia, its throughput drops significantly when accessed from Europe. UltiHash Serverless is designed to deliver high read throughput directly from within the EU. It provides fast, local access to object data, making it well-suited for compute-heavy workloads like model training, inference pipelines, and parallel data processing, while ensuring that all data remains compliant with regional residency requirements.
Last updated
Was this helpful?