> For the complete documentation index, see [llms.txt](https://docs.ultihash.io/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.ultihash.io/reference/changelog/core-image.md). # Core image ## \[1.6.0] 2025-07-16 **Enhancements** * Add support for S3-compatible object versioning **Bug Fixes** * Fixes an issue when operating erasure-coded storage groups with disabled deduplication * Fixes an issue where storage service instances might wrongfully acknowledge write operations of data that has not been flushed to persistent storage yet ## \[1.5.0] 2025-07-08 **Enhancements** * Improved write performance of erasure-coded storage groups * Enabled deletion support for erasure-coded storage groups **Bug Fixes** * Fix issue with GetObject requests which could lead to stale downloads with high CPU utilization ## \[1.4.0] 2025-06-04 **Enhancements** * Add support for erasure-coded storage groups based on Reed-Solomon coding techniques, improving the availability and resilience of UltiHash storage clusters. **Other** * Upgraded employed libraries to their latest available releases. ## \[1.3.1] 2025-04-04 **Other** * Added new OTEL metrics to track license-related attributes. ## \[1.3.0] 2025-02-24 **Enhancements** * **Implemented support for pay-as-you-go license:** Enabled charges based solely on actual used storage capacity. This prevents overpayments for unused disk space. * **Implemented support for per-bucket CORS configuration:** Enabled using `s3:PutBucketCors`, `s3:GetBucketCors` and `s3:DeleteBucketCors` to configure cross-origin interaction. * **Implemented support for pre-signed URL:** Enabled writing and reading S3 objects by using pre-signed URL bypassing IAM policies. **Other** * **Optionally disable deduplication:** The option allows disabling deduplicator service completely. ## \[1.2.1] 2025-02-21 **Bug Fixes** * **S3 Requests Validation Improved:** Now AWS SDK for NodeJS can communicate with UH cluster without producing validation-related errors. ## \[1.2.0] 2025-01-21 **Enhancements** * **Implemented OTEL Traces Support:** Enabled generating OTEL traces to improve debugging capabilities. * **Improved Cluster Startup:** Enabled the cluster to not fail if etcd gets unavailable. **Bug Fixes** * **Concurrency Issue Resolved:** Cluster became more reliable by preventing concurrency problems. * **Log Level Option Respected:** Export of cluster logs respects the log level set by user instead of exporting all existing logs regardless of the requested log level. * **Storage Reclaiming Issue Resolved:** Fixed the issue that would prevent completely reclaiming storage of deleted objects. ## \[1.1.2] 2024-12-19 **Enhancements** * **Optimized Write Operations:** Refined the `STORAGE_WRITE_REQ` message for more efficient coordination between the deduplication engine and the storage layer, boosting overall write performance. * **Improved Reference Counting:** Enhanced the reference counting infrastructure within the storage service to better handle large-scale workloads, ensuring higher efficiency and stability. **Bug Fixes** * **Content-Range Header Issue Resolved:** Fixed an issue where incorrect return values were provided in the `Content-Range` header during ranged GET requests, ensuring accurate and standards-compliant responses. ## \[1.1.1] 2024-12-09 * Request downstream error to be treated as an internal error to allow the client to retry * Synchronized access to database directory ## \[1.1.0] 2024-11-11 * Re-connect when losing connection to etcd * Support authentication against etcd * Correctly report original size in responses to PutObject and CompleteMultipartUpload * Fix request ID for `100 Continue` responses * Add support for policy variables: `uh:ActionId`, `uh:ResourceArn`, `aws:username`, `aws:userid`, `aws:PrincipalArn`, `aws:SourceIp`, `aws:referer`, `aws:UserAgent`, `s3:x-amz-content-sha256`, `s3:x-amz-copy-source`, `s3:delimiter`, `s3:prefix`, `aws:CurrentTime` * Add default content-type for objects * Fix a bug in parsing HTTP range requests * Remove output to log.log * Add support for date condition operators: `DateEquals`, `DateNotEquals`, `DateLessThan`, `DateLessThanEquals`, `DateGreaterThan`, `DateGreaterThanEquals` * Conditions should be less than `2261-01-01T00:00:00Z` * Reduced size of object metadata * Improved read performance * Fix a bug in storage, leading to failed deduplication requests * Improved robustness for successive write-delete-write command sequences and small object sizes * Fix bug on `NotAction`, `NotPrincipal`, `NotResource`: implement NOR for multiple context values * Implement special characters: `${*}`, `${?}`, `${$}` * Support variable on resource policy statement * Prevent services from being destroyed while etcd is not booted up * Restrictions on naming buckets have been resolved (e.g. cannot start with a number) ## \[1.0.0] 2024-10-15 * Added basic policy and authentication support * Finished deletion support ## \[0.6.0] 2024-09-18 * The storage service can now perform delete operations and reclaim disk space * Deduplicator and Entrypoint services are now making use of storage-level delete operations * Fix potential data corruption issue caused by deleting and re-uploading data * Partial implementation of erasure coding / storage groups * Partial implementation of authentication / policy support ## \[0.5.4] 2024-08-08 * Support for object mime types * Improved handling of multipart uploads * Added support for using multiple working directories/storage devices to storage service * Added link/unlink interface to storage service, enabling deletion of unused data ## \[0.5.3] 2024-07-01 * Several S3A compatibility fixes ## \[0.5.2] 2024-06-25 * Increased waiting time for etcd to 5 minutes ## \[0.5.1] 2024-06-24 * Improved compatibility level with S3 API * Fixed handling of XML-reserved characters in object keys * Added REST API for querying raw and effective size of data in the cluster * Fixed incorrect XML in S3 API responses * Fixed occasional application hangs, resulting in bad performance * Improved deduplication algorithm * More efficient storage usage by truncating unused spaces in files ## \[0.5.0] 2024-06-06 * Removed support for S3 Outpost's GetBucket * Deduplication statistic collection * Improve API support for PySpark (copy object, head object, etc.) * Replace directory service with PostgreSQL * Stablize memory requirements for deduplication * Performance improvements for deduplication ## \[0.4.2] 2024-05-22 * Fixed two bugs that result in poor deduplication * Support running as monolith * A few bug fixes in S3 API * Performance improvements ## \[0.4.1] 2024-04-26 * Fixed a bug where data corruption could occur when using multiple deduplicator instances * Implemented asynchronous write support in storage service * Improved write throughput of storage service * Improved handling of command line arguments * Reduced memory footprint of entrypoint service * Fixed timeout issues when uploading large objects * Improved throughput of deduplicator service * Fixed formatting of timestamps in HTTP response * Fixed computation of ETAG ## \[0.4.0] 2024-03-26 * Refactored data store, mostly lockless writes and completely lockless reads * Fixed a bug in the free spot manager * Fixed concurrency issue in directory service * Fix hanging server when requesting empty files * Use buffered file I/O to improve performance of deduplicator WARNING: this breaks compatibility with instances * Caching fragments before writing them to storage ## \[0.3.4] - 2024-03-15 * Fixed delete objects raising segmentation fault in entrypoint ## \[0.3.3] - 2024-03-15 * Fixed entity too small error in entrypoint ## \[0.3.2] - 2024-03-14 * Fixed cache usage * Object Metadata in bucket list response * More unit tests and fixes ## \[0.3.1] - 2024-03-14 * Implemented pagination for better download behaviour * Fixed potential locking issue in the worker pool * Reduced log messages to single line entries * Fixed computation of space savings for empty objects ## \[0.3.0] - 2024-03-13 * Fixed potential log corruption issue in deduplicator * Increase maximum storage service size * Logging of service requests * Add counter counting active connections ## \[0.2.1] - 2024-03-06 * Fix access violations in entrypoint and deduplicator * Fix memory leak in license validation * Fix double-free in MD5 checksum computation * Fix use-after-free in directory bucket deletion * Finalized multipart upload and pending deletion of multipart uploads * Propagate errors about missing downstream services in entrypoint ## \[0.2.0] - 2024-02-29 * Implement etcd-based service coordination * Use open-telemetry for metrics and log reporting * Implement basic licensing * Fix several stability and performance issues