> For the complete documentation index, see [llms.txt](https://docs.ultihash.io/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.ultihash.io/reference/changelog/core-image.md). # Core image ## \[1.6.0] 2025-07-16 **Enhancements** * Add support for S3-compatible object versioning **Bug Fixes** * Fixes an issue when operating erasure-coded storage groups with disabled deduplication * Fixes an issue where storage service instances might wrongfully acknowledge write operations of data that has not been flushed to persistent storage yet ## \[1.5.0] 2025-07-08 **Enhancements** * Improved write performance of erasure-coded storage groups * Enabled deletion support for erasure-coded storage groups **Bug Fixes** * Fix issue with GetObject requests which could lead to stale downloads with high CPU utilization ## \[1.4.0] 2025-06-04 **Enhancements** * Add support for erasure-coded storage groups based on Reed-Solomon coding techniques, improving the availability and resilience of UltiHash storage clusters. **Other** * Upgraded employed libraries to their latest available releases. ## \[1.3.1] 2025-04-04 **Other** * Added new OTEL metrics to track license-related attributes. ## \[1.3.0] 2025-02-24 **Enhancements** * **Implemented support for pay-as-you-go license:** Enabled charges based solely on actual used storage capacity. This prevents overpayments for unused disk space. * **Implemented support for per-bucket CORS configuration:** Enabled using `s3:PutBucketCors`, `s3:GetBucketCors` and `s3:DeleteBucketCors` to configure cross-origin interaction. * **Implemented support for pre-signed URL:** Enabled writing and reading S3 objects by using pre-signed URL bypassing IAM policies. **Other** * **Optionally disable deduplication:** The option allows disabling deduplicator service completely. ## \[1.2.1] 2025-02-21 **Bug Fixes** * **S3 Requests Validation Improved:** Now AWS SDK for NodeJS can communicate with UH cluster without producing validation-related errors. ## \[1.2.0] 2025-01-21 **Enhancements** * **Implemented OTEL Traces Support:** Enabled generating OTEL traces to improve debugging capabilities. * **Improved Cluster Startup:** Enabled the cluster to not fail if etcd gets unavailable. **Bug Fixes** * **Concurrency Issue Resolved:** Cluster became more reliable by preventing concurrency problems. * **Log Level Option Respected:** Export of cluster logs respects the log level set by user instead of exporting all existing logs regardless of the requested log level. * **Storage Reclaiming Issue Resolved:** Fixed the issue that would prevent completely reclaiming storage of deleted objects. ## \[1.1.2] 2024-12-19 **Enhancements** * **Optimized Write Operations:** Refined the `STORAGE_WRITE_REQ` message for more efficient coordination between the deduplication engine and the storage layer, boosting overall write performance. * **Improved Reference Counting:** Enhanced the reference counting infrastructure within the storage service to better handle large-scale workloads, ensuring higher efficiency and stability. **Bug Fixes** * **Content-Range Header Issue Resolved:** Fixed an issue where incorrect return values were provided in the `Content-Range` header during ranged GET requests, ensuring accurate and standards-compliant responses. ## \[1.1.1] 2024-12-09 * Request downstream error to be treated as an internal error to allow the client to retry * Synchronized access to database directory ## \[1.1.0] 2024-11-11 * Re-connect when losing connection to etcd * Support authentication against etcd * Correctly report original size in responses to PutObject and CompleteMultipartUpload * Fix request ID for `100 Continue` responses * Add support for policy variables: `uh:ActionId`, `uh:ResourceArn`, `aws:username`, `aws:userid`, `aws:PrincipalArn`, `aws:SourceIp`, `aws:referer`, `aws:UserAgent`, `s3:x-amz-content-sha256`, `s3:x-amz-copy-source`, `s3:delimiter`, `s3:prefix`, `aws:CurrentTime` * Add default content-type for objects * Fix a bug in parsing HTTP range requests * Remove output to log.log * Add support for date condition operators: `DateEquals`, `DateNotEquals`, `DateLessThan`, `DateLessThanEquals`, `DateGreaterThan`, `DateGreaterThanEquals` * Conditions should be less than `2261-01-01T00:00:00Z` * Reduced size of object metadata * Improved read performance * Fix a bug in storage, leading to failed deduplication requests * Improved robustness for successive write-delete-write command sequences and small object sizes * Fix bug on `NotAction`, `NotPrincipal`, `NotResource`: implement NOR for multiple context values * Implement special characters: `${*}`, `${?}`, `${$}` * Support variable on resource policy statement * Prevent services from being destroyed while etcd is not booted up * Restrictions on naming buckets have been resolved (e.g. cannot start with a number) ## \[1.0.0] 2024-10-15 * Added basic policy and authentication support * Finished deletion support ## \[0.6.0] 2024-09-18 * The storage service can now perform delete operations and reclaim disk space * Deduplicator and Entrypoint services are now making use of storage-level delete operations * Fix potential data corruption issue caused by deleting and re-uploading data * Partial implementation of erasure coding / storage groups * Partial implementation of authentication / policy support ## \[0.5.4] 2024-08-08 * Support for object mime types * Improved handling of multipart uploads * Added support for using multiple working directories/storage devices to storage service * Added link/unlink interface to storage service, enabling deletion of unused data ## \[0.5.3] 2024-07-01 * Several S3A compatibility fixes ## \[0.5.2] 2024-06-25 * Increased waiting time for etcd to 5 minutes ## \[0.5.1] 2024-06-24 * Improved compatibility level with S3 API * Fixed handling of XML-reserved characters in object keys * Added REST API for querying raw and effective size of data in the cluster * Fixed incorrect XML in S3 API responses * Fixed occasional application hangs, resulting in bad performance * Improved deduplication algorithm * More efficient storage usage by truncating unused spaces in files ## \[0.5.0] 2024-06-06 * Removed support for S3 Outpost's GetBucket * Deduplication statistic collection * Improve API support for PySpark (copy object, head object, etc.) * Replace directory service with PostgreSQL * Stablize memory requirements for deduplication * Performance improvements for deduplication ## \[0.4.2] 2024-05-22 * Fixed two bugs that result in poor deduplication * Support running as monolith * A few bug fixes in S3 API * Performance improvements ## \[0.4.1] 2024-04-26 * Fixed a bug where data corruption could occur when using multiple deduplicator instances * Implemented asynchronous write support in storage service * Improved write throughput of storage service * Improved handling of command line arguments * Reduced memory footprint of entrypoint service * Fixed timeout issues when uploading large objects * Improved throughput of deduplicator service * Fixed formatting of timestamps in HTTP response * Fixed computation of ETAG ## \[0.4.0] 2024-03-26 * Refactored data store, mostly lockless writes and completely lockless reads * Fixed a bug in the free spot manager * Fixed concurrency issue in directory service * Fix hanging server when requesting empty files * Use buffered file I/O to improve performance of deduplicator WARNING: this breaks compatibility with instances * Caching fragments before writing them to storage ## \[0.3.4] - 2024-03-15 * Fixed delete objects raising segmentation fault in entrypoint ## \[0.3.3] - 2024-03-15 * Fixed entity too small error in entrypoint ## \[0.3.2] - 2024-03-14 * Fixed cache usage * Object Metadata in bucket list response * More unit tests and fixes ## \[0.3.1] - 2024-03-14 * Implemented pagination for better download behaviour * Fixed potential locking issue in the worker pool * Reduced log messages to single line entries * Fixed computation of space savings for empty objects ## \[0.3.0] - 2024-03-13 * Fixed potential log corruption issue in deduplicator * Increase maximum storage service size * Logging of service requests * Add counter counting active connections ## \[0.2.1] - 2024-03-06 * Fix access violations in entrypoint and deduplicator * Fix memory leak in license validation * Fix double-free in MD5 checksum computation * Fix use-after-free in directory bucket deletion * Finalized multipart upload and pending deletion of multipart uploads * Propagate errors about missing downstream services in entrypoint ## \[0.2.0] - 2024-02-29 * Implement etcd-based service coordination * Use open-telemetry for metrics and log reporting * Implement basic licensing * Fix several stability and performance issues --- # Agent Instructions This documentation is published with GitBook. GitBook is the documentation platform designed so that both humans and AI agents can read, navigate, and reason over technical content effectively. Learn more at gitbook.com. ## Querying This Documentation If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question. Perform an HTTP GET request on the current page URL with the `ask` query parameter, and the optional `goal` query parameter: ``` GET https://docs.ultihash.io/reference/changelog/core-image.md?ask=&goal= ``` `ask` is the immediate question: it should be specific, self-contained, and written in natural language. `goal` is optional and describes the broader end goal you are ultimately trying to accomplish on behalf of the user. GitBook uses it to tailor the answer towards what is most useful for that goal. The response will contain a direct answer to the question and relevant excerpts and sources from the documentation. Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.