Core image

[0.6.0] 2024-09-18

  • The storage service can now perform delete operations and reclaim disk space

  • Deduplicator and Entrypoint services are now making use of storage-level delete operations

  • Fix potential data corruption issue caused by deleting and re-uploading data

  • Partial implementation of erasure coding / storage groups

  • Partial implementation of authentication / policy support

[0.5.4] 2024-08-08

  • Support for object mime types

  • Improved handling of multipart uploads

  • Added support for using multiple working directories/storage devices to storage service

  • Added link/unlink interface to storage service, enabling deletion of unused data

[0.5.3] 2024-07-01

  • Several S3A compatibility fixes

[0.5.2] 2024-06-25

  • Increased waiting time for etcd to 5 minutes

[0.5.1] 2024-06-24

  • Improved compatibility level with S3 API

  • Fixed handling of XML-reserved characters in object keys

  • Added REST API for querying raw and effective size of data in the cluster

  • Fixed incorrect XML in S3 API responses

  • Fixed occasional application hangs, resulting in bad performance

  • Improved deduplication algorithm

  • More efficient storage usage by truncating unused spaces in files

[0.5.0] 2024-06-06

  • Removed support for S3 Outpost's GetBucket

  • Deduplication statistic collection

  • Improve API support for PySpark (copy object, head object, etc.)

  • Replace directory service with PostgreSQL

  • Stablize memory requirements for deduplication

  • Performance improvements for deduplication

[0.4.2] 2024-05-22

  • Fixed two bugs that result in poor deduplication

  • Support running as monolith

  • A few bug fixes in S3 API

  • Performance improvements

[0.4.1] 2024-04-26

  • Fixed a bug where data corruption could occur when using multiple deduplicator instances

  • Implemented asynchronous write support in storage service

  • Improved write throughput of storage service

  • Improved handling of command line arguments

  • Reduced memory footprint of entrypoint service

  • Fixed timeout issues when uploading large objects

  • Improved throughput of deduplicator service

  • Fixed formatting of timestamps in HTTP response

  • Fixed computation of ETAG

[0.4.0] 2024-03-26

  • Refactored data store, mostly lockless writes and completely lockless reads

  • Fixed a bug in the free spot manager

  • Fixed concurrency issue in directory service

  • Fix hanging server when requesting empty files

  • Use buffered file I/O to improve performance of deduplicator WARNING: this breaks compatibility with instances

  • Caching fragments before writing them to storage

[0.3.4] - 2024-03-15

  • Fixed delete objects raising segmentation fault in entrypoint

[0.3.3] - 2024-03-15

  • Fixed entity too small error in entrypoint

[0.3.2] - 2024-03-14

  • Fixed cache usage

  • Object Metadata in bucket list response

  • More unit tests and fixes

[0.3.1] - 2024-03-14

  • Implemented pagination for better download behaviour

  • Fixed potential locking issue in the worker pool

  • Reduced log messages to single line entries

  • Fixed computation of space savings for empty objects

[0.3.0] - 2024-03-13

  • Fixed potential log corruption issue in deduplicator

  • Increase maximum storage service size

  • Logging of service requests

  • Add counter counting active connections

[0.2.1] - 2024-03-06

  • Fix access violations in entrypoint and deduplicator

  • Fix memory leak in license validation

  • Fix double-free in MD5 checksum computation

  • Fix use-after-free in directory bucket deletion

  • Finalized multipart upload and pending deletion of multipart uploads

  • Propagate errors about missing downstream services in entrypoint

[0.2.0] - 2024-02-29

  • Implement etcd-based service coordination

  • Use open-telemetry for metrics and log reporting

  • Implement basic licensing

  • Fix several stability and performance issues

Last updated