Performance optimization

Optimizing performance is critical when working with large datasets or high-throughput environments. This section provides tips and best practices for enhancing the performance of UltiHash, ensuring that it can handle demanding workloads efficiently.

Upload and download data in multiple threads

To speed up data upload and download, do it in multiple threads. Below are the examples how it should be done:

• Uploading Data (uh_upload.py) https://github.com/UltiHash/scripts/tree/main/boto3/multithread_upload

# Example: Upload a folder to a bucket on UltiHash
python3 uh_upload.py --url <https://ultihash> --bucket mybucket folder/

• Downloading Data (uh_download.py) https://github.com/UltiHash/scripts/tree/main/boto3/multithread_download

# Example: Download a bucket from UltiHash
python3 uh_download.py --url <https://ultihash> --path local-folder mybucket