Arweave 2.8.0 version: Hard fork started on November 13th. What does this update bring?

Author: Kyle

Reviewer: Sandy

Source: Content Guild - News

At the Arweave Asia 2024 conference held in Singapore on September 19, 2024, Arweave/AO founder Sam previewed the upcoming Arweave 2.8.0 version update . On October 17, the official documentation for this version was finally released.

Arweave plans to activate version 2.8.0 at block height 1547120 at 14:00 UTC (22:00 Beijing time) on November 13, 2024. This update includes a composite packaging mechanism, block header format adjustment, price mechanism optimization, and performance improvements , aiming to improve network efficiency, reduce resource consumption, and enhance system stability. Next, we will explain the highlights of this update in detail.

Arweave 2.8.0 major updates

1. Composite Packaging Mechanism - A More Efficient Mining Method

Arweave 2.8.0 introduces Composite Packing , which allows miners to reduce the hard disk read rate , make full use of large-capacity hard disks for mining, and reduce dependence on high-performance storage devices. This mechanism brings a more "flexible and refined" mining method:

• Multi-level packaging difficulty (1-32) support : Miners can choose different difficulties (1 to 32). The higher the difficulty, the longer it takes to package the data, but it reduces the hard disk reading speed requirements.
• Block splitting and hashing : Each composite block will be split into 32 sub-blocks , and the RandomX algorithm will be used to gradually complete the packaging. All storage modules must follow a unified packaging format and rules to ensure fairness under different difficulties and prevent rule loopholes.

This mechanism allows miners to independently choose the most appropriate mining method based on the conditions of storage devices and power resources, thereby extending the life of the hard disk and reducing energy consumption, and improving the flexibility and efficiency of mining.

2. Block header format optimization - more flexible data structure

In conjunction with the adjustment of the packaging mechanism, Arweave 2.8.0 version optimizes the block header structure to improve adaptability and storage efficiency to different packaging formats. This update adds multiple fields and optimizes the storage method of the block header.

• New packing_difficulty field : records the packing difficulty of the block, helping the network track the packing format and complexity of each block.
• Optimize poa1 and poa2 fields : adjust the storage methods for the old format (spora_2_6) and the composite packaging format respectively - the old format retains complete data, while the new format reduces redundant data and only stores part of the packaging information.
• New unpacked_chunk_hash field : used to store the hash value of unpacked data to ensure data integrity and prevent tampering.

3. Optimizing the pricing mechanism: smarter and more transparent pricing

Arweave 2.8.0 updates the storage pricing mechanism to further promote the decentralization of price management. The main changes are:

• Introducing a trustless oracle system: Starting from block height 1551470 , the upload price will be automatically calculated and managed by a trustless oracle system, reducing human intervention and improving transparency and fairness.
• Extend the historical data reference period : The storage price is calculated based on 3 months of historical data instead of the previous 1 month, avoiding the impact of short-term market fluctuations and ensuring that prices are more stable and predictable.

4. Performance optimization and bug fixes: Improving synchronization speed and system stability

This update also makes multiple optimizations to the database and node synchronization, significantly improving the system's operating efficiency and reliability, and fixing some known issues:

• Database optimization : We optimized the core database RocksDB to solve the database corruption problem. At the same time, we removed the repair_rocksdb function and improved the stability of the database.
• Improved blockchain synchronization speed : By improving the synchronization mechanism of blocks and transaction headers, the node synchronization time of new devices is greatly shortened, allowing nodes to access the network faster.
• API bug fix : Fixed the issue with the /data_sync_record interface returning deleted block data to avoid data confusion and false positives.

What does Sam specifically mean by “resource usage reduced by more than 75%”?

Although I cannot independently calculate the specific reduction in resource usage, from the updated content of the protocol, the following aspects can indeed effectively reduce resource overhead:

• High-difficulty packaging reduces disk read frequency : Higher packaging difficulty reduces frequent data reads, extends hard disk life, and reduces equipment depreciation and power consumption.
• Synchronization optimization reduces device operation time : The improved synchronization mechanism shortens the node synchronization time and reduces the power required for long-term operation of the device.
• The RandomX algorithm improves computing efficiency : the new algorithm requires 3,500 HugePages (about 7 GB of memory) to be reserved, which optimizes memory access speed and mining performance. Although the RandomX algorithm is more dependent on CPU performance, it achieves more efficient resource utilization by reducing the hard disk read burden.

Therefore, "resource usage reduction" is mainly reflected in the following aspects: reducing the pressure on storage devices, shortening the time required for node operation, and improving the efficiency of CPU and memory usage.

Summarize

After more than six years of operation and more than ten version iterations, Arweave has developed into a stable and reliable decentralized storage network. However, as market demand and user scenarios continue to change, the network still needs to be continuously optimized. The Arweave 2.8.0 version update not only improves the user experience, but also provides miners with a more flexible way to participate.

For users , this update brings:

• A fairer price system : Through the oracle system and historical data reference, prices become more transparent and stable.
• Faster network synchronization : Nodes can quickly access the network, shorten waiting time, and improve user experience.

For miners , the new version provides a more flexible and energy-efficient way of mining, while introducing some new requirements:

• The composite packaging mechanism reduces the burden on equipment : large-capacity hard drives can also mine efficiently, reducing equipment loss and electricity costs.
• Multi-level difficulty selection : miners can flexibly adjust strategies according to resources to adapt to different mining conditions.
• Higher system stability : synchronization speed is improved, database corruption issues are resolved, and maintenance costs are reduced.
• New hardware requirements : Enabling the RandomX algorithm requires reserving 3,500 HugePages , which is 2,500 more than the older version. Miners need to prepare in advance.
• Time node reminder : Before block height 1547120 (November 13, 2024), miners can only complete the preparation work, and the official mining needs to wait for the hard fork to be activated before it can start.

Each version upgrade of Arweave is driving the network towards a more efficient and decentralized direction. In the future, as the ecosystem thrives and new features are continuously introduced, Arweave will continue to meet the needs of users and miners and maintain the vitality and resilience of the network.