CESS Technology Monthly Report | Progress in November 2023

1. Important Submissions, Modifications, and Releases

Blockchain Network

The CESS Testnet v0.7.4 consists of consensus nodes and storage nodes. Consensus nodes maintain the global state of the CESS network (by CESS Node) and serve as "data certification stations" in the CESS network (by TEE Worker). Storage nodes are responsible for providing verifiable storage space and act as the "data storage pool" in the CESS network. Here are the progress updates for this month:

1. Consensus Nodes [v0.7.4]

• Added a feature for users to pay for purchasing space on the chain network, providing strong support for future application layer functionality expansion.

• Upgraded the on-chain storage node registration process to enhance the security of the storage network.

• Updated the parameter configuration related to random challenges in the chain network to reduce the occurrence of nodes failing challenges due to insufficient time.

• Adjusted the frequency of initiating random challenges in the chain network to alleviate the workload on storage nodes and TEE Workers.

• Optimized the file upload functionality of the chain network, which will effectively improve the efficiency of user file persistence to storage nodes.

• Implemented a file fragment tagging feature in the chain network for precise management of file fragments.

• Optimized the code structure of the chain network, streamlined the metadata of storage orders, and reduced the storage burden on the blockchain.

• Completed the integration and testing of the multi-signature feature in the chain network.

• Upgraded the user payment feature for purchasing space on the chain network, allowing users to customize the order expiration time.

• Fixed a data overflow issue that occurred when operating the file bloom filter (used to record stored user files) in the chain network.

• Resolved an issue that caused inaccurate global computing power calculations due to errors when processing offline node locked spaces in the chain network.

• Fixed a problem where the scheduled task for calculating service file tags in the file upload process of the chain network failed to execute properly.

• Completed the optimization and upgrade of the TEE Worker network architecture, separating it from the p2p network for easier future maintenance and upgrades.

• Transferred the registration process of TEE Workers from Kaleido to the rotator program, reducing unnecessary performance overhead.

• Added validation features to various service interfaces of TEE Workers to intercept invalid requests.

• Optimized the TEE Worker log module to make logs clearer and more concise, and added the display of execution times for various services.

• Implemented and optimized the illegal request interception feature for the TEE Worker service file tag calculation service.

• Completed the upgrade of the TEE Worker idle space proof module, enabling the verification method to support thread-safe concurrent operations.

• Fixed an issue where idle space could not be certified due to parameter calculation errors in TEE Workers.

• Developed a stress testing tool for TEE Workers to expose potential issues under high-pressure conditions.

2. Storage Nodes [v0.7.5]

• Fixed an issue where storage nodes could not pass random challenges due to service data being incorrectly deleted.

• Resolved exceptions occurring when some storage nodes retrieved external IPs.

• Completed the upgrade of the storage space expansion feature for storage nodes, supporting the simultaneous increase of corresponding pledged amounts during expansion.

• Fixed an issue where the idle space certification process for storage nodes was blocked due to network failures.

• Based on the new file upload mechanism, completed the reporting functionality for stored user files in storage nodes.

• Fixed an issue where storage nodes could not obtain idle space proof keys from TEE Workers.

• Completed the upgrade of the interaction process between storage nodes and TEE Workers, using a dedicated network to improve data transmission efficiency.

• Fixed conflicts in protobuf data types that occurred in the libp2p library of storage nodes.

• Updated the gRPC methods for communication with TEE Workers in the storage node p2p-go library, resolving network connection failures.

• Fixed an issue where the idle space proof recovery module of storage nodes failed to read data.

• Fixed an address resolution failure issue when storage nodes requested idle space proof keys from TEE Workers.

• Fixed an issue where storage nodes could not pass random challenges due to not completing service file tag calculations on time.

• Fixed an issue where idle space could not be certified due to inconsistent signature data in storage nodes.

• Fixed an issue where the idle space proof module lock in storage nodes was occupied, preventing the program from performing other tasks.

Products

CESS is committed to providing practical storage services and CDN services for Web3, meeting large-scale commercial storage needs and achieving millisecond-level data retrieval and return. CESS pioneered decentralized object storage services (DeOSS), and the product ecosystem of the CESS network is gradually becoming richer and more prosperous. It has currently incubated innovative applications such as online file sharing tools (DeShare), public chain snapshot storage services, and CESS cloud storage. You are welcome to experience them. Here are the progress updates for this month:

1. Object Storage Service (DeOSS)

• Completed the development of the whitelist and blacklist feature for the DeOSS gateway, allowing users to customize access policies for the DeOSS gateway.

• Completed updates to the data structures and transaction processes related to node registration in the Go SDK to accommodate future upgrades.

• Completed the upgrade of the DeOSS file upload process, supporting the selection of the most efficient storage node by the DeOSS gateway for storing user files.

• Removed data transfer restrictions from the DeOSS ShareSwap mechanism, enhancing data sharing efficiency between DeOSS gateways.

• Fixed version conflict issues that occurred when using the p2p-go library in DeOSS.

• Fixed signature verification failures when uploading files using the JS SDK.

• Resolved compatibility issues between ShareSwap and the p2p-go library.

• Completed testing for the DeOSS ShareSwap feature, which is now ready for normal delivery and use.

• Completed testing for the new file upload process in DeOSS, ensuring that uploaded files can be efficiently and accurately stored in various storage nodes.

2. Online File Sharing Tool (DeShare)

• Implemented the feature in DeShare that allows users to send file information to their email.

• Completed the upgrade of the file information display feature in DeShare, supporting the display of more detailed information such as file names.

2. Technical Solution Discussion

• Proposed Technical Solution for "File Upload Module Code Refactoring"

This month, the technical team proposed a technical solution for "File Upload Module Code Refactoring" due to the increasing complexity of the current file upload process, which leads to higher development costs for subsequent version iterations. This plan has been discussed and confirmed by the community and will be implemented in future versions.

3. Technical Documentation Reference

GitHub: https://github.com/CESSProject

GitBook: https://docs.cess.cloud/core/

CIPs: https://github.com/CESSProject/CIPs