
Palo Alto, California /Mysten Labs/ – Mysten Labs, a team of leading distributed systems, programming languages, and cryptography experts and originators of the Sui Network, today announced a landmark achievement in scaling blockchain capacity. During testing and development in a Sui blockchain environment, Pilotfish, a prototype Sui extension, increased throughput by 8x when backed by 8 machines, successfully illustrating the possibility of linear scaling. Notably, the latency per transaction decreased as more machines were added during the test, proving the viability of linear horizontal scaling for low latency blockchain transactions for the first time ever on any blockchain.
This proof-of-concept, was formally presented as an academic preprint titled “Pilotfish: Distributed Transaction Execution for Lazy Blockchains”, and initially shared on January 29, 2024 as an article on the open access archive arXiv.
Lefteris Kokoris-Kogias, one of the authors of the paper and researcher at Mysten Labs, said:
“Pilotfish is a game changer as the blockchain industry seeks to achieve the same dynamic capacity increase currently possible only with centralized server technologies. Pilotfish has the potential to push throughput well beyond what is currently at the forefront of high-performance blockchains, enabling transaction throughput levels no other blockchain existing today can achieve.”
Sui leads the industry in throughput by leveraging multiple cores for parallel transaction execution within individual validators. Using this approach, within months following mainnet, Sui reached 65.8 million transaction executions in a single day – the most of any blockchain ever. However, a single machine can only incorporate a finite number of cores, so throughput gains via this strategy are limited. Moreover, the machines capable of accommodating large numbers of cores are expensive to buy and use. The breakthrough solution that Pilotfish offers enables a single validator to employ multiple servers simultaneously. This new technology not only makes elastic capacity possible, but its auto-scaling architecture, akin to centralized solutions like AWS or Heroku, allows the use of smaller, cheaper servers available on demand.
Nearly all other blockchains aiming to scale use some form of batching – grouping transactions together to be added all at once. The downside of this method is significant additional latency. Instead of transactions moving directly to finality, they are delayed waiting for others to be batched for execution with them. Unlike these other scaling solutions, Pilotfish achieves potentially linear throughput scaling without increasing latency. In the simplest terms, with the horizontal scaling enabled by Pilotfish, simply by engaging the requisite number of machines, a validator can adapt its throughput and resource use to the use case at hand.
Alberto Sonnino, a research scientist at Mysten Labs, said:
“Until now the only option to increase a validator’s capacity has been to upgrade to a more powerful machine. Pilotfish removes that constraint, making possible horizontal scaling by simply adding servers and without delaying execution. With Pilotfish, the question is no longer whether a level of throughput is possible, only how many servers it will require.”
Pilotfish achieves its remarkable scalability by enabling a single validator to execute transactions across multiple machines. Specifically, Pilotfish partitions the validation function into three key roles:
In experimental results, Pilotfish has already achieved remarkable results in terms of linear scaling, low latency, and support for various workloads. In testing, Pilotfish reduced network response times and maintained a latency envelope below 20ms. Future plans include enhancements like multiple SequencingWorkers, shard replication, and ultra-fast networking.
Disclaimer: This publication is sponsored. Coinspeaker does not endorse or assume responsibility for the content, accuracy, quality, advertising, products, or other materials on this web page. Readers are advised to conduct their own research before engaging with any company mentioned. Please note that the featured information is not intended as, and shall not be understood or construed as legal, tax, investment, financial, or other advice. Nothing contained on this web page constitutes a solicitation, recommendation, endorsement, or offer by Coinspeaker or any third party service provider to buy or sell any cryptoassets or other financial instruments. Crypto assets are a high-risk investment. You should consider whether you understand the possibility of losing money due to leverage. None of the material should be considered as investment advice. Coinspeaker shall not be held liable, directly or indirectly, for any damages or losses arising from the use or reliance on any content, goods, or services featured on this web page.