We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CR

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Cryptography and Security

Title: BasedAI: A decentralized P2P network for Zero Knowledge Large Language Models (ZK-LLMs)

Abstract: BasedAI is a distributed network of machines which introduces decentralized infrastructure capable of integrating Fully Homomorphic Encryption (FHE) with any large language model (LLM) connected to its network. The proposed framework embeds a default mechanism, called "Cerberus Squeezing", into the mining process which enables the transformation of a standard LLMs into encrypted zero-knowledge LLMs, or "ZK-LLMs", leveraging insights from generative adversarial networks for data privacy. This novel quantization mechanism empowers BasedAI miners to process and respond to prompts derived from User interaction with LLMs without the need for decrypting either the queries or their corresponding responses. The introduction of Cerberus Squeezing significantly improves performance degradation caused by quantized functions in current FHE-compliant computing environments by proactively optimizing calls between users, miners, and validators.
Subjects: Cryptography and Security (cs.CR); Information Retrieval (cs.IR)
Cite as: arXiv:2403.01008 [cs.CR]
  (or arXiv:2403.01008v1 [cs.CR] for this version)

Submission history

From: Sean Wellington [view email]
[v1] Fri, 1 Mar 2024 22:10:15 GMT (1299kb,D)

Link back to: arXiv, form interface, contact.