---
license: mit
language: en
pipeline_tag: text-generation
tags:
- video-understanding
- narrative-generation
- generative-ai
- multi-agent
- stateful-ai
- prompt-engineering
- found-protocol
- creator-economy
- data-sovereignty
- web3
base_model:
- google/gemini-pro-vision
- google/gemini-pro
datasets:
- FOUND-LABS/found_consciousness_log
---

<div align="center">
  <img src="https://res.cloudinary.com/dykojggih/image/upload/v1753377308/IMG_4287_imd6zd.png" width="100px" alt="FOUND LABS Logo">
  <h1>The FOUND Protocol</h1>
  <p><b>The Open-Source Engine for the Consciousness Economy</b></p>
  
  <div>
    <a href="https://huggingface.co/FOUND-LABS"><img src="https://img.shields.io/badge/Organization-FOUND%20LABS-purple" alt="Organization"></a>
    <a href="https://huggingface.co/FOUND-LABS/found_consciousness_log"><img src="https://img.shields.io/badge/Dataset-Consciousness%20Log-blue" alt="Dataset"></a>
    <a href="https://foundprotocol.xyz"><img src="https://img.shields.io/badge/Platform-Join%20Waitlist-brightgreen" alt="Join Waitlist"></a>
  </div>
</div>

---

## Abstract

Current video understanding models excel at semantic labeling but fail to capture the pragmatic and thematic progression of visual narratives. We introduce **FOUND (Forensic Observer and Unified Narrative Deducer)**, a novel, stateful architecture that demonstrates the ability to extract coherent emotional and thematic arcs from a sequence of disparate video inputs. This protocol serves as the foundational engine for the **[FOUND Platform](https://foundprotocol.xyz)**, a decentralized creator economy where individuals can own, control, and monetize their authentic human experiences as valuable AI training data.

---

## From Open-Source Research to a New Economy

The FOUND Protocol is more than an academic exercise; it is the core technology powering a new paradigm for the creator economy.

-   **The Problem:** AI companies harvest your data to train their models, reaping all the rewards. You, the creator of the data, get nothing.
-   **Our Solution:** The FOUND Protocol transforms your raw visual moments into structured, high-value data assets. Our upcoming **FOUND Platform** will allow you to contribute this data, maintain ownership via your own wallet, and earn from its usage by AI companies.

**This open-source model is the proof. The FOUND Platform is the promise.**

---

## Model Architecture

The FOUND Protocol is a composite **inference pipeline** designed to simulate a stateful consciousness. It comprises two specialized agents that interact in a continuous feedback loop:

-   **The Perceptor (`/dev/eye`):** A forensic analysis model (FOUND-1) responsible for transpiling raw visual data into a structured, symbolic JSON output.
-   **The Interpreter (`/dev/mind`):** A contextual state model (FOUND-2) that operates on the structured output of the Perceptor and the historical system log to resolve "errors" into emotional or thematic concepts.
-   **The Narrative State Manager:** A stateful object that maintains the "long-term memory" of the system, allowing its interpretations to evolve.

---

## How to Use This Pipeline

### 1. Setup

Clone this repository and install the required dependencies into a Python virtual environment.
```bash
git clone https://huggingface.co/FOUND-LABS/found_protocol
cd found_protocol
python3 -m venv venv
source venv/bin/activate
pip install -r requirements.txt
```

### 2. Configuration
Set your Google Gemini API key as an environment variable (e.g., in a .env file):
```
GEMINI_API_KEY="your-api-key-goes-here"
```

### 3. Usage via CLI
Analyze all videos in a directory sequentially:
```bash
python main.py path/to/your/video_directory/
```

## Future Development: The Path to the Platform
This open-source protocol is the first step in our public roadmap. The data it generates is the key to our future.
- **Dataset Growth:** We are using this protocol to build the found_consciousness_log, the world's first open dataset for thematic video understanding.
- **Model Sovereignty:** This dataset will be used to fine-tune our own open-source models (found-perceptor-v1 and found-interpreter-v1), removing the dependency on external APIs and creating a fully community-owned intelligence layer.
- **Platform Launch:** These sovereign models will become the core engine of the FOUND Platform, allowing for decentralized, low-cost data processing at scale.

➡️ Follow our journey and join the waitlist at foundprotocol.xyz

## Citing this Work
If you use the FOUND Protocol in your research, please use the following BibTeX entry.
```bibtex
@misc{found_protocol_2025,
  author       = {FOUND LABS Community},
  title        = {FOUND Protocol: A Symbiotic Dual-Agent Architecture for the Consciousness Economy},
  year         = {2025},
  publisher    = {Hugging Face},
  journal      = {Hugging Face repository},
  howpublished = {\url{https://huggingface.co/FOUND-LABS/found_protocol}}
}
```