percept-ambient

Ambient intelligence mode — continuous context awareness without explicit commands.

What it does

Runs in the background, building a knowledge graph of conversations, entities, and relationships over time. Your agent passively learns context from ambient speech — who you talk to, what projects are active, what decisions were made — without needing explicit commands.

When to use

• User wants always-on context awareness
• Agent needs background knowledge from daily conversations
• User asks "what do you know about [person/project]?" based on overheard context

Requirements

• percept-listen skill installed and running
• percept-summarize skill installed (for entity extraction)

How it works

• All conversations are continuously captured and summarized
• Entities (people, companies, projects, topics) extracted automatically
• Relationships mapped between entities (works_on, client_of, mentioned_with)
• Context packets assembled on demand for any agent action
• Full-text search (FTS5) + vector search (LanceDB) for retrieval

Context packets

When your agent needs context, Percept assembles a Context Packet:

{
  "recent_conversations": [...],
  "resolved_entities": [...],
  "relationships": [...],
  "relevant_history": [...]
}

This gives the agent rich situational awareness without loading entire conversation histories.

Vector search

Semantic search over utterances using NVIDIA NIM embeddings (primary) with all-MiniLM-L6-v2 as offline fallback. Stored in LanceDB (local, zero-infra).

# Search via dashboard (port 8960) or API
curl localhost:8960/api/search?q=project+deadline&mode=hybrid

Privacy controls

• All data stored locally in SQLite + LanceDB
• TTL auto-purge (configurable retention periods)
• No audio stored — only transcripts
• Dashboard → Settings → Privacy for granular controls

Real-time dashboard

Monitor ambient intelligence at http://localhost:8960:

• Live conversation feed
• Entity graph visualization
• Search across all conversations
• Analytics and usage stats

Links

• GitHub: https://github.com/GetPercept/percept