Vapora/scripts/sync-tracking.nu

126 lines
3.6 KiB
Plaintext
Raw Permalink Normal View History

feat: Phase 5.3 - Multi-Agent Learning Infrastructure Implement intelligent agent learning from Knowledge Graph execution history with per-task-type expertise tracking, recency bias, and learning curves. ## Phase 5.3 Implementation ### Learning Infrastructure (✅ Complete) - LearningProfileService with per-task-type expertise metrics - TaskTypeExpertise model tracking success_rate, confidence, learning curves - Recency bias weighting: recent 7 days weighted 3x higher (exponential decay) - Confidence scoring prevents overfitting: min(1.0, executions / 20) - Learning curves computed from daily execution windows ### Agent Scoring Service (✅ Complete) - Unified AgentScore combining SwarmCoordinator + learning profiles - Scoring formula: 0.3*base + 0.5*expertise + 0.2*confidence - Rank agents by combined score for intelligent assignment - Support for recency-biased scoring (recent_success_rate) - Methods: rank_agents, select_best, rank_agents_with_recency ### KG Integration (✅ Complete) - KGPersistence::get_executions_for_task_type() - query by agent + task type - KGPersistence::get_agent_executions() - all executions for agent - Coordinator::load_learning_profile_from_kg() - core KG→Learning integration - Coordinator::load_all_learning_profiles() - batch load for multiple agents - Convert PersistedExecution → ExecutionData for learning calculations ### Agent Assignment Integration (✅ Complete) - AgentCoordinator uses learning profiles for task assignment - extract_task_type() infers task type from title/description - assign_task() scores candidates using AgentScoringService - Fallback to load-based selection if no learning data available - Learning profiles stored in coordinator.learning_profiles RwLock ### Profile Adapter Enhancements (✅ Complete) - create_learning_profile() - initialize empty profiles - add_task_type_expertise() - set task-type expertise - update_profile_with_learning() - update swarm profiles from learning ## Files Modified ### vapora-knowledge-graph/src/persistence.rs (+30 lines) - get_executions_for_task_type(agent_id, task_type, limit) - get_agent_executions(agent_id, limit) ### vapora-agents/src/coordinator.rs (+100 lines) - load_learning_profile_from_kg() - core KG integration method - load_all_learning_profiles() - batch loading for agents - assign_task() already uses learning-based scoring via AgentScoringService ### Existing Complete Implementation - vapora-knowledge-graph/src/learning.rs - calculation functions - vapora-agents/src/learning_profile.rs - data structures and expertise - vapora-agents/src/scoring.rs - unified scoring service - vapora-agents/src/profile_adapter.rs - adapter methods ## Tests Passing - learning_profile: 7 tests ✅ - scoring: 5 tests ✅ - profile_adapter: 6 tests ✅ - coordinator: learning-specific tests ✅ ## Data Flow 1. Task arrives → AgentCoordinator::assign_task() 2. Extract task_type from description 3. Query KG for task-type executions (load_learning_profile_from_kg) 4. Calculate expertise with recency bias 5. Score candidates (SwarmCoordinator + learning) 6. Assign to top-scored agent 7. Execution result → KG → Update learning profiles ## Key Design Decisions ✅ Recency bias: 7-day half-life with 3x weight for recent performance ✅ Confidence scoring: min(1.0, total_executions / 20) prevents overfitting ✅ Hierarchical scoring: 30% base load, 50% expertise, 20% confidence ✅ KG query limit: 100 recent executions per task-type for performance ✅ Async loading: load_learning_profile_from_kg supports concurrent loads ## Next: Phase 5.4 - Cost Optimization Ready to implement budget enforcement and cost-aware provider selection.
2026-01-11 13:03:53 +00:00
#!/usr/bin/env nu
# sync-tracking.nu - Synchronize tracking data from all projects to central database
# Follows NuShell 0.108+ guidelines with explicit types and Rule 17 string interpolation
def main [
--projects-dir: string = "/Users/Akasha" # No bool type annotation (Rule!)
--verbose = false
--dry-run = false
]: void {
if $verbose {
print "🔄 Starting tracking sync..."
print $"📁 Scanning projects in: [$projects_dir]"
}
# Rule 3: Early validation
if not ($projects_dir | path exists) {
print $"❌ Error: Projects directory [$projects_dir] not found"
return
}
# Find all .coder directories
let coder_projects = (
ls $projects_dir --all --recursive
| where type == "dir"
| where name == ".coder"
| get parent_path
)
if ($coder_projects | length) == 0 {
print "⚠️ No .coder directories found"
return
}
print $"✅ Found (($coder_projects | length)) projects to sync"
# Rule 1: Single purpose - process each project
let total_synced = (
$coder_projects
| each { |project_path|
sync-project $project_path $verbose $dry_run
}
| math sum
)
print $"
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━
✅ Sync Complete
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━
📊 Total entries synced: ($total_synced)
⏱️ Timestamp: (date now | format date '%Y-%m-%d %H:%M:%S UTC')
"
}
# Rule 1: Single purpose - only syncs one project
def sync-project [project-path: string, verbose: bool, dry-run: bool]: int {
# Rule 3: Early return validation
if not ($project-path | path exists) {
if $verbose {
print $"⚠️ Skipping [$project-path] - not found"
}
return 0
}
# Rule 17: ($expr) for expressions, [$var] for variables
let changes-file = $"[$project-path]/.coder/changes.md"
let todo-file = $"[$project-path]/.coder/todo.md"
let mut synced = 0
# Process changes.md
if ($changes-file | path exists) {
if $verbose {
print $"📝 Syncing changes from [$changes-file]"
}
if not $dry_run {
let result = (
curl --silent --request POST "http://localhost:3000/api/v1/tracking/sync" \
--header "Content-Type: application/json" \
--data {
project: $project-path
type: "changes"
file: $changes-file
} | to json
)
if ($result | has "error") {
print $"❌ Error syncing changes: ($result.error)"
} else {
$synced = ($synced + 1)
}
}
}
# Process todo.md
if ($todo-file | path exists) {
if $verbose {
print $"📝 Syncing todos from [$todo-file]"
}
if not $dry_run {
let result = (
curl --silent --request POST "http://localhost:3000/api/v1/tracking/sync" \
--header "Content-Type: application/json" \
--data {
project: $project-path
type: "todos"
file: $todo-file
} | to json
)
if ($result | has "error") {
print $"❌ Error syncing todos: ($result.error)"
} else {
$synced = ($synced + 1)
}
}
}
if $verbose {
print $"✅ Synced [$project-path]"
}
$synced
}