2026-01-14 02:00:23 +00:00
|
|
|
use std
|
feat(core): three-layer DAG, unified component arch, commands-registry cache, Nushell 0.112.2 migration
- DAG architecture: `dag show/validate/export` (nulib/main_provisioning/dag.nu),
config loader (lib_provisioning/config/loader/dag.nu), taskserv dag-executor.
Backed by schemas/lib/dag/*.ncl; orchestrator emits NATS events via
WorkspaceComposition::into_workflow. See ADR-020, ADR-021.
- Unified Component Architecture: components/mod.nu, main_provisioning/
{components,workflow,extensions,ontoref-queries}.nu. Full workflow engine with
topological sort and NATS subject emission. Blocks A-H complete (libre-daoshi).
- Commands-registry: nulib/commands-registry.ncl (Nickel source, 314 lines) +
JSON cache at ~/.cache/provisioning/commands-registry.json rebuilt on source
change. cli/provisioning fast-path alias expansion avoids cold Nu startup.
ADDING_COMMANDS.md documents new-command workflow.
- Platform service manager: service-manager.nu (+573), startup.nu (+611),
service-check.nu (+255); autostart/bootstrap/health/target refactored.
- Nushell 0.112.2 migration: removed all try/catch and bash redirections;
external commands prefixed with ^; type signatures enforced. Driven by
scripts/refactor-try-catch{,-simplified}.nu.
- TTY stack: removed shlib/*-tty.sh; replaced by cli/tty-dispatch.sh,
tty-filter.sh, tty-commands.conf.
- New domain modules: images/ (golden image lifecycle), workspace/{state,sync}.nu,
main_provisioning/{bootstrap,cluster-deploy,fip,state}.nu, commands/{state,
build,integrations/auth,utilities/alias}.nu, platform.nu expanded (+874).
- Config loader overhaul: loader/core.nu slimmed (-759), cache/core.nu
refactored (-454), removed legacy loaders/file_loader.nu (-330).
- Thirteen new provisioning-<domain>.nu top-level modules for bash dispatcher.
- Tests: test_workspace_state.nu (+351); updates to test_oci_registry,
test_services.
- README + CHANGELOG updated.
2026-04-17 04:27:33 +01:00
|
|
|
# REMOVED: use ../lib_provisioning * - causes circular import (already loaded by main provisioning script)
|
2026-01-14 02:00:23 +00:00
|
|
|
use ../lib_provisioning/platform *
|
feat(core): three-layer DAG, unified component arch, commands-registry cache, Nushell 0.112.2 migration
- DAG architecture: `dag show/validate/export` (nulib/main_provisioning/dag.nu),
config loader (lib_provisioning/config/loader/dag.nu), taskserv dag-executor.
Backed by schemas/lib/dag/*.ncl; orchestrator emits NATS events via
WorkspaceComposition::into_workflow. See ADR-020, ADR-021.
- Unified Component Architecture: components/mod.nu, main_provisioning/
{components,workflow,extensions,ontoref-queries}.nu. Full workflow engine with
topological sort and NATS subject emission. Blocks A-H complete (libre-daoshi).
- Commands-registry: nulib/commands-registry.ncl (Nickel source, 314 lines) +
JSON cache at ~/.cache/provisioning/commands-registry.json rebuilt on source
change. cli/provisioning fast-path alias expansion avoids cold Nu startup.
ADDING_COMMANDS.md documents new-command workflow.
- Platform service manager: service-manager.nu (+573), startup.nu (+611),
service-check.nu (+255); autostart/bootstrap/health/target refactored.
- Nushell 0.112.2 migration: removed all try/catch and bash redirections;
external commands prefixed with ^; type signatures enforced. Driven by
scripts/refactor-try-catch{,-simplified}.nu.
- TTY stack: removed shlib/*-tty.sh; replaced by cli/tty-dispatch.sh,
tty-filter.sh, tty-commands.conf.
- New domain modules: images/ (golden image lifecycle), workspace/{state,sync}.nu,
main_provisioning/{bootstrap,cluster-deploy,fip,state}.nu, commands/{state,
build,integrations/auth,utilities/alias}.nu, platform.nu expanded (+874).
- Config loader overhaul: loader/core.nu slimmed (-759), cache/core.nu
refactored (-454), removed legacy loaders/file_loader.nu (-330).
- Thirteen new provisioning-<domain>.nu top-level modules for bash dispatcher.
- Tests: test_workspace_state.nu (+351); updates to test_oci_registry,
test_services.
- README + CHANGELOG updated.
2026-04-17 04:27:33 +01:00
|
|
|
use ../lib_provisioning/config/accessor.nu *
|
2025-10-07 10:32:04 +01:00
|
|
|
|
2026-01-14 02:00:23 +00:00
|
|
|
# Taskserv workflow definitions
|
2025-10-07 10:32:04 +01:00
|
|
|
|
2026-01-14 02:00:23 +00:00
|
|
|
def get-orchestrator-url [--orchestrator: string = ""] {
|
|
|
|
|
if ($orchestrator | is-not-empty) {
|
|
|
|
|
return $orchestrator
|
2025-10-07 10:32:04 +01:00
|
|
|
}
|
feat(core): three-layer DAG, unified component arch, commands-registry cache, Nushell 0.112.2 migration
- DAG architecture: `dag show/validate/export` (nulib/main_provisioning/dag.nu),
config loader (lib_provisioning/config/loader/dag.nu), taskserv dag-executor.
Backed by schemas/lib/dag/*.ncl; orchestrator emits NATS events via
WorkspaceComposition::into_workflow. See ADR-020, ADR-021.
- Unified Component Architecture: components/mod.nu, main_provisioning/
{components,workflow,extensions,ontoref-queries}.nu. Full workflow engine with
topological sort and NATS subject emission. Blocks A-H complete (libre-daoshi).
- Commands-registry: nulib/commands-registry.ncl (Nickel source, 314 lines) +
JSON cache at ~/.cache/provisioning/commands-registry.json rebuilt on source
change. cli/provisioning fast-path alias expansion avoids cold Nu startup.
ADDING_COMMANDS.md documents new-command workflow.
- Platform service manager: service-manager.nu (+573), startup.nu (+611),
service-check.nu (+255); autostart/bootstrap/health/target refactored.
- Nushell 0.112.2 migration: removed all try/catch and bash redirections;
external commands prefixed with ^; type signatures enforced. Driven by
scripts/refactor-try-catch{,-simplified}.nu.
- TTY stack: removed shlib/*-tty.sh; replaced by cli/tty-dispatch.sh,
tty-filter.sh, tty-commands.conf.
- New domain modules: images/ (golden image lifecycle), workspace/{state,sync}.nu,
main_provisioning/{bootstrap,cluster-deploy,fip,state}.nu, commands/{state,
build,integrations/auth,utilities/alias}.nu, platform.nu expanded (+874).
- Config loader overhaul: loader/core.nu slimmed (-759), cache/core.nu
refactored (-454), removed legacy loaders/file_loader.nu (-330).
- Thirteen new provisioning-<domain>.nu top-level modules for bash dispatcher.
- Tests: test_workspace_state.nu (+351); updates to test_oci_registry,
test_services.
- README + CHANGELOG updated.
2026-04-17 04:27:33 +01:00
|
|
|
if ($env.PROVISIONING_ORCHESTRATOR_URL? | is-not-empty) {
|
|
|
|
|
return $env.PROVISIONING_ORCHESTRATOR_URL
|
2025-10-07 10:32:04 +01:00
|
|
|
}
|
feat(core): three-layer DAG, unified component arch, commands-registry cache, Nushell 0.112.2 migration
- DAG architecture: `dag show/validate/export` (nulib/main_provisioning/dag.nu),
config loader (lib_provisioning/config/loader/dag.nu), taskserv dag-executor.
Backed by schemas/lib/dag/*.ncl; orchestrator emits NATS events via
WorkspaceComposition::into_workflow. See ADR-020, ADR-021.
- Unified Component Architecture: components/mod.nu, main_provisioning/
{components,workflow,extensions,ontoref-queries}.nu. Full workflow engine with
topological sort and NATS subject emission. Blocks A-H complete (libre-daoshi).
- Commands-registry: nulib/commands-registry.ncl (Nickel source, 314 lines) +
JSON cache at ~/.cache/provisioning/commands-registry.json rebuilt on source
change. cli/provisioning fast-path alias expansion avoids cold Nu startup.
ADDING_COMMANDS.md documents new-command workflow.
- Platform service manager: service-manager.nu (+573), startup.nu (+611),
service-check.nu (+255); autostart/bootstrap/health/target refactored.
- Nushell 0.112.2 migration: removed all try/catch and bash redirections;
external commands prefixed with ^; type signatures enforced. Driven by
scripts/refactor-try-catch{,-simplified}.nu.
- TTY stack: removed shlib/*-tty.sh; replaced by cli/tty-dispatch.sh,
tty-filter.sh, tty-commands.conf.
- New domain modules: images/ (golden image lifecycle), workspace/{state,sync}.nu,
main_provisioning/{bootstrap,cluster-deploy,fip,state}.nu, commands/{state,
build,integrations/auth,utilities/alias}.nu, platform.nu expanded (+874).
- Config loader overhaul: loader/core.nu slimmed (-759), cache/core.nu
refactored (-454), removed legacy loaders/file_loader.nu (-330).
- Thirteen new provisioning-<domain>.nu top-level modules for bash dispatcher.
- Tests: test_workspace_state.nu (+351); updates to test_oci_registry,
test_services.
- README + CHANGELOG updated.
2026-04-17 04:27:33 +01:00
|
|
|
config-get "platform.orchestrator.url" "http://localhost:9011"
|
2026-01-14 02:00:23 +00:00
|
|
|
}
|
2025-10-07 10:32:04 +01:00
|
|
|
|
2026-01-14 02:00:23 +00:00
|
|
|
# Detect if orchestrator URL is local (for plugin usage)
|
|
|
|
|
def use-local-plugin [orchestrator_url: string] {
|
|
|
|
|
# Check if it's a local endpoint
|
|
|
|
|
(detect-platform-mode $orchestrator_url) == "local"
|
|
|
|
|
}
|
|
|
|
|
export def taskserv_workflow [
|
|
|
|
|
taskserv: string # Taskserv name
|
|
|
|
|
operation: string # Operation: create, delete, generate, check-updates
|
|
|
|
|
infra?: string # Infrastructure target
|
|
|
|
|
settings?: string # Settings file path
|
|
|
|
|
--check (-c) # Check mode only
|
|
|
|
|
--wait (-w) # Wait for completion
|
|
|
|
|
--orchestrator: string = "" # Orchestrator URL (optional, uses platform config if not provided)
|
|
|
|
|
] {
|
|
|
|
|
let orch_url = (get-orchestrator-url --orchestrator=$orchestrator)
|
|
|
|
|
let workflow_data = {
|
|
|
|
|
taskserv: $taskserv,
|
|
|
|
|
operation: $operation,
|
|
|
|
|
infra: ($infra | default ""),
|
|
|
|
|
settings: ($settings | default ""),
|
|
|
|
|
check_mode: $check,
|
|
|
|
|
wait: $wait
|
2025-12-11 21:57:05 +00:00
|
|
|
}
|
|
|
|
|
|
2026-01-14 02:00:23 +00:00
|
|
|
# Submit to orchestrator
|
|
|
|
|
let response = (http post $"($orch_url)/workflows/taskserv/create" --content-type "application/json" ($workflow_data | to json))
|
2025-12-11 21:57:05 +00:00
|
|
|
|
2026-01-14 02:00:23 +00:00
|
|
|
if not ($response | get success) {
|
|
|
|
|
return { status: "error", message: ($response | get error) }
|
2025-12-11 21:57:05 +00:00
|
|
|
}
|
2025-10-07 10:32:04 +01:00
|
|
|
|
2026-01-14 02:00:23 +00:00
|
|
|
let task_id = ($response | get data)
|
|
|
|
|
_print $"Taskserv ($operation) workflow submitted: ($task_id)"
|
2025-12-11 21:57:05 +00:00
|
|
|
|
2026-01-14 02:00:23 +00:00
|
|
|
if $wait {
|
|
|
|
|
wait_for_workflow_completion $orch_url $task_id
|
2025-10-07 10:32:04 +01:00
|
|
|
} else {
|
2026-01-14 02:00:23 +00:00
|
|
|
{ status: "submitted", task_id: $task_id }
|
2025-10-07 10:32:04 +01:00
|
|
|
}
|
|
|
|
|
}
|
|
|
|
|
|
2026-01-14 02:00:23 +00:00
|
|
|
# Specific taskserv operations
|
|
|
|
|
export def "taskserv create" [
|
|
|
|
|
taskserv: string # Taskserv name
|
|
|
|
|
infra?: string # Infrastructure target
|
|
|
|
|
settings?: string # Settings file path
|
|
|
|
|
--check (-c) # Check mode only
|
|
|
|
|
--wait (-w) # Wait for completion
|
|
|
|
|
--orchestrator: string = "" # Orchestrator URL (optional, uses platform config if not provided)
|
|
|
|
|
] {
|
|
|
|
|
taskserv_workflow $taskserv "create" $infra $settings --check=$check --wait=$wait --orchestrator $orchestrator
|
2025-10-07 10:32:04 +01:00
|
|
|
}
|
|
|
|
|
|
2026-01-14 02:00:23 +00:00
|
|
|
export def "taskserv delete" [
|
|
|
|
|
taskserv: string # Taskserv name
|
|
|
|
|
infra?: string # Infrastructure target
|
|
|
|
|
settings?: string # Settings file path
|
|
|
|
|
--check (-c) # Check mode only
|
|
|
|
|
--wait (-w) # Wait for completion
|
|
|
|
|
--orchestrator: string = "" # Orchestrator URL (optional, uses platform config if not provided)
|
|
|
|
|
] {
|
|
|
|
|
taskserv_workflow $taskserv "delete" $infra $settings --check=$check --wait=$wait --orchestrator $orchestrator
|
2025-10-07 10:32:04 +01:00
|
|
|
}
|
|
|
|
|
|
2026-01-14 02:00:23 +00:00
|
|
|
export def "taskserv generate" [
|
|
|
|
|
taskserv: string # Taskserv name
|
|
|
|
|
infra?: string # Infrastructure target
|
|
|
|
|
settings?: string # Settings file path
|
|
|
|
|
--check (-c) # Check mode only
|
|
|
|
|
--wait (-w) # Wait for completion
|
|
|
|
|
--orchestrator: string = "" # Orchestrator URL (optional, uses platform config if not provided)
|
|
|
|
|
] {
|
|
|
|
|
taskserv_workflow $taskserv "generate" $infra $settings --check=$check --wait=$wait --orchestrator $orchestrator
|
|
|
|
|
}
|
2025-10-07 10:32:04 +01:00
|
|
|
|
2026-01-14 02:00:23 +00:00
|
|
|
export def "taskserv check-updates" [
|
|
|
|
|
taskserv?: string # Taskserv name (optional for all)
|
|
|
|
|
infra?: string # Infrastructure target
|
|
|
|
|
settings?: string # Settings file path
|
|
|
|
|
--check (-c) # Check mode only
|
|
|
|
|
--wait (-w) # Wait for completion
|
|
|
|
|
--orchestrator: string = "" # Orchestrator URL (optional, uses platform config if not provided)
|
|
|
|
|
] {
|
|
|
|
|
let taskserv_name = ($taskserv | default "")
|
|
|
|
|
taskserv_workflow $taskserv_name "check-updates" $infra $settings --check=$check --wait=$wait --orchestrator $orchestrator
|
|
|
|
|
}
|
2025-10-07 10:32:04 +01:00
|
|
|
|
2026-01-14 02:00:23 +00:00
|
|
|
def wait_for_workflow_completion [orchestrator: string, task_id: string] {
|
|
|
|
|
_print "Waiting for workflow completion..."
|
2025-10-07 10:32:04 +01:00
|
|
|
|
2026-01-14 02:00:23 +00:00
|
|
|
mut result = { status: "pending" }
|
2025-10-07 10:32:04 +01:00
|
|
|
|
2026-01-14 02:00:23 +00:00
|
|
|
while true {
|
|
|
|
|
let status_response = (http get $"($orchestrator)/tasks/($task_id)")
|
2025-10-07 10:32:04 +01:00
|
|
|
|
2026-01-14 02:00:23 +00:00
|
|
|
if not ($status_response | get success) {
|
|
|
|
|
return { status: "error", message: "Failed to get task status" }
|
|
|
|
|
}
|
2025-10-07 10:32:04 +01:00
|
|
|
|
2026-01-14 02:00:23 +00:00
|
|
|
let task = ($status_response | get data)
|
|
|
|
|
let task_status = ($task | get status)
|
2025-10-07 10:32:04 +01:00
|
|
|
|
2026-01-14 02:00:23 +00:00
|
|
|
match $task_status {
|
|
|
|
|
"Completed" => {
|
|
|
|
|
_print $"✅ Workflow completed successfully"
|
|
|
|
|
if ($task | get output | is-not-empty) {
|
|
|
|
|
_print "Output:"
|
|
|
|
|
_print ($task | get output)
|
2025-10-07 10:32:04 +01:00
|
|
|
}
|
2026-01-14 02:00:23 +00:00
|
|
|
$result = { status: "completed", task: $task }
|
|
|
|
|
break
|
|
|
|
|
},
|
|
|
|
|
"Failed" => {
|
|
|
|
|
_print $"❌ Workflow failed"
|
|
|
|
|
if ($task | get error | is-not-empty) {
|
|
|
|
|
_print "Error:"
|
|
|
|
|
_print ($task | get error)
|
2025-10-07 10:32:04 +01:00
|
|
|
}
|
2026-01-14 02:00:23 +00:00
|
|
|
$result = { status: "failed", task: $task }
|
|
|
|
|
break
|
|
|
|
|
},
|
|
|
|
|
"Running" => {
|
|
|
|
|
_print $"🔄 Workflow is running..."
|
|
|
|
|
},
|
|
|
|
|
_ => {
|
|
|
|
|
_print $"⏳ Workflow status: ($task_status)"
|
2025-10-07 10:32:04 +01:00
|
|
|
}
|
|
|
|
|
}
|
|
|
|
|
|
2026-01-14 02:00:23 +00:00
|
|
|
sleep 2sec
|
2025-10-07 10:32:04 +01:00
|
|
|
}
|
|
|
|
|
|
2026-01-14 02:00:23 +00:00
|
|
|
return $result
|
chore: complete KCL to Nickel migration cleanup and setup pre-commit
Clean up 404 KCL references (99.75% complete):
- Rename kcl_* variables to schema_*/nickel_* (kcl_path→schema_path, etc.)
- Update functions: parse_kcl_file→parse_nickel_file
- Update env vars: KCL_MOD_PATH→NICKEL_IMPORT_PATH
- Fix cli/providers-install: add has_nickel and nickel_version variables
- Correct import syntax: .nickel.→.ncl.
- Update 57 files across core, CLI, config, and utilities
Configure pre-commit hooks:
- Activate: nushell-check, nickel-typecheck, markdownlint
- Comment out: Rust hooks (fmt, clippy, test), check-yaml
Testing:
- Module discovery: 9 modules (6 providers, 1 taskserv, 2 clusters) ✅
- Syntax validation: 15 core files ✅
- Pre-commit hooks: all passing ✅
2026-01-08 20:08:46 +00:00
|
|
|
}
|