Redundancy & Scheduling Logic
Details on the “One Model – Two Nodes” policy, workload distribution, failover systems, and fairness in task assignment.
DeepNode is designed to maximize reliability, fault tolerance, and performance efficiency when running AI models. At the core of this system are two core principles:
Redundancy — Every model is deployed across multiple nodes to ensure no single point of failure
Scheduling Logic — Tasks are assigned dynamically based on real-time performance, load, and reputation.
Together, these systems ensure that users receive fast, accurate responses, even during high traffic or partial network disruptions.
Redundant Execution
To ensure high availability and resilience:
Each production model is deployed on at least two Nodes, selected from different ends of the Node reputation spectrum:
One top-ranked Node (high reliability, high throughput)
One lower-ranked Node (to give new Nodes opportunity for growth and evaluation)
This 1 model → 2 Nodes setup enables:
Higher uptime and availability
Redundant fallback if a node fails
Fair rotation and decentralization
If a Node crashes, times out, or returns invalid output, the system automatically retries on the backup node.
Scheduling Logic
When a user request is made, DeepNode routes it to the best-fit Node through a multi-factor scheduling algorithm.
Key factors include:
Node reputation score
Prioritizes Nodes with consistent performance, uptime, and low error rates
Load balancing
Avoids overloading a single Node to maintain low latency
Recent failure rate
Penalizes Nodes with recent downtime or failed executions
Stake weight (optional override)
Can be used in certain Domains to give preference to highly staked Nodes
Fallback & Retries
If a Node fails to return a valid response within a defined timeframe:
The system automatically retries on the backup Node
If both fail, the user receives an error but is not charged
Node reputations are adjusted accordingly (penalty or reward)
This ensures users aren’t punished for infrastructure issues while incentivizes Miners to maintain reliable deployments.
Deployment Rotation
To prevent centralization and allow all Miners to build reputation over time:
DeepNode rotates deployments periodically across eligible Nodes
Models are rebalanced between top-tier and underutilized Nodes
Poor-performing Nodes are gradually phased out or slashed
This keeps the network dynamic, fair, and censorship-resistant, without compromising performance.
Last updated