GPU MANAGEMENT SOLUTIONS

Every GPU. Every watt.
One connected view.

Bring node health, workload dispatch and household energy into a single management experience. Explore how SunStack’s control platform is being developed for distributed compute.

SunStack control roomDistributed GPU operations
INTERACTIVE DEMO
GPU nodes4 example nodes
Available3 ready for work
Energy hold1 waiting for surplus
GPU power675 W total
Node / locationHardwareUtilisationPowerStatus
Sydney · Node 01RTX 309024 GB VRAM
78%
225 WAvailable
Newcastle · Node 02RTX 409024 GB VRAM
64%
270 WAvailable
Wollongong · Node 03RTX 309024 GB VRAM
42%
180 WAvailable
Dubbo · Node 04RTX 409024 GB VRAM
0%
0 WEnergy hold
Example data and simulated controls. No live infrastructure is connected.
FROM DEVICE TO DECISION

Five responsibilities.
One coordinated system.

A management approach that connects telemetry to decisions, while keeping device limits and household priorities visible.

01

Connect & discover

Connect heterogeneous GPU nodes and energy devices. Record hardware capabilities, connectivity and available resources.

02

Monitor & meter

Bring GPU utilisation, power, temperature, workload activity and dedicated energy metering into one operational view.

03

Understand the energy

Consider PV availability, battery state of charge, household load, tariffs and grid constraints before scheduling.

04

Predict performance & energy

Study how a job behaves on different GPU configurations and power limits to estimate runtime, energy and capacity needs.

05

Schedule & supervise

Match jobs to appropriate nodes, apply supported power controls, and respond to changing energy conditions or node failures.

The control room uses illustrative data. Predictive scheduling, automated power control and recovery are development capabilities, subject to hardware support and trial validation.

A PRACTICAL SYSTEM ARCHITECTURE

Local limits. Coordinated decisions.

The management approach connects observations from each property with workload planning and an operator’s view of the network.

OBSERVE

Site telemetry

PV, battery, household and GPU metering.

OPERATE

Node runtime

Device health, capabilities and supported local controls.

COORDINATE

The scheduler

Job matching, energy windows and recovery decisions.

SUPERVISE

Operator console

Fleet state, policies, workload status and measured outcomes.

PERFORMANCE & ENERGY PLANNING

Before a job runs,
understand its options.

The prediction module is intended to estimate the consequences of choosing a GPU configuration and power setting. More GPUs do not automatically mean a better result.

Explore the evaluation approach
INPUTS

Describe the job and the hardware.

Task typeModel & memoryGPU generationGPU countPower limitEnergy windowDeadline
ESTIMATES

Compare useful outcomes.

Completion timeEnergy consumptionRequired capacityPower demandScaling efficiencyCost under agreed tariffs

Predictions need calibration against measured workloads. Multi-GPU estimates must reflect interconnect, task parallelism and system overhead.

CONTROL THAT RESPECTS THE SETTING

Respond to the conditions that matter.

Intended operating responses are subject to hardware support, workload behaviour and validation in trials.

ConditionManagement intentWhat needs to remain visible
Household demand increasesReduce new job admission or supported GPU power within the agreed policy.Household load, GPU allocation and the reason for a change.
Battery approaches its reserveRestrict battery-supported work and preserve the household reserve.State of charge, reserve setting and eligible energy sources.
Temperature approaches a limitApply supported throttling, pause work or take the node out of service.Temperature, effective power limit and recovery state.
A node becomes unreachableStop assigning new work and assess restart or migration options.Job state, retry cost, output integrity and node connectivity.
A job needs more resourcesReassess placement and feasibility against model memory and runtime needs.GPU capability, resource requirements and an explanation of the match.
DEPLOYMENT & INTEGRATION

Start with visibility. Build towards control.

01

Discover the environment

Inventory GPUs, energy devices, metering, network boundaries and existing operating constraints.

02

Establish a baseline

Collect comparable telemetry and measure representative workloads before applying optimisation.

03

Run a controlled pilot

Introduce limited scheduling and supported controls, with clear fallbacks and reviewable results.

04

Expand with evidence

Use measured performance, household impact and operational outcomes to guide further deployment.

PLATFORM QUESTIONS

Designed for a mixed, changing fleet.

LET’S BUILD WHAT’S NEXT

Build a deployment that understands its energy.

Talk about GPU management