35 Optimizer Modes Level Zero GPU Acceleration Director Ensembles 2,500+ Automated Tests

HyperSwarm Optimization Suite

Swarm optimization, from a single algorithm to a coordinated fleet.

A .NET library of swarm and metaheuristic optimizers, with the tooling to run them, measure them, and watch them converge.

35 Total Optimizers 12 Core, 14 Hybrids, 9 Advanced & MO
123+ Registered Features Explicit Feature Registry & Reflection
10 GPU Offload Classes Compiled Level Zero SPIR-V / Zebin
~2,500 Test Methods Across 191 Test Suites in .NET
SYSTEM ARCHITECTURE

Population-Based Optimization for Hard Search Problems

HyperSwarm is a collection of population-based optimizers for hard search problems: hyperparameter tuning, scheduling, routing, and continuous and multi-objective design spaces.

It ships the classic algorithms, hybrids that combine them, and a coordination layer that runs several swarms together and decides which ones deserve more budget. Characterization and visualization tools sit alongside the algorithms, so you can see why a run behaved the way it did.

👑
Director Ensembles

Allocates compute budget dynamically to high-performing subswarms.

⚡
Level Zero Compute

Offloads velocity updates, dominance checks, and hypervolume to Intel GPUs.

🤖
AutoML Engine

Powers telemetry-aware architecture exploration inside AutoMLApp.

DEEP CAPABILITIES

End-to-End Optimization Architecture

From single-particle mathematical operators to self-organizing multi-swarm ensembles across hardware backends.

🐝

Broad algorithm coverage

35 Optimizers across 4 Families

11 core swarm algorithms (PSO, Ant Colony, Bee Colony, Bat, Grey Wolf, Fish School, Firefly, Glowworm, Cuckoo, Krill Herd, Synchronizing Firefly), 14 hybrid metaheuristics, 7 advanced metaheuristics (including OfBatsAndBeacons, ILS, MAP-Elites), and 3 multi-objective engines.

🎯

Multi-objective search

Pareto & Hypervolume Precision

MOPSO and NSGA-III-style PSO with real-time non-dominated sorting, Pareto frontier preservation, and GPU-accelerated Monte Carlo hypervolume measurement.

👑

Fleet & Director coordination

Dynamic Subswarm Budget Allocation

Run heterogeneous swarms as coordinated ensembles. Director components plan subswarm launches, assign authority dynamically, and route workload across distributed hardware fabrics.

🧠

Self-adaptation & learning

25+ Controllers & Diversity Feedback

Fuzzy inertia control, topology learning, landscape analysis, entropy-based diversity tracking, early stopping, and automatic perturbation restart strategies.

🕸️

Stigmergy & shared memory

Indirect Trace Communication

Indirect pheromone-like coordination through shared trace buffers, episodic policy memory, and warm cache stores so repeated searches don't start from scratch.

📊

Characterization & visualization

Desktop & Hosted Real-Time Profilers

Deep runtime profiling, convergence trajectory monitors, spatial particle distribution visualizers, and detailed diagnostic logs explaining search decisions.

⚡

Hardware acceleration

10 Intel Level Zero GPU Offload Targets

Native Level Zero SPIR-V / zebin kernel offloads for ACO transitions, CMA-ES covariance, DE mutation, dominance matrix checks, N-body repulsion, and pairwise distances.

🤖

Feeds AutoMLApp

Autonomous Pipeline Tuning Backend

Acts as the pluggable search engine behind AutoMLApp's hyperparameter exploration, balancing model architecture performance against telemetry cost signals.

ALGORITHM VISUAL BLUEPRINT

The 35 Optimizer Modes

Comprehensive visual inventory across 11 Core Swarms, 14 Hybrids, 7 Advanced Metaheuristics, and 3 Multi-Objective engines in SwarmAlgorithms.

HYPERSWARM 35-OPTIMIZER ENGINE LEVEL ZERO SPIR-V OFFLOAD

SWARM & METAHEURISTIC ATLAS

35 verified optimizers • 11 Core Swarms • 14 Hybrids • 7 Advanced Metaheuristics • 3 Multi-Objective

Exact mathematical models in HyperSwarm.Optimizers — Click any tile to inspect parameters and GPU kernels
CORE SWARM #01
CORE SWARM #02
CORE SWARM #03
CORE SWARM #04
CORE SWARM #05
α β δ
CORE SWARM #06
CORE SWARM #07
CORE SWARM #08
CORE SWARM #09
CORE SWARM #10
CORE SWARM #11
HYBRID METAHEURISTICS #12
PSO DE
HYBRID METAHEURISTICS #13
PSO GWO
HYBRID METAHEURISTICS #14
PSO ACO
HYBRID METAHEURISTICS #15
PSO FA
HYBRID METAHEURISTICS #16
PSO SA
HYBRID METAHEURISTICS #17
PSO TS
HYBRID METAHEURISTICS #18
PSO CMAES
HYBRID METAHEURISTICS #19
ABC DE
HYBRID METAHEURISTICS #20
ACO GA
HYBRID METAHEURISTICS #21
BCO PSO
HYBRID METAHEURISTICS #22
DE SQP
HYBRID METAHEURISTICS #23
FA CS
HYBRID METAHEURISTICS #24
GWO WOA
HYBRID METAHEURISTICS #25
MEMETIC PSO
ADVANCED METAHEURISTICS #26
GORDON BATMAN ROBIN JOKER
ADVANCED METAHEURISTICS #27
ADVANCED METAHEURISTICS #28
ADVANCED METAHEURISTICS #29
T1 T2 T3 T4
ADVANCED METAHEURISTICS #30
ADVANCED METAHEURISTICS #31
ADVANCED METAHEURISTICS #32
MULTI-OBJECTIVE #33
MULTI-OBJECTIVE #34
MULTI-OBJECTIVE #35

Core Swarm Optimizers

11 Algorithms
Population Metaheuristics
Particle Swarm Optimization (PSO)

Classical and inertia-weighted velocity update models with global/local best tracking.

Ant Colony Optimization (ACO)

Pheromone trail deposition and probabilistic path construction with GPU offload.

Artificial Bee Colony (ABC)

Employed, onlooker, and scout bee foraging phases for multimodal landscapes.

Bat Algorithm (BA)

Echolocation, pulse emission frequency, and loudness attenuation tuning.

Grey Wolf Optimizer (GWO)

Alpha, Beta, Delta, and Omega hierarchical leadership hunting behavior.

Artificial Fish School (AFSA)

Praying, swarming, chasing, and leaping behaviors for dense search.

Firefly Algorithm (FA)

Light intensity flashing, attractiveness decay, and brightness distance attraction.

Glowworm Swarm (GSO)

Luciferin-induced variable neighborhood search for simultaneous multimodal peak capture.

Cuckoo Search (CS)

Lévy flights and parasitic egg replacement mechanisms for scale-invariant exploration.

Krill Herd (KH)

Movement induced by other individuals, foraging activity, and random directional diffusion.

Synchronizing Firefly

Coupled phase-oscillator synchrony with spatial coordinate updates.

Hybrid Metaheuristics

14 Algorithms
Cross-Disciplinary Hybrids
PSO + Differential Evolution (PSO-DE)

Velocity vectors combined with vector differences and binomial crossovers.

PSO + Grey Wolf (PSO-GWO)

Wolf pack leadership guiding velocity acceleration bounds.

PSO + Ant Colony (PSO-ACO)

Continuous particle trajectory informed by discrete pheromone graphs.

PSO + Firefly (PSO-FA)

Luminescence attraction applied to inertia-weighted particles.

PSO + Simulated Annealing (PSO-SA)

Boltzmann probability criteria preventing local stagnation.

PSO + Tabu Search (PSO-TS)

Tabu memory lists preventing revisited fitness basins.

PSO + CMA-ES

Covariance matrix adaptation applied to sub-clusters of swarm particles.

ABC + DE

Bee colony scout mutations replaced by differential vector shifts.

ACO + Genetic Algorithm (ACO-GA)

Chromosome crossover applied to high-pheromone tour solutions.

BCO + PSO

Bee colony foraging informing particle personal best memories.

DE + Sequential Quadratic (DE-SQP)

Global DE exploration transitioning into local SQP gradient polishing.

FA + Cuckoo Search (FA-CS)

Flashing attractiveness enhanced with heavy-tailed Lévy flight leaps.

GWO + Whale Optimizer (GWO-WOA)

Encircling pack hunts combined with spiral bubble-net foraging maneuvers.

Memetic PSO

Individual particles execute localized line-search polishing at each iteration.

Advanced Metaheuristics

7 Algorithms
High-Dimensional & Combinatorial
Of Bats and Beacons Swarm

Models the search interplay of four archetypal characters—Batman, Robin, Gordon, and Joker—following their classic tropes (vigilante tracking, loyal support, signal coordination, and chaotic disruption).

Iterated Local Search (ILS)

Perturbation and local neighborhood search cycles for combinatorial spaces.

MAP-Elites

Multi-dimensional Archive of Phenotypic Elites illuminating diverse behavioral niches.

Parallel Tempering

Replica exchange across heated energy levels to traverse rugged objective barriers.

GRASP

Greedy Randomized Adaptive Search Procedure for complex routing and scheduling.

Lagrangian Relaxation

Dual constraint relaxation for heavily bounded optimization constraints.

Augmented Lagrangian Swarm

Penalty parameter updates enforcing hard non-linear equality/inequality boundaries.

Multi-Objective Engines

3 Algorithms
Pareto & Hypervolume Precision
Multi-Objective PSO (MOPSO)

External archive of Pareto-optimal non-dominated leaders with crowding distance.

NSGA-III-Style PSO

Reference-point-based non-dominated particle sorting for 3+ objective tasks.

General Multi-Objective Swarm

Pluggable dominance comparator with dynamic hypervolume contribution tracking.

TOPOLOGY ARCHITECTURES (8 CLASSES)

Communication Neighborhoods

Self-Adaptive Controllers: ~25 Specialized Tuners
🌐 Global Best ⭕ Ring (LBest) 📐 Von Neumann Grid 📍 Random Geometric 🕸️ Scale-Free (Barabási-Albert) 🏝️ Multi-Swarm Island 🔄 Dynamic Re-linking 📏 Dimension-Adaptive

Topology learning dynamically shifts particle neighborhood connectivity based on entropy measurements and landscape variance, preventing early collapse into deceptive local optima.

FEATURE INVENTORY

123 Distinct Registered Features

Every capability is tagged with a distinct GUID/ID in the system registry, with reflection discovering additional plugin features at runtime.

40

Convergence Tracking & Metrics

Rate of change, stagnation detectors, diversity metrics, momentum gauges, and trajectory audits.

33

Self-Adaptive Controllers

Fuzzy logic inertia tuners, adaptive mutation rates, topology adaptation, and auto-temperature schedulers.

13

Ensemble & Multi-Swarm

Subswarm partitioning, migration managers, island models, and inter-swarm genetic exchange.

11

Director & Coordination

Dynamic budget allocator, supervisor authority matrices, task routing, and convergence arbitration.

11

Stigmergy & Policy Memory

Pheromone grid diffusion, episodic history recall, replay buffers, and warm-start caches.

11

Topologies & Neighborhoods

Global best, Ring, Von Neumann, Random Geometric, Scale-Free, Multi-Swarm, Dynamic, and Dimension-Adaptive.

10

Multi-Objective & Pareto

Non-dominated ranking, crowding distance, IGD+, hypervolume calculation, and reference-point niching.

3

Spatial Indexing & Partitions

KD-Tree spatial clustering, Voronoi particle partitioning, and neighbor lookups.

NATIVE SUBSTRATE Intel Level Zero API

Hardware Acceleration & Compiled GPU Kernels

HyperSwarm executes mathematical hotspots directly on Intel Xe / Arc / Data Center Max GPUs via LevelZero.NET C ABI shims.

Offload Target (10 Classes) Compiled GPU Kernel Mathematical Operation
ACO Transitions pairwise_distance, fitness_kernel GPU-accelerated tour edge selection and pheromone matrix updates.
CMA-ES Covariance exchange_weights, tile_placement Parallel matrix inversion and multivariate normal perturbation sampling.
DE Mutation & Crossover fitness_kernel, rastrigin_fitness Vector difference and binomial crossover computed across SIMD workgroups.
Dominance Matrix Checks dominance_matrix O(N²) all-to-all Pareto non-domination comparison performed in a single kernel launch.
Firefly Flashing & Distance firefly_attraction, pairwise_distance Quadratic distance attenuation and attractiveness updates parallelized across GPU threads.
Hypervolume Calculation monte_carlo_hypervolume High-throughput Monte Carlo sampling for multi-objective frontier hypervolume estimation.
N-Body & Swarm Repulsion nbody_repulsion Inter-particle electrostatic collision avoidance and diversity dispersion forces.
PSO Velocity Update pso_velocity Direct SIMD velocity and position updates across millions of particles per millisecond.
HyperSwarm Director Ensemble Invocation with Level Zero GPU Offload C# / .NET 10
// Build Director Ensemble with GPU acceleration and adaptive diversity budget
var ensemble = new SwarmDirectorBuilder()
    .WithSubSwarm("pso_exploratory", SwarmMode.PSO, size: 200, topology: Topology.ScaleFree)
    .WithSubSwarm("cuckoo_levy", SwarmMode.CuckooSearch, size: 80, topology: Topology.Ring)
    .WithSubSwarm("mopso_pareto", SwarmMode.MOPSO, size: 150, topology: Topology.Dynamic)
    .WithAcceleration(options => 
    {
        options.UseLevelZeroBackend = true;
        options.PreferredDevice = DeviceSelector.IntelDiscreteGpu;
        options.OffloadTargets = OffloadTarget.VelocityUpdate | OffloadTarget.DominanceMatrix | OffloadTarget.MonteCarloHypervolume;
    })
    .WithSelfAdaptation(adapt => 
    {
        adapt.TrackDiversityEntropy = true;
        adapt.DynamicRestartThreshold = 0.04;
    })
    .Build();

var report = await ensemble.OptimizeAsync(objectiveFunc, searchBounds, CancellationToken.None);
Console.WriteLine($"Global Best Fitness: {report.BestFitness} (Evaluated {report.TotalEvaluations} points across {report.SubSwarmCount} swarms)");
STATUS: ACTIVE DEVELOPMENT Production Ready Library & Coordination Layer

Implementation Maturity & Test Suite

The algorithms and coordination layer are fully implemented and verified against approximately 2,500 test methods across 191 test files. HyperSwarm provides the high-performance search backend powering AutoMLApp's hyperparameter tuning and runs in harmony with SwarmDev's intent pipelines.