Patent Leaderboard
USPTO Patent Rankings Data through Dec 31, 2025
Home › Autonomous allocation of deep neural network inference requests in a cluster with heterogeneous devices

Autonomous allocation of deep neural network inference requests in a cluster with heterogeneous devices

US Patent 12437233 · Granted Oct 7, 2025

Assignee

Inventors

View full patent text on Google Patents →

More Patents by These Inventors

Model optimization in infrastructure processing unit (IPU)2025
Multi-level caching for dynamic deep learning models2025
Graph context-based operator checks to improve graph clustering and execution in2025
Platform health engine in infrastructure processing unit2024
Serverless computing architecture for artificial intelligence workloads on edge 2024
Serverless computing architecture for artificial intelligence workloads on edge 2024
Serverless computing architecture for artificial intelligence workloads on edge 2024
Integrity verification of pre-compiled artificial intelligence model blobs using2024
Integrity verification of pre-compiled artificial intelligence model blobs using2024
Integrity verification of pre-compiled artificial intelligence model blobs using2024
Graph partitioning to exploit batch-level parallelism2024
Ensemble based cluster tuning and framework fallback for AI accelerators using t2023