Search Results for "load balancing in cloud"
Sort By:
48 projects for "load balancing in cloud" with 1 filter applied:
-
Run applications fast and securely in a fully managed environmentRun frontend and backend services, batch jobs, deploy websites and applications, and queue processing workloads without the need to manage infrastructure.
-
Cloud-based help desk software with ServoDeskWhat if You Could Automate 90% of Your Repetitive Tasks in Under 30 Days? At ServoDesk, we help businesses like yours automate operations with AI, allowing you to cut service times in half and increase productivity by 25% - without hiring more staff.
-
1
EPLB
Expert Parallelism Load Balancer
...It uses policies like hierarchical load balancing (grouped experts placed at node and then GPU level) and global load balancing depending on configuration. The logic is implemented in eplb.py and supports predicting placements given estimated expert usage weights. EPLB aims to reduce hot-spotting and ensure more uniform usage of compute resources in large MoE deployments. -
2
Spring Cloud Tencent
A Spring Cloud based Service Governance Framework
Spring Cloud Tencent is a Spring Cloud-based Service Governance Framework provided by Tencent. Spring Cloud Tencent is an one-stop microservice solution which implements the standard Spring Cloud SPI. It integrates Spring Cloud with Tencent middlewares and makes it easy to develop microservice. -
3
DeepSeek-V3
Powerful AI language model (MoE) optimized for efficiency/performance
DeepSeek-V3 is a robust Mixture-of-Experts (MoE) language model developed by DeepSeek, featuring a total of 671 billion parameters, with 37 billion activated per token. It employs Multi-head Latent Attention (MLA) and the DeepSeekMoE architecture to enhance computational efficiency. The model introduces an auxiliary-loss-free load balancing strategy and a multi-token prediction training objective to boost performance. Trained on 14.8 trillion diverse, high-quality tokens, DeepSeek-V3 underwent supervised fine-tuning and reinforcement learning to fully realize its capabilities. Evaluations indicate that it outperforms other open-source models and rivals leading closed-source models, achieving this with a training duration of 55 days on 2,048 Nvidia H800 GPUs, costing approximately $5.58 million. -
4
guide-rpc-framework
A custom RPC framework implemented by Netty+Kyro+Zookeeper
...It’s aimed primarily at learners and practitioners of distributed systems who want to see how you might build an RPC system from first principles rather than just use an existing library. The project provides code for client-side stubs, server-side skeletons, method dispatching, serialization, load balancing, and node management via Zookeeper. Since RPC remains a foundational building block in microservices, server architectures, and high-performance systems, this codebase helps you trace how requests are framed, routed, serialized, and executed across nodes. Because it integrates key pieces of the ecosystem (Netty event loops, Kyro object graphs, Zookeeper coordination), you also gain exposure to that stack. -
Share your screen instantly while on a phone call with CrankWheel for an engaging presentation.Our 10x simpler screen sharing tool is designed for you if you spend your days on the phone with clients, and need to add a visual presentation to close sales. No more scheduling a follow-up meeting, or teaching them to use a complex tool. Send them a text message or email, and they see your screen in seconds.
-
5
Clouddriver
Read and write operations across cloud providers
Clouddriver is the cloud-provider integration layer of Spinnaker, exposing a uniform API and cache for infrastructure resources across multiple clouds. It discovers and tracks entities such as server groups, load balancers, security groups, images, and instances, normalizing them so higher-level services can reason consistently. The service also brokers mutating operations—like creating server groups or resizing clusters—by translating Spinnaker requests into provider-specific calls. ... -
6
NGINX Admin’s Handbook
How to improve NGINX performance, security, and other important things
nginx-admins-handbook is a practical, in-depth guide for configuring, securing, and operating NGINX across real-world deployments. It distills years of research, notes, and field experience into a single handbook that complements the official docs with concrete rules, explanations, and curated external references. The handbook spans fundamentals and advanced topics alike, from HTTP and SSL/TLS basics to reverse proxy patterns, performance tuning, debugging workflows, and hardening... -
7
aws-devops-zero-to-hero
AWS zero to hero repo for devops engineers to learn AWS in 30 Days
...Later in the curriculum, you move into topics like CloudFormation, CodeCommit/CodePipeline/CodeBuild/CodeDeploy, Terraform on AWS, CloudTrail and Config for compliance, Elastic Load Balancing, and cloud migration strategies. A full day is dedicated to “500 AWS interview questions and answers,” which makes this repo double as an interview prep resource as well as a skills builder. -
8
Armeria
Your go-to microservice framework for any situation
Build a reactive microservice at your pace, not theirs. Armeria is your go-to microservice framework for any situation. You can build any type of microservice leveraging your favorite technologies, including gRPC, Thrift, Kotlin, Retrofit, Reactive Streams, Spring Boot and Dropwizard. Let's embrace the reality, we almost always have to deal with more than one protocol. It was once Thrift, today it's gRPC, and REST never gets old. At the same time, you sometimes have to handle health check... -
9
Portkey AI Gateway
A blazing fast AI Gateway with integrated guardrails
...It presents a single, friendly API through which you can route to 200+ LLMs, while applying configurable input/output guardrails to enforce policies or restrict certain content. It supports automatic retries, fallbacks, load balancing across providers or keys, and request timeouts to avoid latency spikes. The gateway is multimodal: it can handle text, vision, audio, and image models under a common interface. It also offers features for governance: role-based access, compliance with standards (SOC2, HIPAA, GDPR), secure key management, and logging/analytics of usage, latency, errors, and cost. ... -
Junie, the AI coding agent by JetBrainsJunie is an AI-powered coding agent developed by JetBrains designed to enhance developer productivity by integrating directly into popular IDEs such as IntelliJ IDEA, PyCharm, and Android Studio. It supports developers by assisting with code completion, testing, and inspections, ensuring code quality and reducing debugging time.
-
10
Pangolin
Identity-Aware Tunneled Reverse Proxy Server with Dashboard UI
Pangolin is an open-source, self-hosted tunneled reverse proxy server that brings identity-aware access control and dashboard management to exposing private services securely. It allows you to connect applications and resources behind firewalls or NATs to a central hub, using encrypted tunnels rather than opening public ports or relying entirely on VPNs. With Pangolin you can route traffic from across distributed networks, enforce contextual access rules (such as SSO, geolocation, time of... -
11
CoreNet
CoreNet: A library for training deep neural networks
...CoreNet provides abstractions for data, tensor, and pipeline parallelism, allowing models to scale without code duplication or heavy manual configuration. Its distributed runtime manages synchronization, load balancing, and mixed-precision computation to maximize throughput while minimizing communication bottlenecks. CoreNet integrates tightly with Apple’s proprietary ML stack and hardware, serving as the foundation for research in computer vision, language models, and multimodal systems within Apple AI. The framework includes monitoring tools, fault tolerance mechanisms, and efficient checkpointing for massive training runs. -
12
Thread Affinity
Bind a java thread to a given core
Lets you bind a thread to a given core, this can improve performance (this library works best on linux). Java-Thread-Affinity will try to use JNA to provide access to native thread-handling functions. JNA should be installed on your system to get the most from this library. Java-Thread-Affinity currently depends on JNA version 4.4.0, which in turn depends on a version of GLIBC >= 2.14. If your operating system is an old one, with a version of GLIBC released before 2011, this library will not... -
13
Bifrost
The Fastest LLM Gateway with built in OTel observability
...It is built to be high performance: in benchmark tests at 5,000 requests per second, it reportedly adds only microseconds of overhead and achieves perfect success rates with no failed requests. Bifrost supports features such as automatic fallback (failover between providers), load balancing across API keys/providers, and semantic caching to reduce latency and cost. It also includes observability with built-in metrics, tracing, logging, and supports governance features like rate limiting, access control, and cost budgeting. The architecture is modular: there is a core engine, plugin layers, and transport layers (HTTP APIs). -
14
testkube
Kubernetes-native testing framework for test execution
...Testkube uses Kubernetes-native constructs to store and run your test definitions ensuring compatibility, security, and scalability for all your testing needs. Advanced test orchestration functionality enables you to parameterize and parallelize your load, API, and UI tests to simulate real-life usage scenarios. -
15
Azure Zero to Hero Course
Repository to learn Azure from Zero
Azure Zero to Hero Course is a comprehensive, day-by-day course repository designed to teach Azure fundamentals and practical skills from the ground up, targeted especially at aspiring DevOps engineers. The README is structured as a multi-day curriculum: early days cover cloud concepts, terminology, and Azure basics such as regions, availability zones, resource groups, and VM creation. Subsequent days dive into networking (VNets, subnets, NSGs, load balancers, firewalls), storage services, Azure CLI, IAM/RBAC, and Azure DevOps. Multiple days are dedicated to full projects, such as deploying an application behind a firewall on Azure, building CI/CD pipelines with Azure DevOps and AKS, deploying a three-tier e-commerce app on AKS, and integrating Key Vault with Kubernetes using CSI drivers. ... -
16
Apache Sedona
Cluster computing framework for processing large-scale geospatial data
...Sedona offers Scala, Java, Spatial SQL, Python, and R APIs and integrates them into underlying system kernels with care. You can simply create spatial analytics and data mining applications and run them in any cloud environments. -
17
pipeless
A computer vision framework to create and deploy apps in minutes
...You provide some functions that are executed for new video frames and Pipeless takes care of everything else. You can easily use industry-standard models, such as YOLO, or load your custom model in one of the supported inference runtimes. Pipeless ships some of the most popular inference runtimes, such as the ONNX Runtime, allowing you to run inference with high performance on CPU or GPU out-of-the-box. You can deploy your Pipeless application with a single command to edge and IoT devices or the cloud. -
18
System Design Notebook
Learn System Design step by step
System Design Notebook is a structured, personal knowledge base for learning and practicing system design, written in a way that mirrors real interview and on-the-job thinking. Instead of being a single long article, it’s split into topics like scalability, load balancing, data partitioning, caching, availability, consistency, and communication patterns, so you can study them in isolation. It emphasizes reasoning: why you pick a certain database, why you shard, why you put a queue, and what trade-offs come with each choice. The notes often connect abstract concepts to concrete systems such as social networks, feeds, chat, and file storage, which makes it easier to translate theory into design diagrams. ... -
19
Open Guide to AWS
Amazon Web Services — a practical guide
...Unlike official AWS documentation, which provides only formal product details, this guide integrates real-world experiences, advice, and caveats gathered from engineers who work with AWS daily. It covers core services such as EC2, S3, IAM, load balancers, and EBS, while also providing insights into optional and advanced services. The guide is designed to be concise, practical, and continuously updated, making it a valuable resource for both beginners and experienced cloud practitioners. It addresses topics like cost management, lock-in risks, service selection, and alternatives, helping users make informed architectural decisions. ... -
20
JPPF
The open source grid computing solution
JPPF makes it easy to parallelize computationally intensive tasks and execute them on a Grid. -
21
Bat2015
Bachelor of Science (Informatik)
...We create a distributed system with Apache thrift and the C-API of glpk. Now, it is possible to use as many cores in a network as you want. With a focus on the MILP methods we implement a load balancing and speed up the solving process in a multiplicative way. Sometimes we have super-linear speedup with a small set of hardware. With a splitting of problems, parallel computing and distributing the actual best solution to all running processes we solve CBP much faster than a sequential processing can do. -
22
Git repo: https://github.com/asipto/siremis Web management interface for Kamailio (OpenSER) - handle subscriber profiles, access control lists, accounting, least cost routing and load balancing, monitoring charts, xmlrpc communication with SIP server
-
23
Agent.GUI
The Project moved to github https://github.com/EnFlexIT/AgentWorkbench
The project has moved to github https://github.com/EnFlexIT/AgentWorkbench Agent.GUI is a simulation framework and toolkit based on the JADE framework. It provides functionalities for time aspects, agent-environment interaction, visualization and load balancing, Furthermore, the included application focuses the usability for end users. -
24
Blood Bank
A BloodBank Administration Software
This networked(LAN) software is made as an IT solution for a blood bank to support the day-to-day actions. The software is coded using Java language and the UI is implemented with JavaFX. Please concern that this software is developed mainly for educational purpose. -
25
Amoeba is a proxy that sits between your client and DB server(s) that can monitor, analyze or transform their communication. written in java. 1.load balancing 2、failover; 3、queries Route.projects:amoeba for mysql ,for mongodb,for aladdin
