Infrastructure

AWS, cloud services, and compute infrastructure

1.

AWS

Core AWS services — EC2, S3, IAM

2.

LLM Gateways WIP

Routing, load balancing, and API management for LLMs

3.

Ray WIP

Distributed computing framework for scaling ML workloads, training, and tuning