2023 — Now
Software Engineer II
UKG · Remote
- Architected and implemented a high-availability LiteLLM AI proxy platform with active-active nodes, a Redis caching layer and a Cloud SQL backend, giving thousands of engineers lower-latency, more cost-efficient access to LLMs through prompt caching.
- Built a Python data pipeline that pulls LiteLLM's daily activity API into MongoDB to capture usage and spend, including a historical backfill from January 2025, powering executive dashboards for AI adoption.
- Wrote Python automation for JFrog Artifactory: programmatic permission targets, repository bandwidth monitoring with BigQuery, and regex-based repository organization.
- Created Jira ScriptRunner API endpoints for incident lifecycle management, integrated with Microsoft Teams through Power Automate for real-time executive visibility.
- Built GitHub Actions workflows for Copilot Agent ruleset management and Artifactory permissions, enabling self-service repository onboarding.
- Designed Grafana dashboards backed by BigQuery to track authenticated vs. anonymous Artifactory access during a company-wide security migration.