Features & roadmap

• Cloud providers
  • AWS
  • GCP
  • Azure
  • On-prem
• PipelineTags (versioning + CI/CD)
• PipelineFiles
• Custom environments
• Multi GPU pools (currently working on-prem)
• CPU nodes
• GPU nodes
• Grafana dashboards
• Prometheus tracking
• Predictive caching (cold start reduction)
• Spot instance support
• Predictive autoscaling
• Streaming
• Auto batch inference