Primary use case
Classification, regression, forecasting, anomaly detection, recommendation
Chat, search, summarization, copilots, content generation, document Q&A
Programming language
Python, R
Python, JavaScript / TypeScript
Core model stack
Scikit-learn, XGBoost, PyTorch, TensorFlow
PyTorch, TensorFlow, Hugging Face Transformers
Data layer
Pandas, NumPy, feature pipelines
Pandas, NumPy, document parsing, chunking, embeddings
Serving/API layer
FastAPI, Flask
FastAPI, Flask, vLLM, Ollama
App UI/prototyping
Jupyter Notebook, Streamlit, web app
Gradio, Streamlit, web app
Storage
PostgreSQL, MongoDB, object storage
PostgreSQL, MongoDB, Pinecone, Qdrant, Milvus, pgvector
Retrieval layer
Usually not needed
Vector store/vector index, embeddings, reranking
Model orchestration
Batch jobs, model endpoints, and scheduled pipelines
LangChain, LangGraph, LlamaIndex, Semantic Kernel
Experiment tracking/evaluation
MLflow, offline metrics, A/B testing
MLflow, prompt evaluation, response quality checks, tracing
Containerization
Docker
Docker
Orchestration/scaling
Kubernetes
Kubernetes
Cloud platform
AWS, Azure, Google Cloud
AWS, Azure, Google Cloud
Monitoring
Logs, latency, accuracy, drift, infra metrics
Logs, latency, token usage, response quality, infra metrics
CI/CD
GitHub Actions, GitLab CI, Jenkins
GitHub Actions, GitLab CI, Jenkins
Testing
Unit tests, integration tests, load tests
Unit tests, integration tests, load tests, prompt / output evaluation