| Primary use case | Classification, regression, forecasting, anomaly detection, recommendation | Chat, search, summarization, copilots, content generation, document Q&A |
| Programming language | Python, R | Python, JavaScript / TypeScript |
| Core model stack | Scikit-learn, XGBoost, PyTorch, TensorFlow | PyTorch, TensorFlow, Hugging Face Transformers |
| Data layer | Pandas, NumPy, feature pipelines | Pandas, NumPy, document parsing, chunking, embeddings |
| Serving/API layer | FastAPI, Flask | FastAPI, Flask, vLLM, Ollama |
| App UI/prototyping | Jupyter Notebook, Streamlit, web app | Gradio, Streamlit, web app |
| Storage | PostgreSQL, MongoDB, object storage | PostgreSQL, MongoDB, Pinecone, Qdrant, Milvus, pgvector |
| Retrieval layer | Usually not needed | Vector store/vector index, embeddings, reranking |
| Model orchestration | Batch jobs, model endpoints, and scheduled pipelines | LangChain, LangGraph, LlamaIndex, Semantic Kernel |
| Experiment tracking/evaluation | MLflow, offline metrics, A/B testing | MLflow, prompt evaluation, response quality checks, tracing |
| Containerization | Docker | Docker |
| Orchestration/scaling | Kubernetes | Kubernetes |
| Cloud platform | AWS, Azure, Google Cloud | AWS, Azure, Google Cloud |
| Monitoring | Logs, latency, accuracy, drift, infra metrics | Logs, latency, token usage, response quality, infra metrics |
| CI/CD | GitHub Actions, GitLab CI, Jenkins | GitHub Actions, GitLab CI, Jenkins |
| Testing | Unit tests, integration tests, load tests | Unit tests, integration tests, load tests, prompt / output evaluation |