OpenAgentSkill Registry Manifest
Skill: End To End Data Pipeline
Slug: hoangsonww-end-to-end-data-pipeline
Category: data-analysis
Description: 📈 A scalable, production-ready data pipeline for real-time streaming & batch processing, integrating Kafka, Spark, Airflow, AWS, Kubernetes, and MLflow. Supports end-to-end data ingestion, transformation, storage, monitoring, and AI/ML serving with CI/CD automation using Terraform & GitHub Actions.

Agent fit:
- Decision: 71/100 Prototype first
- Primary fit: GitHub automation
- Role: Fallback candidate

Supply profile:
- Track: Data, BI, and analytics
- Scenario: GitHub automation
- Applicable agents: Claude Code, CLI, Codex, Cursor, Python
- Maintenance: 2mo since push
- Risk: Needs review

Trust:
- Trust score: 78/100 Strong shortlist
- Audit: 80/100 Needs review

Attribution:
- Status: Community indexed
- Source: GitHub star discovery
- Creator: hoangsonww
- Claim URL: https://www.openagentskill.com/skills/hoangsonww-end-to-end-data-pipeline#claim-this-skill

Install:
npx skills add hoangsonww/End-to-End-Data-Pipeline

URLs:
- Web: https://www.openagentskill.com/skills/hoangsonww-end-to-end-data-pipeline
- API: https://www.openagentskill.com/api/agent/skills/hoangsonww-end-to-end-data-pipeline
- Install API: https://www.openagentskill.com/api/skills/hoangsonww-end-to-end-data-pipeline/install
- Repository: https://github.com/hoangsonww/End-to-End-Data-Pipeline