OpenAgentSkill Registry Manifest
Skill: End To End Data Pipeline
Slug: hoangsonww-end-to-end-data-pipeline
Category: data-analysis
Description: 📈 A scalable, production-ready data pipeline for real-time streaming & batch processing, integrating Kafka, Spark, Airflow, AWS, Kubernetes, and MLflow. Supports end-to-end data ingestion, transformation, storage, monitoring, and AI/ML serving with CI/CD automation using Terraform & GitHub Actions.

Agent fit:
- Decision: 77/100 Strong shortlist
- Primary fit: GitHub automation
- Role: Companion skill

Supply profile:
- Track: Coding and developer agents
- Scenario: GitHub automation
- Applicable agents: Claude Code, CLI, Codex, Cursor, Python
- Maintenance: 16d since push
- Risk: Safe to try

Trust:
- Trust score: 79/100 Strong shortlist
- Audit: 84/100 Safe to try

Attribution:
- Status: Community indexed
- Source: GitHub star discovery
- Creator: hoangsonww
- Claim URL: https://www.openagentskill.com/skills/hoangsonww-end-to-end-data-pipeline#claim-this-skill

Install:
npx skills add hoangsonww/End-to-End-Data-Pipeline

URLs:
- Web: https://www.openagentskill.com/skills/hoangsonww-end-to-end-data-pipeline
- API: https://www.openagentskill.com/api/agent/skills/hoangsonww-end-to-end-data-pipeline
- Install API: https://www.openagentskill.com/api/skills/hoangsonww-end-to-end-data-pipeline/install
- Repository: https://github.com/hoangsonww/End-to-End-Data-Pipeline