I worked in Sprout as a Jr. Data Engineer. My day-to-day job involves:
- Create and maintain ETL (Extract, Transform, Load) processes to move data from various sources to data storage systems using tools like Apache Airflow, DBT, dlt and others
- Manage databases to ensure data is stored efficiently and securely
- Design data models and schemas for efficient data storage and retrieval.
- Implement processes to ensure data accuracy and quality.
- Utilize tools like DLT to process large datasets.
- Develop dashboards and reports using visualization tools such as Superset and Grafana to support data-driven decisions.
- Collaborate with data scientists and analysts to understand data requirements and deliver data solutions.
Things I did while working here:
DBT Implementation on Dashboard
Improving Database Migration