G2 Risk Solutions- Business Intelligence Engineer
ConsultBae
- Bangalore, Karnataka
- Permanent
- Full-time
- Design, implement, and maintain data pipelines using Apache Airflow, ensuring the extraction, transformation, and loading (ETL) of data from various sources.
- Collaborate with engineers and analysts to ensure efficient and reliable data pipelines.
- Monitor and optimize data pipelines for performance and reliability. Data Extraction and Transformation:
- Utilize SQL and Python to extract data from various sources, including databases, APIs, and data warehouses.
- Utilize dbt to transform raw data into structured, clean, and well-documented datasets.
- Maintain and evolve dbt models to support evolving business requirements.
- Conduct data analysis to identify trends, patterns, and insights that can drive business decisions.
- Develop and maintain data models that support business intelligence and reporting needs.
- Create interactive reports and dashboards using business intelligence tools like Apache Superset, Amazon QuickSight, Tableau, Power BI, or custom Python solutions.
- Ensure that stakeholders have access to actionable insights through user-friendly dashboards.
- Collaborate with cross-functional teams, including engineers, data scientists, and business stakeholders, to understand and address their data needs and priorities.
- Communicate insights effectively and present data-driven recommendations to make data-driven decisions.
- Implement data quality checks and validations to ensure data accuracy and consistency.
- Maintain comprehensive documentation of data pipelines, data models, and reporting solutions.
- Share knowledge and best practices with colleagues to promote a data-driven culture.
- Identify opportunities to optimize query performance and data processing efficiency.
- Ensure data solutions are scalable to accommodate growing data volumes and evolving business needs.
- Strong proficiency in SQL for data extraction, transformation, and analysis.
- Proficiency in Python for data processing, scripting, and automation.
- Experience with Apache Airflow for building and managing ETL workflows.
- Knowledge of dbt (Data Build Tool) for transforming and modeling data in a version- controlled environment.
- Familiarity with Amazon QuickSight or similar data visualization tools.
- Strong problem-solving and critical-thinking skills.
- Excellent communication and collaboration skills.
- Attention to detail and a strong commitment to data quality.
- Knowledge of database systems, data warehousing, and data integration concepts.
- Bachelor's degree in a relevant field (e.g., Computer Science, Data Science, Business, or Engineering).
- Relevant certifications in data engineering, business intelligence, or related fields.
- Experience with cloud platforms (e.g., AWS, Azure, GCP).
- Knowledge of advanced