
Data Engineer
- Bangalore, Karnataka
- Permanent
- Full-time
- Proficiency in SQL (Mandatory skill): Essential for querying, manipulating, and analyzing data within relational databases.
- Experience with spark streaming (Mandatory skill): Crucial for processing real-time data streams efficiently within big data solutions.
- Understanding of NoSQL databases (Mandatory skill): Vital for handling unstructured or semi-structured data formats in data-intensive applications.
- Experience in Spark: Key for large-scale data processing and analytical tasks within Jio's extensive data ecosystem.
- Proficiency in Spark SQL: Important for leveraging Spark's SQL interface to perform complex analytical queries effectively.
- Familiarity with Azure: Necessary for managing data solutions and storage within Microsofts cloud environment.
- Understanding of AWS: Essential for leveraging Amazons cloud services for scalable data storage and processing solutions.
- Experience with Kafka: Important for building real-time data pipelines and streaming applications.
- Design, develop, and maintain robust data pipelines for efficient data transformation and integration across platforms.
- Collaborate with cross-functional teams to gather and analyze data requirements, ensuring alignment with business goals.
- Implement real-time data streaming solutions using spark streaming, achieving high throughput and low latency data processing.
- Utilize SQL and NoSQL databases to manage, store, and retrieve large volumes of structured and unstructured data effectively.
- Optimize data workflows, improving performance and scalability of data-driven applications and reporting solutions.
- Ensure the security and integrity of data, implementing best practices for data protection and compliance.
- Participate in the deployment and monitoring of AI-driven analytics platforms, enhancing data-driven decision-making processes.
- Stay updated with emerging data technologies, recommending innovative solutions to foster continuous improvement.
Expertia AI Technologies