Big Data Engineer

Nubes Inc

India
Permanent
Full-time

7 days ago
Apply easily

Job Title: Big Data EngineerLocation: RemoteEmployment Type: Full-timeExperience Level: Mid to Senior LevelJob Overview:We are seeking a skilled Big Data Engineer with expertise in Azure Cloud, Databricks, and a strong background in Java and Spark/Scala. The ideal candidate will have hands-on experience designing and implementing scalable data pipelines and working with large-scale distributed systems. This is an opportunity to work on cutting-edge data solutions and contribute to impactful projects in a collaborative environment.Key Responsibilities:

Design, develop, and optimize big data pipelines using Spark and Scala.
Implement data processing workflows on Azure Databricks to handle complex datasets efficiently.
Leverage Azure Cloud services to design scalable and reliable data solutions.
Write high-quality, reusable, and efficient Java code for backend systems and data processing.
Collaborate with cross-functional teams to integrate data solutions into applications and services.
Monitor and maintain the performance of data systems, ensuring data integrity and reliability.
Stay updated with the latest industry trends and technologies to improve systems and processes.

Required Qualifications:

Azure Cloud: Minimum of 2 years of hands-on experience with Azure services such as Azure Data Lake, Azure Synapse, or Azure Functions.
Databricks: At least 2 years of experience working with Databricks for data engineering or analytics projects.
Big Data: 2+ years of experience with big data tools and frameworks, including Hadoop, Spark, and Kafka.
Java Development: 2+ years of experience with strong proficiency in building robust, scalable systems.
Spark/Scala: Minimum of 2 years of experience with Spark for big data processing and Scala programming.

Preferred Skills:

Familiarity with CI/CD pipelines and version control tools like Git.
Knowledge of data modeling and ETL frameworks.
Experience with SQL and NoSQL databases.
Strong analytical and problem-solving skills.
Excellent communication and teamwork abilities.

Nubes Inc