Job Title: AI Engineer - Document Intelligence with Big Data ExpertisePosition Type: Full-timeLocation: Gurgaon (Relocation will be required based upon project to Kanpur/ BLR/ Jaipur across India.Job Summary:As an AI Engineer with a specialization in Document Intelligence and Big Data, you will be at the forefront of designing and implementing AI solutions that leverage large-scale data processing technologies. Your role will involve integrating document and image analysis with big data ecosystems to derive insights from vast amounts of structured and unstructured data.Key Responsibilities:- Develop and optimize AI models for document classification, text extraction, and image processing, ensuring they are capable of handling big data volumes.- Implement NLP and computer vision algorithms to analyze and interpret complex documents and images within large datasets.- Utilize big data technologies such as Hadoop, Spark, and Hive to store, process, and analyze document-related data efficiently.- Work with OCR and image processing tools to convert documents into analyzable data, enhancing accuracy with big data processing techniques.- Establish and maintain a robust MLOps framework to manage the lifecycle of AI models within a big data environment.- Collaborate with data engineering teams to design and implement scalable data pipelines for real-time and batch processing of documents.- Monitor and optimize the performance of AI systems, ensuring they meet the scalability and reliability requirements of big data applications.- Apply best practices in data governance, ensuring compliance with data privacy and security standards when dealing with sensitive information.- Engage with stakeholders to gather requirements and deliver AI solutions that provide actionable insights from document data at scale.- Document and share knowledge on big data technologies and AI model development within the organization.Qualifications:- Bachelor's or master's degree in computer science, Artificial Intelligence, Machine Learning.- Proven experience with AI, machine learning, image processing, NLP, and big data technologies.- Proficiency in programming languages such as Python, Java, Scala, or similar.- Strong understanding of big data ecosystems, including HDFS, Hive, and Spark.- Experience with machine learning frameworks (e.g., TensorFlow, PyTorch) and computer vision libraries (e.g., OpenCV).- Knowledge of OCR technologies and their application in big data contexts.- Familiarity with MLOps and AI Ops practices, particularly in big data environments.- Excellent analytical and problem-solving skills, with a track record of working on complex data-driven projects.Preferred Skills:- Experience with cloud-based big data services- Proficiency with data warehousing solutions and SQL-based query engines (e.g., Hive, Presto).- Knowledge of containerization (Docker), orchestration (Kubernetes), and microservices architecture.- Experience with CI/CD tools (e.g., Jenkins, GitLab CI) and infrastructure as code (e.g., Terraform, Ansible).- Understanding of data privacy regulations and their implications for big data processing.Work Experience: Minimum 2yrs in AI/ML
