Solutions Architect (PySpark, Spark, Python)
Model N
- Hyderabad, Telangana
- Permanent
- Full-time
- Work closely with stakeholders to understand business needs, goals, and requirements.
- Design scalable, reliable, and cost-effective data integration/extraction solutions. This includes selecting appropriate technologies, platforms, and architectural patterns.
- SME for Apache spark, providing technical guidance and support.
- Develop, improve, and maintain highly complex Government Pricing calculations with Spark.
- Work with our internal and external clients to implement, test and report client-specific methodologies using state-of-the-art and evolving technologies.
- Resolve ad-hoc Operations change requests, manage code optimization and provide technical guidance to our different stakeholders.
- Reconcile system calculation results to parallel calculations. Analyze and resolve discrepancies.
- Coach and guide team members as industry processes evolve.
- Address performance-related issues.
- Create and update knowledge base articles for common issues.
- Maintain detailed documentation of support issues, solutions provided, and troubleshooting steps.
- Implement preventive measures to reduce the recurrence of issues.
- Conduct regular training sessions to share insights, best practices, and updates with the team.
- Identify opportunities for process improvement within the Spark functionality.
- Generate regular reports on support activities, issue resolutions, and performance metrics.
- Should be flexible in timings, may require having some hours overlap with US team.
- Bachelor's degree in computer science, Information Technology, or a related field.
- Minimum of 8+ years as a Software Developer or similar role with Python.
- Expert in Apache Spark.
- Working experience with PySpark using Dataframes.
- Vast experience with libraries such as Pandas and NumPy.
- Expert in writing SQL.
- Experience in working in mandated deadline environment; effective in managing multiple client assignments; ability to prioritize.
- Knowledge of the software development life cycle and process improvement methodologies, including iterative development practices.
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration skills.
- Ability to work in a fast-paced environment and prioritize tasks effectively.
- Experience with front-end technologies: JSReport Studio, JavaScript, HTML, CSS
- Advanced modelling in Excel using pivot tables.