Software Engineer - Data Engineering-Zeotap
📢 Job Opportunity Alert!
Position: Software Engineer - Data Engineering
Location: Bengaluru
Company: Zeotap
Type: Full-Time
Experience: Fresher/Experienced
Responsibilities:
- I design and implement robust, scalable, and high-performance data pipelines using Spark, Scala, and Airflow, and I am familiar with Google Cloud.
- Develop, construct, test, and maintain architectures such as databases and large-scale processing systems.
- Assemble large, complex data sets that meet functional and non-functional business requirements.
- Build the infrastructure required for optimal extraction, transformation, and loading (ETL) of data from various data sources.
- Collaborate with data scientists and other stakeholders to improve data models that drive business processes.
- Implement data flow and tracking using Apache Airflow.
- Ensure data quality and integrity across various data processing stages.
- Monitor and optimize the performance of data processing pipelines.
- Tune and optimize Spark jobs for performance and efficiency, ensuring they run effectively on large-scale datasets.
- Troubleshoot and resolve issues related to data pipelines and infrastructure.
- Stay up-to-date with the latest technologies and best practices in Big Data and data engineering.
- Adhere to Zeotap’s company, privacy, and information security policies and procedures.
- Complete all assigned awareness training on time.
Requirements:
- 2+ years of experience in building and deploying high-scale solutions.
- Strong problem-solving skills with clear fundamentals of data structures and algorithms.
- Expert coding skills in Java or Scala.
- Coding skills in Go or Python are a significant plus.
- Mandatory experience with Apache Spark or other Big Data stack technologies.
- Proficiency in high-level and low-level design.
- A significant advantage is a deep understanding of any OLTP, OLAP, NoSQL, or Graph databases.
- Hands-on experience with distributed systems and design is highly desirable.
- Knowledge of streaming technologies such as Kafka, Flink, or Samza is a big plus.
- Solid understanding of scalable Big Data technologies.
- Bachelor’s or Master’s degree in Information Systems, Computer Science, or a related field is preferred.
How to Apply: Click Here
Comments
Post a Comment