Data Engineer

Hero is hiring the sharpest brains to create the future of mobility.

Job Description:

Connects and models complex distributed data sets to build repositories, such as data warehouses, data lakes, using appropriate technologies. Manages data-related contexts ranging across addressing small to large data sets, structured/unstructured or streaming data, extraction, transformation, curation, modelling, building data pipelines, identifying right tools, writing SQL/Java/Scala code, etc. 

Responsibilities:

• Create and maintain optimal data pipeline architecture.
• Assemble large, complex data sets that meet functional / non-functional business requirements.
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS ‘big data’ technologies.
• Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
• Work with stakeholders including the Executive, Product, Data, and Design teams to assist with data-related technical issues and support their data infrastructure needs.
• Keep data secure. 
• Create data tools for analytics and data scientist team members.
• Work with data and analytics experts to strive for greater functionality data systems

Eligibility:

• Minimum of 4 years of hands-on experience with a strong data background. 
• Bachelor's degree in Computer Science or equivalent; Masters preferred. 
• Extensive experience working with Big Data tools and building data solutions for advanced analytics.
• Practical knowledge across data extraction and transformation tools - traditional ETL tools (Informatica, Altryx)as well as more recent big data tools
• Knowledge in data architecture, defining data retention policies, monitoring performance, and advising any necessary infrastructure changes
• Solid development skills in Java, Scala, and SQL
• Clear hands-on mastery in big database systems - Hadoop ecosystem, Cloud technologies (AWS, Azure, Google), in-memory database systems (HANA, Hazel cast, etc) and other database systems - traditional RDBMS (Terradata, SQL Server, Oracle), and NoSQL databases (Cassandra, MongoDB, DynamoDB)
• Comfortable in dashboard development (Tableau, Powerbi, Qlik, etc) and in developing data analytics models (R, Python, Spark)
• The Applicants with Full-Time degrees will only be eligible.

Compensation: INR 15 - INR 25 LPA*

*The compensation/offer will be based on the total years of relevant experience, Skill/Competencies, Academic background, and the current compensation structure and will be decided on a case-to-case basis.