Big Data Engineer
- Develop end-to-end big data pipelines
- Utilise technologies such as Hadoop, Hive, Spark, and Scala
- Implement data warehouse and ETL concepts
About the job Big Data Engineer
Job Description for Big Data Engineer:
Primary Skills- Bigdata Hadoop, Hive, Spark, scala, SQL
Secondary Skills- DW/ETL, Unix, Git, Bitbucket, ControlM
- 3-5 years of experience in developing end to end bigdata pipeline
- Must have experience in developing at least 1 bigdata project using hive, spark, scala
- Thorough understanding of Hadoop and spark architecture
- Strong SQL skills
- Basic understanding of Unix scripting
- Good understanding of Data warehouse/ETL concepts
- Experience on any version control tool
- Experience on any job scheduling tool
- Good to have knowledge on Azure or any other cloud
- Good to have experience on Hive Query or spark code optimization
We vet all employer accounts and do our best to keep job ads safe, but scams can still occur. Be cautious when sharing personal information — never provide financial details or make payments during the application process. For extra security, use the Apply button on our site when proceeding.
Skills
0 of 13 matchedPyramid Global Technologies