Job description L
- Selecting and integrating Big Data tools and frameworks
- Implementing Dataflow (ETL) process
- Monitoring performance and advising any necessary infrastructure changes
- Defining data retention process
- Sound knowledge of Big Data querying tools such as Pig, Hive and Impala
- Experience with build stream-processing systems, using solutions such as Storm or Spark- Streaming or cloud services (kinesis)
Candidate requirements :
- A candidate with 2 to 4 years of work experience in Big data ML toolkits, Spark, NoSQL databases such as HBase, MongoDB
- Experience on cloud service like AWS, GCP
- Good understanding of Lambda architecture
- Proficiency with Hadoop, MapReduce, HDFS
- Hands-on experience on AWS services such as EMR, Elastic Search, S3, Apache NiFi, Lambda, SQS, SNS, Kafka, Aurora, Kinesis, and Athena.
- work on visualizations technique tableau/graphs
- Should have a good hold on Python or Java / PHP
- Working with Linux computing environment and use of command-line tools like sed/awk
- Grasp at databases including RDBMS, NoSQL, MongoDB,elastic search etc.
Friday, September 04, 2020
Purplle - Data Engineer - Big Data Tools & Framework (2-4 yrs) (Purplle.com)
