Big Data Engineer – BDEIS222

Job Information

  • icon
    Category Engineering Jobs
  • icon
    Posted On May 19 ,2022
  • icon
    Qualifications Bachelor's Degree
  • icon
    Employer Name DelonJobs
  • icon
    Contact Email cv@delon.ng

Job Description

DelonJobs is seeking to hire a Big Data Engineer for aleading fintech company in Nigeria who will be responsible for collecting, storing, processing, analyzing of hugesets of data and choosing optimal solutions to maintain, implement, monitor, and integrate them with architecture. Interested candidates must possess a bachelor’s degree in Computer Science/Engineering or related field with a minimum of 3 years of industry experience in area oftechnical expertise. Salary is negotiable. To apply, kindly send your CV with the subject“Big Data Engineer – BDEIS222” to cv@delon.ng

Job Responsibilities

  1. Selecting and integrating any Big Data tools andframeworks required to provide requested capabilities.
  2. Implementing ETL processes.
  3. Design, build, maintain and test robust data pipelinesfor different types of data streams.
  4. Monitoring performance and advising any necessaryinfrastructure changes.
  5. Analyzing data and defining data retention policies.

Job Requirements

  1. Proficient understandingof distributed computing principles.
  2. Management of Hadoopcluster, with all included services.
  3. Ability to solve anyongoing issues with operating the cluster.
  4. Proficiency with Hadoopv2, MapReduce, HDFS.
  5. Experience with buildingstream-processing systems, using solutions such as Storm or Spark-Streaming.
  6. Good knowledge of BigData querying tools, such as Drill, Pig, Hive, and Impala.
  7. Experience with Spark.
  8. Experience withintegration of data from multiple data sources.
  9. Experience with NoSQLdatabases, such as HBase, Cassandra, MongoDB.
  10. Knowledge of various ETLtechniques and frameworks, such as Flume or Sqoop.
  11. Experience with variousmessaging systems, such as Kafka or RabbitMQ.
  12. Good understanding ofLambda Architecture, along with its advantages and drawbacks.
  13. Experience withMapR/Databricks/Cloudera platforms.
  14. Good scripting andprogramming skills (Scala/Python/Java).